pulsatrix 1.1.0
Loading...
Searching...
No Matches
op_type.hpp
Go to the documentation of this file.
1
5#pragma once
6
7namespace pulsatrix {
8
19enum class OpType {
20 Linear,
21 Conv,
26 Pooling,
47};
48
49} // namespace pulsatrix
Definition acquisition_functions.hpp:16
@ Activation
By the channel's largest activation over positions.
@ Linear
One linear layer with a bias, not tied to the embeddings (MDLM).
OpType
The op-type tag a Node carries. Charter Part 2 §3: nodes are tagged by a small closed set of op types...
Definition op_type.hpp:19
@ Attention
Multi-head (scaled dot-product) attention – Phase 3's MultiHeadAttentionModule.