ESM's contact head (EsmContactPredictionHead): a logistic regression over every head's corrected attention map, sigmoid(sum_c weight[c] * f_c(i, j) + bias). Channel c = layer * heads + head, as transformers stacks them.
More...
#include <protein_contacts.hpp>
ESM's contact head (EsmContactPredictionHead): a logistic regression over every head's corrected attention map, sigmoid(sum_c weight[c] * f_c(i, j) + bias). Channel c = layer * heads + head, as transformers stacks them.
◆ bias
| float pulsatrix::EsmContactHead::bias = 0.0f |
◆ heads
| int64_t pulsatrix::EsmContactHead::heads = 0 |
◆ layers
| int64_t pulsatrix::EsmContactHead::layers = 0 |
◆ weight
| std::vector<float> pulsatrix::EsmContactHead::weight |
The documentation for this struct was generated from the following file: