pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::EsmContactHead Struct Reference

ESM's contact head (EsmContactPredictionHead): a logistic regression over every head's corrected attention map, sigmoid(sum_c weight[c] * f_c(i, j) + bias). Channel c = layer * heads + head, as transformers stacks them. More...

#include <protein_contacts.hpp>

Public Attributes

int64_t layers = 0
 
int64_t heads = 0
 
std::vector< float > weight
 layers * heads values
 
float bias = 0.0f
 

Detailed Description

ESM's contact head (EsmContactPredictionHead): a logistic regression over every head's corrected attention map, sigmoid(sum_c weight[c] * f_c(i, j) + bias). Channel c = layer * heads + head, as transformers stacks them.

Member Data Documentation

◆ bias

float pulsatrix::EsmContactHead::bias = 0.0f

◆ heads

int64_t pulsatrix::EsmContactHead::heads = 0

◆ layers

int64_t pulsatrix::EsmContactHead::layers = 0

◆ weight

std::vector<float> pulsatrix::EsmContactHead::weight

layers * heads values


The documentation for this struct was generated from the following file: