pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::MaskedLMOptions Struct Reference

ESM-2's masking (Lin et al. 2023; BERT's 80/10/10). More...

#include <protein_training.hpp>

Public Attributes

double mask_probability = 0.15
 Each residue is picked for prediction with this probability.
 
double mask_fraction = 0.8
 Of the picked residues, the share replaced by <mask>...
 
double random_fraction = 0.1
 ...and the share replaced by a random amino acid; the rest stay as they are.
 
int64_t max_tokens = 1024
 The longest a sequence may be, in tokens with <cls> and <eos> (ESM-2's 1024): longer ones are cropped to a random window of max_tokens - 2 residues.
 

Detailed Description

ESM-2's masking (Lin et al. 2023; BERT's 80/10/10).

Member Data Documentation

◆ mask_fraction

double pulsatrix::MaskedLMOptions::mask_fraction = 0.8

Of the picked residues, the share replaced by <mask>...

◆ mask_probability

double pulsatrix::MaskedLMOptions::mask_probability = 0.15

Each residue is picked for prediction with this probability.

◆ max_tokens

int64_t pulsatrix::MaskedLMOptions::max_tokens = 1024

The longest a sequence may be, in tokens with <cls> and <eos> (ESM-2's 1024): longer ones are cropped to a random window of max_tokens - 2 residues.

◆ random_fraction

double pulsatrix::MaskedLMOptions::random_fraction = 0.1

...and the share replaced by a random amino acid; the rest stay as they are.


The documentation for this struct was generated from the following file: