|
pulsatrix 1.1.0
|
ESM-2's masking (Lin et al. 2023; BERT's 80/10/10). More...
#include <protein_training.hpp>
Public Attributes | |
| double | mask_probability = 0.15 |
| Each residue is picked for prediction with this probability. | |
| double | mask_fraction = 0.8 |
Of the picked residues, the share replaced by <mask>... | |
| double | random_fraction = 0.1 |
| ...and the share replaced by a random amino acid; the rest stay as they are. | |
| int64_t | max_tokens = 1024 |
The longest a sequence may be, in tokens with <cls> and <eos> (ESM-2's 1024): longer ones are cropped to a random window of max_tokens - 2 residues. | |
ESM-2's masking (Lin et al. 2023; BERT's 80/10/10).
| double pulsatrix::MaskedLMOptions::mask_fraction = 0.8 |
Of the picked residues, the share replaced by <mask>...
| double pulsatrix::MaskedLMOptions::mask_probability = 0.15 |
Each residue is picked for prediction with this probability.
| int64_t pulsatrix::MaskedLMOptions::max_tokens = 1024 |
The longest a sequence may be, in tokens with <cls> and <eos> (ESM-2's 1024): longer ones are cropped to a random window of max_tokens - 2 residues.
| double pulsatrix::MaskedLMOptions::random_fraction = 0.1 |
...and the share replaced by a random amino acid; the rest stay as they are.