pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::MaskedLMBatch Struct Reference

One collated batch, on the collator's backend. More...

#include <protein_training.hpp>

Collaboration diagram for pulsatrix::MaskedLMBatch:

Public Attributes

Tensor ids
 (N, L) token ids: masked inputs, padded with <pad>.
 
Tensor keep
 (N, L): 1 for a real token, 0 for padding (EncoderLM::set_padding_mask).
 
Tensor targets
 (N, L): the original token where one was picked, -100 (ignored) elsewhere.
 
int64_t num_targets = 0
 Picked tokens: the loss's normalizer.
 

Detailed Description

One collated batch, on the collator's backend.

Member Data Documentation

◆ ids

Tensor pulsatrix::MaskedLMBatch::ids

(N, L) token ids: masked inputs, padded with <pad>.

◆ keep

Tensor pulsatrix::MaskedLMBatch::keep

(N, L): 1 for a real token, 0 for padding (EncoderLM::set_padding_mask).

◆ num_targets

int64_t pulsatrix::MaskedLMBatch::num_targets = 0

Picked tokens: the loss's normalizer.

◆ targets

Tensor pulsatrix::MaskedLMBatch::targets

(N, L): the original token where one was picked, -100 (ignored) elsewhere.


The documentation for this struct was generated from the following file: