|
pulsatrix 1.1.0
|
This is the complete list of members for pulsatrix::SequencePreTokenizer, including all inherited members.
| pre_tokenize(std::vector< NormalizedString > &splits) const override | pulsatrix::SequencePreTokenizer | virtual |
| SequencePreTokenizer(std::vector< std::shared_ptr< const PreTokenizer > > pre_tokenizers) | pulsatrix::SequencePreTokenizer | explicit |
| ~PreTokenizer()=default | pulsatrix::PreTokenizer | virtual |