pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::SequencePreTokenizer Member List

This is the complete list of members for pulsatrix::SequencePreTokenizer, including all inherited members.

pre_tokenize(std::vector< NormalizedString > &splits) const overridepulsatrix::SequencePreTokenizervirtual
SequencePreTokenizer(std::vector< std::shared_ptr< const PreTokenizer > > pre_tokenizers)pulsatrix::SequencePreTokenizerexplicit
~PreTokenizer()=defaultpulsatrix::PreTokenizervirtual