pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::DigitsPreTokenizer Member List

This is the complete list of members for pulsatrix::DigitsPreTokenizer, including all inherited members.

DigitsPreTokenizer(bool individual_digits)pulsatrix::DigitsPreTokenizerexplicit
pre_tokenize(std::vector< NormalizedString > &splits) const overridepulsatrix::DigitsPreTokenizervirtual
~PreTokenizer()=defaultpulsatrix::PreTokenizervirtual