|
pulsatrix 1.1.0
|
This is the complete list of members for pulsatrix::DigitsPreTokenizer, including all inherited members.
| DigitsPreTokenizer(bool individual_digits) | pulsatrix::DigitsPreTokenizer | explicit |
| pre_tokenize(std::vector< NormalizedString > &splits) const override | pulsatrix::DigitsPreTokenizer | virtual |
| ~PreTokenizer()=default | pulsatrix::PreTokenizer | virtual |