|
pulsatrix 1.1.0
|
This is the complete list of members for pulsatrix::SplitPreTokenizer, including all inherited members.
| Literal(const std::string &text, SplitBehavior behavior, bool invert=false) | pulsatrix::SplitPreTokenizer | static |
| pre_tokenize(std::vector< NormalizedString > &splits) const override | pulsatrix::SplitPreTokenizer | virtual |
| SplitPreTokenizer(const std::string ®ex, SplitBehavior behavior, bool invert=false) | pulsatrix::SplitPreTokenizer | |
| ~PreTokenizer()=default | pulsatrix::PreTokenizer | virtual |