pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::SplitPreTokenizer Member List

This is the complete list of members for pulsatrix::SplitPreTokenizer, including all inherited members.

Literal(const std::string &text, SplitBehavior behavior, bool invert=false)pulsatrix::SplitPreTokenizerstatic
pre_tokenize(std::vector< NormalizedString > &splits) const overridepulsatrix::SplitPreTokenizervirtual
SplitPreTokenizer(const std::string &regex, SplitBehavior behavior, bool invert=false)pulsatrix::SplitPreTokenizer
~PreTokenizer()=defaultpulsatrix::PreTokenizervirtual