|
pulsatrix 1.1.0
|
This is the complete list of members for pulsatrix::MetaspacePreTokenizer, including all inherited members.
| MetaspacePreTokenizer(std::string replacement, PrependScheme scheme, bool split) | pulsatrix::MetaspacePreTokenizer | |
| pre_tokenize(std::vector< NormalizedString > &splits) const override | pulsatrix::MetaspacePreTokenizer | virtual |
| ~PreTokenizer()=default | pulsatrix::PreTokenizer | virtual |