|
pulsatrix 1.1.0
|
Replaces every match of a literal string or a regex (Hugging Face's Replace normalizer). More...
#include <sentencepiece_bpe.hpp>


Public Member Functions | |
| ReplaceNormalizer (std::string pattern, std::string content) | |
| A literal pattern. | |
| void | normalize (NormalizedString &text) const override |
Public Member Functions inherited from pulsatrix::Normalizer | |
| virtual | ~Normalizer ()=default |
Static Public Member Functions | |
| static ReplaceNormalizer | Regex (const std::string &pattern, std::string content) |
| A regex pattern. | |
Replaces every match of a literal string or a regex (Hugging Face's Replace normalizer).
| pulsatrix::ReplaceNormalizer::ReplaceNormalizer | ( | std::string | pattern, |
| std::string | content | ||
| ) |
A literal pattern.
| std::invalid_argument | if it's empty. |
|
overridevirtual |
Implements pulsatrix::Normalizer.
|
static |
A regex pattern.