|
pulsatrix 1.1.0
|
A rope_scaling (or rope_parameters) entry other than the default.
More...
#include <hf_model.hpp>
Public Attributes | |
| std::string | type |
rope_type (older files: type), for example "llama3", "linear", "yarn". | |
| float | factor = 1.0f |
| float | low_freq_factor = 1.0f |
| float | high_freq_factor = 1.0f |
| int64_t | original_max_position_embeddings = 0 |
A rope_scaling (or rope_parameters) entry other than the default.
| float pulsatrix::HfRopeScaling::factor = 1.0f |
| float pulsatrix::HfRopeScaling::high_freq_factor = 1.0f |
| float pulsatrix::HfRopeScaling::low_freq_factor = 1.0f |
| int64_t pulsatrix::HfRopeScaling::original_max_position_embeddings = 0 |
| std::string pulsatrix::HfRopeScaling::type |
rope_type (older files: type), for example "llama3", "linear", "yarn".