pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::HfRopeScaling Struct Reference

A rope_scaling (or rope_parameters) entry other than the default. More...

#include <hf_model.hpp>

Public Attributes

std::string type
 rope_type (older files: type), for example "llama3", "linear", "yarn".
 
float factor = 1.0f
 
float low_freq_factor = 1.0f
 
float high_freq_factor = 1.0f
 
int64_t original_max_position_embeddings = 0
 

Detailed Description

A rope_scaling (or rope_parameters) entry other than the default.

Member Data Documentation

◆ factor

float pulsatrix::HfRopeScaling::factor = 1.0f

◆ high_freq_factor

float pulsatrix::HfRopeScaling::high_freq_factor = 1.0f

◆ low_freq_factor

float pulsatrix::HfRopeScaling::low_freq_factor = 1.0f

◆ original_max_position_embeddings

int64_t pulsatrix::HfRopeScaling::original_max_position_embeddings = 0

◆ type

std::string pulsatrix::HfRopeScaling::type

rope_type (older files: type), for example "llama3", "linear", "yarn".


The documentation for this struct was generated from the following file: