pulsatrix 1.1.0
Loading...
Searching...
No Matches
golden_logits.hpp File Reference

The golden-logit harness: a loaded model's logits against Hugging Face's on real text (LLM-6). More...

#include <cstdint>
#include <map>
#include <string>
#include <vector>
#include "pulsatrix/causal_lm.hpp"
#include "pulsatrix/safetensors.hpp"
Include dependency graph for golden_logits.hpp:

Go to the source code of this file.

Classes

struct  pulsatrix::GoldenSequenceResult
 One reference sequence's comparison. More...
 
struct  pulsatrix::GoldenReport
 A model's comparison against a golden file. More...
 

Namespaces

namespace  pulsatrix
 

Functions

GoldenSequenceResult pulsatrix::CompareLogits (const std::vector< float > &got, const std::vector< float > &expected, int64_t num_tokens, int64_t vocab)
 Compares one sequence's logits, both (L, vocab) row-major.
 
GoldenReport pulsatrix::CompareToGolden (CausalLM &model, const SafetensorsFile &golden, float threshold=1e-3f)
 Runs model on every ids.<k> sequence of a golden file (as written by tools/golden/make_golden.py) and compares all its logits with logits.<k> (CompareLogits).
 

Detailed Description

The golden-logit harness: a loaded model's logits against Hugging Face's on real text (LLM-6).