|
pulsatrix 1.1.0
|
The golden-logit harness: a loaded model's logits against Hugging Face's on real text (LLM-6). More...
#include <cstdint>#include <map>#include <string>#include <vector>#include "pulsatrix/causal_lm.hpp"#include "pulsatrix/safetensors.hpp"
Go to the source code of this file.
Classes | |
| struct | pulsatrix::GoldenSequenceResult |
| One reference sequence's comparison. More... | |
| struct | pulsatrix::GoldenReport |
| A model's comparison against a golden file. More... | |
Namespaces | |
| namespace | pulsatrix |
Functions | |
| GoldenSequenceResult | pulsatrix::CompareLogits (const std::vector< float > &got, const std::vector< float > &expected, int64_t num_tokens, int64_t vocab) |
| Compares one sequence's logits, both (L, vocab) row-major. | |
| GoldenReport | pulsatrix::CompareToGolden (CausalLM &model, const SafetensorsFile &golden, float threshold=1e-3f) |
Runs model on every ids.<k> sequence of a golden file (as written by tools/golden/make_golden.py) and compares all its logits with logits.<k> (CompareLogits). | |
The golden-logit harness: a loaded model's logits against Hugging Face's on real text (LLM-6).