|
pulsatrix 1.1.0
|
Language-model head that reuses an EmbeddingModule's table as its weight (LLM-2). More...
#include <optional>#include <vector>#include "pulsatrix/embedding_module.hpp"#include "pulsatrix/module.hpp"

Go to the source code of this file.
Classes | |
| class | pulsatrix::TiedLMHeadModule |
logits = x @ E^T, where E is a token embedding table (vocab, d_model) that the head shares rather than copies – Hugging Face's tie_word_embeddings (SmolLM2, Qwen3, Gemma 3). Shape (..., d_model) -> (..., vocab). More... | |
Namespaces | |
| namespace | pulsatrix |
Language-model head that reuses an EmbeddingModule's table as its weight (LLM-2).