pulsatrix 1.1.0
Loading...
Searching...
No Matches
tied_lm_head_module.hpp File Reference

Language-model head that reuses an EmbeddingModule's table as its weight (LLM-2). More...

#include <optional>
#include <vector>
#include "pulsatrix/embedding_module.hpp"
#include "pulsatrix/module.hpp"
Include dependency graph for tied_lm_head_module.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

class  pulsatrix::TiedLMHeadModule
 logits = x @ E^T, where E is a token embedding table (vocab, d_model) that the head shares rather than copies – Hugging Face's tie_word_embeddings (SmolLM2, Qwen3, Gemma 3). Shape (..., d_model) -> (..., vocab). More...
 

Namespaces

namespace  pulsatrix
 

Detailed Description

Language-model head that reuses an EmbeddingModule's table as its weight (LLM-2).