pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::GenerationResult Struct Reference

A generated continuation. More...

#include <generation.hpp>

Public Attributes

std::vector< int64_t > tokens
 The prompt followed by the new tokens.
 
std::vector< int64_t > new_tokens
 Only the new tokens, EOS included if generated.
 
std::vector< float > log_probs
 Each new token's log-probability under the model itself (log-softmax of the raw logits, before any processing): how likely the model found it, whatever the decoding settings were.
 
FinishReason finish_reason = FinishReason::Length
 

Detailed Description

A generated continuation.

Member Data Documentation

◆ finish_reason

FinishReason pulsatrix::GenerationResult::finish_reason = FinishReason::Length

◆ log_probs

std::vector<float> pulsatrix::GenerationResult::log_probs

Each new token's log-probability under the model itself (log-softmax of the raw logits, before any processing): how likely the model found it, whatever the decoding settings were.

◆ new_tokens

std::vector<int64_t> pulsatrix::GenerationResult::new_tokens

Only the new tokens, EOS included if generated.

◆ tokens

std::vector<int64_t> pulsatrix::GenerationResult::tokens

The prompt followed by the new tokens.


The documentation for this struct was generated from the following file: