pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::LoraLayerRelevance Struct Reference

One adapted layer's share of a relevance pass (TRN-8). More...

#include <lora.hpp>

Collaboration diagram for pulsatrix::LoraLayerRelevance:

Public Attributes

std::string name
 The layer's name, as LoraLayers() gives it.
 
Tensor base
 Input relevance through the base weight, (N, in).
 
Tensor adapter
 Input relevance through the adapter, (N, in).
 
double base_total = 0
 Sums over everything: the layer's relevance carried by each path.
 
double adapter_total = 0
 

Detailed Description

One adapted layer's share of a relevance pass (TRN-8).

Member Data Documentation

◆ adapter

Tensor pulsatrix::LoraLayerRelevance::adapter

Input relevance through the adapter, (N, in).

◆ adapter_total

double pulsatrix::LoraLayerRelevance::adapter_total = 0

◆ base

Tensor pulsatrix::LoraLayerRelevance::base

Input relevance through the base weight, (N, in).

◆ base_total

double pulsatrix::LoraLayerRelevance::base_total = 0

Sums over everything: the layer's relevance carried by each path.

◆ name

std::string pulsatrix::LoraLayerRelevance::name

The layer's name, as LoraLayers() gives it.


The documentation for this struct was generated from the following file: