One layer's rescaling vector l: (out) for an output-scaling layer, (in) for a feedforward one. LinearModule owns and drives it; read it through LinearModule::ia3().
More...
#include <ia3.hpp>
One layer's rescaling vector l: (out) for an output-scaling layer, (in) for a feedforward one. LinearModule owns and drives it; read it through LinearModule::ia3().
◆ IA3Adapter()
l = 1: the layer is unchanged.
◆ enabled()
| bool pulsatrix::IA3Adapter::enabled |
( |
| ) |
const |
|
inline |
◆ feedforward()
| bool pulsatrix::IA3Adapter::feedforward |
( |
| ) |
const |
|
inline |
◆ merged()
| bool pulsatrix::IA3Adapter::merged |
( |
| ) |
const |
|
inline |
◆ scale()
| const Tensor & pulsatrix::IA3Adapter::scale |
( |
| ) |
const |
|
inline |
◆ scale_grad()
| const Tensor & pulsatrix::IA3Adapter::scale_grad |
( |
| ) |
const |
|
inline |
◆ set_scale()
| void pulsatrix::IA3Adapter::set_scale |
( |
const std::vector< float > & |
values | ) |
|
Replaces l.
- Exceptions
-
| std::invalid_argument | on a wrong size. |
◆ LinearModule
The documentation for this class was generated from the following file: