pulsatrix 1.1.0
Loading...
Searching...
No Matches
activation_module.hpp File Reference

A pointwise activation chosen at construction: ReLU, tanh, sigmoid, SiLU, exact GELU or GELU's tanh approximation (PLM-1). More...

#include <optional>
#include "pulsatrix/module.hpp"
Include dependency graph for activation_module.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

class  pulsatrix::ActivationModule
 y = f(x), elementwise, for one of the backend's activations. No parameters. More...
 

Namespaces

namespace  pulsatrix
 

Detailed Description

A pointwise activation chosen at construction: ReLU, tanh, sigmoid, SiLU, exact GELU or GELU's tanh approximation (PLM-1).