pulsatrix
Loading...
Searching...
No Matches
dropout_module.hpp File Reference

Inverted dropout – the first module whose forward behavior genuinely differs between training and inference (Module::is_training()). More...

#include <optional>
#include <cstdint>
#include "pulsatrix/module.hpp"
Include dependency graph for dropout_module.hpp:

Go to the source code of this file.

Classes

class  pulsatrix::DropoutModule
 y = (mask_i ? x_i / (1 - p) : 0) at training time (inverted dropout – scaling happens at training time so eval-time forward needs no rescaling); y = x at eval time or when p == 0. No parameters. More...
 

Namespaces

namespace  pulsatrix
 

Detailed Description

Inverted dropout – the first module whose forward behavior genuinely differs between training and inference (Module::is_training()).