|
pulsatrix 1.1.0
|
Stochastic gradient descent – operates uniformly across any Module's parameters(). More...
#include <stdexcept>#include <unordered_map>#include <vector>#include "pulsatrix/module.hpp"#include "pulsatrix/param_groups.hpp"

Go to the source code of this file.
Classes | |
| class | pulsatrix::SGDOptimizer |
| param -= learning_rate * (grad + weight_decay * param), per parameter, for every parameter a Module exposes. Learning rate and weight decay can differ per parameter group (TRN-1). With no weight decay this is plain SGD. More... | |
Namespaces | |
| namespace | pulsatrix |
Stochastic gradient descent – operates uniformly across any Module's parameters().