pulsatrix 1.1.0
Loading...
Searching...
No Matches
sgd_optimizer.hpp File Reference

Stochastic gradient descent – operates uniformly across any Module's parameters(). More...

#include <stdexcept>
#include <unordered_map>
#include <vector>
#include "pulsatrix/module.hpp"
#include "pulsatrix/param_groups.hpp"
Include dependency graph for sgd_optimizer.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

class  pulsatrix::SGDOptimizer
 param -= learning_rate * (grad + weight_decay * param), per parameter, for every parameter a Module exposes. Learning rate and weight decay can differ per parameter group (TRN-1). With no weight decay this is plain SGD. More...
 

Namespaces

namespace  pulsatrix
 

Detailed Description

Stochastic gradient descent – operates uniformly across any Module's parameters().