replay_buffer.hpp File Reference

Off-policy experience replay: fixed-capacity circular transition store + sampling. More...

#include <cstdint>
#include <vector>
#include "pulsatrix/device_backend.hpp"
#include "pulsatrix/tensor.hpp"

Include dependency graph for replay_buffer.hpp:

Go to the source code of this file.

Classes
struct	pulsatrix::ReplayBatch
	One uniformly-sampled minibatch of transitions, one Tensor per transition field. More...
class	pulsatrix::ReplayBuffer
	Fixed-capacity circular replay buffer of (observation, action, reward, next_observation, done) transitions, with uniform-random-with-replacement batch sampling – the off-policy experience store of Mnih et al. 2015 (DQN), reused unchanged by SAC and every other off-policy learner in this campaign. More...

Namespaces
namespace	pulsatrix

Detailed Description

Off-policy experience replay: fixed-capacity circular transition store + sampling.