pulsatrix/api/gae_8hpp_source.html

#pragma once


#include "pulsatrix/device_backend.hpp"

#include "pulsatrix/tensor.hpp"


namespace pulsatrix {


struct GAEResult {

    Tensor advantages;

    Tensor returns;

};


[[nodiscard]] GAEResult ComputeGAE(const Tensor& rewards, const Tensor& dones, const Tensor& values,

                                   float bootstrap_value, float gamma, float lambda, DeviceBackend* backend);


}  // namespace pulsatrix

pulsatrix::DeviceBackend
Vendor-agnostic compute/memory backend. CPUBackend, CUDABackend (Phase 1.5), and HIPBackend (Phase 1....
Definition device_backend.hpp:219

pulsatrix::Tensor
N-dimensional tensor. Owns its data buffer exclusively; a DeviceBackend* is injected (not owned) – th...
Definition tensor.hpp:29

device_backend.hpp
Abstract interface isolating vendor-specific memory/compute operations from Tensor/ComputationGraph.

pulsatrix
Definition acquisition_functions.hpp:16

pulsatrix::ComputeGAE
GAEResult ComputeGAE(const Tensor &rewards, const Tensor &dones, const Tensor &values, float bootstrap_value, float gamma, float lambda, DeviceBackend *backend)
Generalized Advantage Estimation (Schulman et al. 2016, arXiv:1506.02438): the exponentially-weighted...

pulsatrix::GAEResult
ComputeGAE()'s two outputs: the advantage estimate per step and the critic's regression target per st...
Definition gae.hpp:22

pulsatrix::GAEResult::returns
Tensor returns
A_t + V(s_t) – the critic's regression target. Deliberately not the raw Monte-Carlo return RolloutBuf...
Definition gae.hpp:27

pulsatrix::GAEResult::advantages
Tensor advantages
A_t – the GAE(gamma, lambda) advantage estimate, the actor's per-step weight.
Definition gae.hpp:24

tensor.hpp
N-dimensional tensor – owns a buffer via DeviceBackend*, RAII (Rule of Five).