
A2CLoss
TD3Loss
ReinforceLoss
Dreamer

Vectorized value function operators also appear in the library. Check the documentation here.
[Beta] Models and exploration strategies
We provide multiple models, modules and exploration strategies. Get a detailed description in the doc.
[Beta] Composable replay buffer
A composable replay buffer class is provided that can be used to store data in multiple contexts including single and multi-agent, on and off-policy and many more.. Components include:

Storages (list, physical or memory-based contiguous storages)
Samplers (Prioritized, sampler without repetition)
Writers
Possibility to add transforms

Replay buffers and other data utilities are documented here.
[Beta] Logging tools and trainer
We support multiple logging tools including tensorboard, wandb and mlflow.