CleanRL.jl

Simple single file implementations of Reinforcement Learning algorithms in Julia.
Inspired by CleanRL

TODO (Algorithms):

• Simple DQN
• A2C
• Rainbow
• PPO
• DDPG
• SAC

TODO (Utils):

• General replay buffer
• CLI for hyperparameters
• Support loggers
• GPU training
• Multi-thread PPO
• Vectorized envs
• Plotting
• Multi-loggers (file/console/Tensorboard)
• Make nn inputs F32 - F32 env wrapper? - done for PPO
• Make individual file runners e.g experiments/run_ppo.(jl/sh)
• Better logging - log interval and always log at correct step

TODO (Investigate):

• Profile PPO