Reinforcement Learning

Reinforcement Learning

Online Lectures

• ⭐ David Silver Introduction to Reinforcement Learning
• ⭐ DeepMind Reinforcement Learning Series 2021
• ⭐ OpenAI Spinning Up in Deep RL!
• ⭐ Tutorial: Introduction to Reinforcement Learning with Function Approximation - Rich Sutton
• ⭐ Introduction to RL by Tim Miller
• Georgia Tech CS7642 Reinforcement Learning

⭐ Andrej Karpathy RL Learning path

• https://karpathy.github.io/2016/05/31/rl/

Hugging Face

• ⭐ Hugging Face Deep RL Class
• Prerequisites:
  • Udacity: Introduction to Python
  • Udacity: Intro to Deep Learning with PyTorch
  • PyTorch in 60min

Stable Baselines 3

• ⭐ Stable Baselines 3 Documentation

⭐ The Best Tools for Reinforcement Learning in Python You Actually Want to Try - 2022

• The Best Tools for Reinforcement Learning in Python You Actually Want to Try

Books and Papers

• ⭐ Reinforcement Learning by Sutton and Barto
  • This is "The" RL bible, read it at least 3 times.
• ⭐ Grokking Deep Reinforcement Learning
  • Github Codes
• A Generalized Reinforcement-Learning Model: Convergence and Applications by Littman and Szepesvari (1996)
• ⭐ Deep Reinforcement Learning and the Deadly Triad

Other RL Links

• ⭐ Awesome Reinforcement Learning
• ⭐ Reinforcement Learning for Fun
• Quora answer: Difference between V(s) and Q(s,a)
• RL Environment list
• RL Environment zoo
• Awesome Deep RL
• ⭐ An Outsider's Tour of Reinforcement Learning
  • Comparison of PID (proportional–integral–derivative) controller and RL
• Exploration vs Exploitation and Decaying Epsilon
• Denny Britz RL Resources

⭐ DQN (Deep Q Networks)

I like DQN, so it has its own section.

• 2013 DQN Paper
  • DQN Papers with code
  • 2015 DQN paper with target network
• Reinforcement Learning Explained Visually (Part 5): Deep Q Networks, step-by-step

⭐ Open Ended Learning

• DeepMind- Open-Ended Learning Leads to Generally Capable Agents
• Generally capable agents emerge from open-ended play
• Open-Ended Learning Leads to Generally Capable Agents - paper 42MB

DeepMind

Resources from DeepMind

• DeepMind Github Repo
  • DeepMind Research

AlphaGo

• AlphaGo - The Movie
• AlphaGo Paper

Ray's RLlib

• What is Ray - API list including RLlib
• RLlib: Scalable Reinforcement Learning
• RLlib examples
• Hands-on Reinforcement Learning with Ray’s RLlib
• Github Hands-on RL with RLlib