Deep RL Course documentation
Additional Readings
Unit 0. Welcome to the course
Unit 1. Introduction to Deep Reinforcement Learning
Bonus Unit 1. Introduction to Deep Reinforcement Learning with Huggy
Live 1. How the course work, Q&A, and playing with Huggy
Unit 2. Introduction to Q-Learning
Unit 3. Deep Q-Learning with Atari Games
Bonus Unit 2. Automatic Hyperparameter Tuning with Optuna
Unit 4. Policy Gradient with PyTorch
Unit 5. Introduction to Unity ML-Agents
Unit 6. Actor Critic methods with Robotics environments
Unit 7. Introduction to Multi-Agents and AI vs AI
Unit 8. Part 1 Proximal Policy Optimization (PPO)
IntroductionThe intuition behind PPOIntroducing the Clipped Surrogate Objective FunctionVisualize the Clipped Surrogate Objective FunctionPPO with CleanRLConclusionAdditional Readings
Unit 8. Part 2 Proximal Policy Optimization (PPO) with Doom
Bonus Unit 3. Advanced Topics in Reinforcement Learning
Bonus Unit 5. Imitation Learning with Godot RL Agents
Certification and congratulations
Additional Readings
These are optional readings if you want to go deeper.
PPO Explained
- Towards Delivering a Coherent Self-Contained Explanation of Proximal Policy Optimization by Daniel Bick
- What is the way to understand Proximal Policy Optimization Algorithm in RL?
- Foundations of Deep RL Series, L4 TRPO and PPO by Pieter Abbeel
- OpenAI PPO Blogpost
- Spinning Up RL PPO
- Paper Proximal Policy Optimization Algorithms
PPO Implementation details
- The 37 Implementation Details of Proximal Policy Optimization
- Part 1 of 3 — Proximal Policy Optimization Implementation: 11 Core Implementation Details