Open Source Robotics

精選高品質的開源機器人專案、工具與軟體,推動機器人社群向前發展。

Introduction to Reinforcement Learning

  • 提供者: UCL / DeepMind
  • 講師: David Silver
  • 程度: intermediate
  • 形式: video-lectures
  • 時長: 10 Lectures
  • 類別: reinforcement-learning
  • 語言: English
  • 價格: 免費
  • 標籤: reinforcement-learning, mdp, dynamic-programming, policy-gradient, value-function, exploration

這套經典講座系列由 DeepMind 首席科學家、AlphaGo 與 AlphaZero 的共同創造者 David Silver 在 University College London 講授,介紹強化學習的主要方法與技術。這門共 10 講的課程涵蓋:Introduction to RL、Markov Decision Processes、Dynamic Programming、Model-Free Prediction、Model-Free Control、Value Function Approximation、Policy Gradient Methods、Integrating Learning and Planning、Exploration and Exploitation,以及 Case Study on RL in Classic Games。

為何值得修讀

Taught by David Silver — the lead researcher behind AlphaGo and AlphaZero — this lecture series is the most widely recommended introduction to reinforcement learning. Silver's ability to explain complex concepts clearly, combined with his unique perspective from building systems that defeated world champions at Go, makes this an unparalleled learning resource. It has introduced thousands of practitioners to RL.

你將學到

  • The reinforcement learning problem formulation and Markov Decision Processes
  • Dynamic programming methods for solving known MDPs
  • Model-free prediction: Monte Carlo and temporal-difference learning
  • Model-free control: SARSA, Q-learning
  • Value function approximation with neural networks
  • Policy gradient methods and the REINFORCE algorithm

課程大綱

Ten self-contained lectures progressing from fundamentals to advanced topics. Starts with the RL problem formulation and MDPs, builds through dynamic programming and model-free methods (both prediction and control), then covers function approximation, policy gradients, planning integration, and exploration. Concludes with a fascinating case study applying RL to classic games including the AlphaGo breakthrough.

核心主題

  • Introduction to reinforcement learning
  • Markov Decision Processes (MDPs)
  • Dynamic programming: policy iteration, value iteration
  • Model-free prediction: MC, TD(0), TD(λ)
  • Model-free control: on-policy and off-policy
  • Value function approximation
  • Policy gradient methods
  • Integrating learning and planning (Dyna, MCTS)
  • Exploration vs. exploitation
  • Case study: RL in classic games (Atari, Go)

先備知識

  • Basic probability and statistics
  • Linear algebra fundamentals
  • Some programming experience (for understanding pseudocode)

適用對象

  • Anyone new to reinforcement learning seeking a strong theoretical foundation
  • Students preparing for more advanced RL courses (like CS 285)
  • Practitioners wanting to understand the fundamentals before applying RL libraries
  • Researchers from other fields looking to add RL to their toolkit

連結

  • 網站: https://www.davidsilver.uk/teaching/

本網站需要 JavaScript 才能正常運作。請啟用 JavaScript 以瀏覽我們的開源機器人專案。