Open Source Robotics

精選高品質的開源機器人專案、工具與軟體,推動機器人社群向前發展。

CS 285: Deep Reinforcement Learning

  • 提供者: UC Berkeley
  • 講師: Sergey Levine
  • 程度: advanced
  • 形式: video-lectures
  • 時長: One Semester
  • 類別: reinforcement-learning
  • 語言: English
  • 價格: 免費
  • 標籤: reinforcement-learning, deep-learning, policy-gradient, actor-critic, imitation-learning, meta-learning

這門課程涵蓋控制、強化學習與深度學習的交會領域。主題包括強化學習形式體系的進階探討、無模型 RL 演算法(策略梯度、價值函數、Q-learning、actor-critic)、基於模型的 RL、模仿學習,以及探索、影片預測、遷移學習、多任務學習與元學習等進階主題。先備知識包括熟悉 RL、數值最佳化、機器學習與深度神經網路。

為何值得修讀

Sergey Levine's CS 285 at UC Berkeley is widely considered the best deep reinforcement learning course available. It goes far beyond basic RL, covering the latest research in model-based RL, offline RL, meta-learning, and their applications to robotics. Many of the methods taught here are directly used in state-of-the-art robot learning systems today.

你將學到

  • Policy gradient methods and their variants (REINFORCE, PPO, TRPO)
  • Value function methods and deep Q-learning
  • Actor-critic architectures for continuous control
  • Model-based reinforcement learning for sample efficiency
  • Imitation learning and inverse reinforcement learning
  • Exploration strategies, meta-learning, and transfer learning

課程大綱

A full semester course with video lectures, written homework, and programming assignments. Progresses from imitation learning through policy gradients, value-based methods, and actor-critic architectures, then covers advanced topics including model-based RL, exploration, offline RL, and meta-learning. Assignments involve implementing algorithms from scratch and training policies in simulated environments.

核心主題

  • Supervised learning of behaviors: imitation learning
  • Policy gradients and variance reduction
  • Actor-critic methods (A2C, A3C, SAC)
  • Value function methods and Q-learning (DQN, TD3)
  • Model-based RL and world models
  • Exploration and exploitation
  • Offline RL and batch RL
  • Transfer learning and meta-learning
  • Goal-conditioned RL and multi-task learning

先備知識

  • Machine learning fundamentals (CS 189 level or equivalent)
  • Deep learning basics (experience with PyTorch or TensorFlow)
  • Probability and statistics
  • Comfort with mathematical notation and optimization

適用對象

  • Graduate students researching RL or robot learning
  • ML engineers applying RL to real-world control problems
  • Robotics researchers wanting to understand modern learning-based control
  • Anyone who wants a deep, research-level understanding of deep RL

連結

  • 網站: https://rail.eecs.berkeley.edu/deeprlcourse/

本網站需要 JavaScript 才能正常運作。請啟用 JavaScript 以瀏覽我們的開源機器人專案。