CS 285: Deep Reinforcement Learning
- 提供者: UC Berkeley
- 講師: Sergey Levine
- 程度: advanced
- 形式: video-lectures
- 時長: One Semester
- 類別: reinforcement-learning
- 語言: English
- 價格: 免費
- 標籤: reinforcement-learning, deep-learning, policy-gradient, actor-critic, imitation-learning, meta-learning
這門課程涵蓋控制、強化學習與深度學習的交會領域。主題包括強化學習形式體系的進階探討、無模型 RL 演算法(策略梯度、價值函數、Q-learning、actor-critic)、基於模型的 RL、模仿學習,以及探索、影片預測、遷移學習、多任務學習與元學習等進階主題。先備知識包括熟悉 RL、數值最佳化、機器學習與深度神經網路。
為何值得修讀
Sergey Levine's CS 285 at UC Berkeley is widely considered the best deep reinforcement learning course available. It goes far beyond basic RL, covering the latest research in model-based RL, offline RL, meta-learning, and their applications to robotics. Many of the methods taught here are directly used in state-of-the-art robot learning systems today.
你將學到
- Policy gradient methods and their variants (REINFORCE, PPO, TRPO)
- Value function methods and deep Q-learning
- Actor-critic architectures for continuous control
- Model-based reinforcement learning for sample efficiency
- Imitation learning and inverse reinforcement learning
- Exploration strategies, meta-learning, and transfer learning
課程大綱
A full semester course with video lectures, written homework, and programming assignments. Progresses from imitation learning through policy gradients, value-based methods, and actor-critic architectures, then covers advanced topics including model-based RL, exploration, offline RL, and meta-learning. Assignments involve implementing algorithms from scratch and training policies in simulated environments.
核心主題
- Supervised learning of behaviors: imitation learning
- Policy gradients and variance reduction
- Actor-critic methods (A2C, A3C, SAC)
- Value function methods and Q-learning (DQN, TD3)
- Model-based RL and world models
- Exploration and exploitation
- Offline RL and batch RL
- Transfer learning and meta-learning
- Goal-conditioned RL and multi-task learning
先備知識
- Machine learning fundamentals (CS 189 level or equivalent)
- Deep learning basics (experience with PyTorch or TensorFlow)
- Probability and statistics
- Comfort with mathematical notation and optimization
適用對象
- Graduate students researching RL or robot learning
- ML engineers applying RL to real-world control problems
- Robotics researchers wanting to understand modern learning-based control
- Anyone who wants a deep, research-level understanding of deep RL
連結
- 網站: https://rail.eecs.berkeley.edu/deeprlcourse/