Robot Learning: From Fundamentals to Foundation Models
- Erogato da: ETH Zurich (Computer Vision and Geometry Group)
- Docente: Oier Mees
- Livello: advanced
- Formato: video-lectures
- Durata: 12 weeks, 5 ECTS (11 recorded lectures, Feb 16 - May 18 2026)
- Categoria: robot-learning
- Lingua: English
- Prezzo: Gratuito
- Tag: robot-learning, imitation-learning, reinforcement-learning, vision-language-action, foundation-models, world-models, diffusion-policy, eth-zurich
Il corso di laurea magistrale dell'ETH di Zurigo sul robot learning della primavera 2026 (263-5911-00L), tenuto da Oier Mees e pubblicato integralmente sulla pagina del corso del Computer Vision and Geometry Group: undici serie di slide delle lezioni con le registrazioni su YouTube, dieci registrazioni di lezioni di ospiti tra cui Cheng Chi, Ted Xiao, Quan Vuong, Aviral Kumar e Lucas Beyer, un elenco selezionato di articoli per ogni settimana e quattro esercitazioni di programmazione in un repository GitHub pubblico. Va dal controllo dei robot e dagli MDP all'apprendimento per imitazione e per rinforzo, fino ai modelli generativi, ai modelli del mondo e alle policy generaliste Vision-Language-Action. I materiali si possono leggere e guardare gratuitamente, ma il repository non contiene un file di licenza e la pagina del corso non indica alcuna licenza, quindi vanno considerati consultabili e non con licenza aperta.
Perché seguirlo
This is the most current graduate treatment of robot learning available for free, and currency is the point: a 2026 syllabus that spends whole weeks on world models, generalist policies and embodied reasoning, discussing papers published months before the lecture. Oier Mees works on exactly this material, and each week closes with a guest whose own system is on the slide - Cheng Chi on diffusion policy and UMI, Quan Vuong on Physical Intelligence's VLAs, Scott Reed on NVIDIA GEAR's world models. Where the older free courses here teach the mathematics and classical methods that stay true, this one maps where the field actually is.
Cosa imparerai
- Robot control and Markov decision processes as the formal frame for everything that follows
- Imitation learning: behavioural cloning, its failure modes, and visual representation learning for manipulation
- Reinforcement learning for robots across two weeks, from policy gradients to human-in-the-loop and offline RL
- Generative models as policies - diffusion policy, implicit behavioural cloning, and steering them with RL
- Sequence modelling and transformers for control: decision transformers, ALOHA-style bimanual policies, next-token locomotion
- World models and video-generation policies for learning behaviour without a physical robot
- Generalist Vision-Language-Action policies, from language-conditioned imitation through Gato to pi*0.6
- Embodied reasoning and test-time scaling, and the open problems the field has not solved
Programma
Twelve weekly sessions, February to May 2026. Weeks 1-11 each pair a lecture (slides plus YouTube recording) with a student-led discussion of three papers, and weeks 2-11 close with a guest spotlight recording. The arc: introduction, robot control and MDPs, imitation learning, reinforcement learning I and II, generative models, sequence modelling and transformers, world models, generalist robot policies, embodied reasoning and test-time scaling, frontiers and open problems. Week 12 is guest lectures only. Four coding assignments - PyTorch and NumPy, robot control and MDPs, imitation learning, reinforcement learning - live in the course GitHub repository, which holds the homework folders and nothing else. Enrolled students are graded on paper presentation (20%), homework (40%) and a group final project (40%); none of that is available to self-learners, who get the lectures, papers and assignment code.
Argomenti principali
- Robot control and MDPs
- Imitation learning and behavioural cloning
- Reinforcement learning for manipulation and locomotion
- Diffusion and other generative policies
- Transformers and sequence modelling for control
- World models
- Generalist robot policies and VLAs
- Embodied reasoning and test-time scaling
Prerequisiti
- Solid linear algebra, calculus and probability (the ETH catalogue's stated requirement)
- Python - all assignments are Python, and the first homework is a PyTorch and NumPy tutorial
- Background in machine learning and robotics is strongly encouraged rather than required
A chi si rivolge
- Graduate students and researchers who already know ML and want the robotics-specific state of the art
- Engineers building manipulation or locomotion policies who need the vocabulary behind current papers
- Anyone who has finished a classical robotics or RL course and wants the 2026 continuation
- Reading-group organisers - each week ships three papers with a recorded discussion