Robotic Manipulation: Perception, Planning, and Control
- 提供者: MIT
- 講師: Russ Tedrake
- 程度: advanced
- 形式: video-lectures
- 時長: One Semester
- 類別: manipulation
- 語言: English
- 價格: 免費
- 標籤: manipulation, perception, motion-planning, deep-learning, kinematics, control
這門課程介紹建構機器人系統的基本演算法方法,讓機器人能在住家與餐廳等非結構化環境中自主操作實體物件。主題包括感知(深度學習與 3D 幾何方法)、規劃(機器人運動學、軌跡生成、無碰撞運動規劃、任務與運動規劃、不確定性下的規劃),以及動力學與控制(基於模型與基於學習)。學生將建構一套軟體堆疊,讓機械手臂能在雜亂場景中自主操作物件。
為何值得修讀
Taught by Russ Tedrake at MIT, this course represents the cutting edge of robotic manipulation research. Unlike introductory courses, it tackles the hard unsolved problems: how do you get a robot to autonomously handle objects in cluttered, unpredictable environments like homes and kitchens? The course combines perception, planning, and control into a complete manipulation stack that students actually build and run.
你將學到
- Deep learning approaches for robotic perception and object recognition
- 3D geometry for manipulation: point clouds, pose estimation, grasp planning
- Motion planning in cluttered environments with collision avoidance
- Task-and-motion planning for complex multi-step manipulation tasks
- Model-based and learning-based control strategies
- Building a complete autonomous manipulation software stack
課程大綱
A semester-long course combining lectures with a cumulative software project. Students progressively build a manipulation stack: starting with perception (processing 3D sensor data), then planning (generating collision-free trajectories), and finally control (executing plans on a simulated robotic arm). The course uses Drake simulation environment throughout.
核心主題
- Geometric perception: point clouds, pose estimation
- Deep learning for perception: object detection, segmentation
- Kinematics and trajectory optimization
- Collision-free motion planning
- Grasp planning and force closure analysis
- Task-and-motion planning (TAMP)
- Planning under uncertainty
- Learning-based manipulation policies
先備知識
- Strong programming skills (Python)
- Linear algebra and basic optimization
- Familiarity with deep learning fundamentals
- Prior exposure to robotics concepts recommended
適用對象
- Graduate students in robotics or computer science
- Researchers working on manipulation and grasping
- Engineers building real-world robotic manipulation systems
- Advanced practitioners who want to understand the full manipulation pipeline