Open Source Robotics

精選高品質的開源機器人專案、工具與軟體,推動機器人社群向前發展。

Robotic Manipulation: Perception, Planning, and Control

  • 提供者: MIT
  • 講師: Russ Tedrake
  • 程度: advanced
  • 形式: video-lectures
  • 時長: One Semester
  • 類別: manipulation
  • 語言: English
  • 價格: 免費
  • 標籤: manipulation, perception, motion-planning, deep-learning, kinematics, control

這門課程介紹建構機器人系統的基本演算法方法,讓機器人能在住家與餐廳等非結構化環境中自主操作實體物件。主題包括感知(深度學習與 3D 幾何方法)、規劃(機器人運動學、軌跡生成、無碰撞運動規劃、任務與運動規劃、不確定性下的規劃),以及動力學與控制(基於模型與基於學習)。學生將建構一套軟體堆疊,讓機械手臂能在雜亂場景中自主操作物件。

為何值得修讀

Taught by Russ Tedrake at MIT, this course represents the cutting edge of robotic manipulation research. Unlike introductory courses, it tackles the hard unsolved problems: how do you get a robot to autonomously handle objects in cluttered, unpredictable environments like homes and kitchens? The course combines perception, planning, and control into a complete manipulation stack that students actually build and run.

你將學到

  • Deep learning approaches for robotic perception and object recognition
  • 3D geometry for manipulation: point clouds, pose estimation, grasp planning
  • Motion planning in cluttered environments with collision avoidance
  • Task-and-motion planning for complex multi-step manipulation tasks
  • Model-based and learning-based control strategies
  • Building a complete autonomous manipulation software stack

課程大綱

A semester-long course combining lectures with a cumulative software project. Students progressively build a manipulation stack: starting with perception (processing 3D sensor data), then planning (generating collision-free trajectories), and finally control (executing plans on a simulated robotic arm). The course uses Drake simulation environment throughout.

核心主題

  • Geometric perception: point clouds, pose estimation
  • Deep learning for perception: object detection, segmentation
  • Kinematics and trajectory optimization
  • Collision-free motion planning
  • Grasp planning and force closure analysis
  • Task-and-motion planning (TAMP)
  • Planning under uncertainty
  • Learning-based manipulation policies

先備知識

  • Strong programming skills (Python)
  • Linear algebra and basic optimization
  • Familiarity with deep learning fundamentals
  • Prior exposure to robotics concepts recommended

適用對象

  • Graduate students in robotics or computer science
  • Researchers working on manipulation and grasping
  • Engineers building real-world robotic manipulation systems
  • Advanced practitioners who want to understand the full manipulation pipeline

連結

  • 網站: https://manipulation.csail.mit.edu/
  • GitHub: https://github.com/RussTedrake/manipulation

本網站需要 JavaScript 才能正常運作。請啟用 JavaScript 以瀏覽我們的開源機器人專案。