實體人工智慧

Welcome to the World of Physical AI! In recent years, we’ve witnessed astonishing breakthroughs in Generative AI — from ChatGPT transforming how we interact with language to Veo 3 pushing the boundaries of video generation. Now, the spotlight shifts to Agentic AI, where systems are not just reactive but goal-driven and autonomous. But the next frontier lies beyond the screen. We’re entering the era of Physical AI — where artificial intelligence steps into the real world. What is Physical AI? Physical AI refers to AI systems that can perceive, reason, and act in the physical environment — sensing through cameras, microphones, and other sensors, and responding through motors, arms, wheels, or other actuators. It’s the bridge between digital intelligence and physical action. Curious how these systems work in practice? Wonder how today’s AI models are powering real-world applications — from robotics to smart homes and autonomous vehicles? Ready to explore the challenges of making AI truly embodied and interactive? If these questions excite you, this course is for you. What you’ll learn: • Explain how sensing, reasoning, and action come together in intelligent physical systems • Explain the core concepts and technologies behind Physical AI • Identify major applications and use cases • Apply foundational techniques to real-world scenarios • Design and prototype your own Physical AI solution Join us to explore how intelligence meets action — in the physical world.

Programming (C/C++/Python), Linear Algebra, Probability, Computer Vision, and Machine Learning

Course Assignment: 40% - HW1: 3D Scene Reconstruction and Mapping - HW2: Path Planning - HW3: Build your data collection tool for chosen tasks (e.g., brew your coffee) - HW4: Train your physical AI in Digitial Twin to complete the chosen tasks Course Project (per group, 2-3 people a group): 40% - Design and prototype your own Physical AI solution - Demonstrate the effectiveness of your physical AI solutions in the real world - Present YOUR solution for solving by the end of the semester Group Presentation: 20%

Slides, papers, and online resources