機器人視覺
Robotic Vision
| 節 | 週四 |
|---|---|
7 15:30–16:20 | 機器人視覺 EE635 3 節連堂 |
8 16:30–17:20 | |
9 17:30–18:20 |
* 根據陽明交大上課時間表所列
This course aims at training students to participate world-class competition, and we will target the RobotX Competition (https://www.robotx.org/) in 2018. This course will cover the fundamental and advanced domains in vision for mobility tasks, including the challenges combining object recognition, pose estimation, motion planning, and SLAM. We will systematically study each components from previous winning teams in 2014 and 2016, as well as cutting-edge methods that may better improve the performance. Students will form teams to develop term projects, and we encourage in-class discussions and presentation skills with a white board for class participations. This course is a "learning-by-doing," and include in-class lab/tutorial in each teaching module. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and focus advanced topics using Gazebo, 3D Perception, and deep learning.
This course involve a fair amount of probability, linear algebra, and programming. Students are required to take image processing or computer vision. Being familiar with Unix-like system, Git, C++, Robot Operation System (ROS) and Python is needed. Due to the tight competition schedule, we wish to cover more advanced topics directly relevant to the competition. *We will assume that you have been familiar with Duckietown A to H (http://duckietown.nctu.edu.tw/materials.html), which is an open-source, self-learning material. 20 Duckiebots will be available after 1/20. Please feel free to get started early during winter break! *Due to the limited robots/computing resource for Gazebo and Deep Learning, we will ask all attended students to fill in a short self-evaluation and motivation statement. We apologise that we can only enroll a limited number of students according to students' 1) motivation, and knowledge of 2) of Unix/Ubuntu, Vim, Git, 3) Duckietown and ROS, 4) computer vision and image processing, and 5) your own computing resource (such as a native Ubuntu machine with GTX 1060 or above).
* Task-oriented: We aim at the RobotX competition (https://www.robotx.org/) in 2018. * Learning by Doing: We have lecture and lab sections, and include hand-on tutorial/lab materials each week. * In-class Discussion: We encourage discussions and presentation skills using a white board each team for class participation. We also wish to train students' presentation skills. * Project-based learning: each team will work on a term project related to RobotX Competition.
1.學期作業: We have in-class tutorial/lab each week, and the lab materials typically include 3 specific tasks (programming/algorithm/system work). and students are expected to finish the lab materials during the class. 2. 考試狀況: There will be no midterm/final exams. 3.評量方法: In-Class Lab/Tutorials (40%), Midterm Project Proposal (20%) Final Presentation and Term Paper/Report (40%)
| 週次 | 主題 |
|---|---|
| 第 1 週 | Introduction to Robotic Vision and RobotX Competition |
| 第 2 週 | Part I: Gazebo Gazebo and Virtual Challenges Lab01: Subscribe/Publish ROS Messages in Gazebo |
| 第 3 週 | Gazebo for Marine Robotics Lab02: Gazebo USV |
| 第 4 週 | Duckietown Lane Following Revisit Lab03: Duckietown Virtual Lane Following |
| 第 5 週 | Part II: From Duckietown to RobotX AprilTag; How to Read a Research Paper Lab04: AprilTag Navi |
| 第 6 週 | HSV Filter & FSM Lab05: Light Buoy Sequence Detection |
| 第 7 週 | Image Features: Harris Corner, FAST, SIFT, & MSER Lab06: Placard Detector with Image Feature |
| 第 8 週 | Bayes Filter Lab07: GPS Navi |
| 第 9 週 | Midterm Project Proposal Pitch |
| 第 10 週 | Part III: 3D Perception 3D Sensors and Data Logging Velodyne & RGBD Camera Calibration |
| 第 11 週 | Point Cloud and ICP Lab06: PCL Normal RANSAC ICP |
| 第 12 週 | Laser-Based Feature Detection Lab07: 3D Feature Tracking |
| 第 13 週 | Part IV: Deep Learning Intro to Deep Learning Lab11: Layer Computation |
| 第 14 週 | Network Structure Lab12: Network Structure and Surgery |
| 第 15 週 | DL Prediction Lab13: Prediction from Pre-trained Models |
| 第 16 週 | DL Training Lab14: Training with Freiburg Groceries |
| 第 17 週 | Feature Engineering vs. Deep Learning Lab15: Placard Detector with Deep Learning |
| 第 18 週 | Final Presentation |
1. Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010. 2. Robotics, Vision, and Control, Peter Croke, Springer, 2011. 3. Introduction to Autonomous Robots, Nikolaus Correll, 2015.