校際選修

115-1 選課時程

進行中

  • 初選第一階段 6/15/2026
  • 初選第二階段 6/22/2026
  • 校際選修 8/24/2026
  • 初選第三階段 8/31/2026
  • 開學後加退選 9/7/2026
  • 逾期加退選 9/21/2026
選課資源

機器人視覺

Robotic Vision

學期
106-2
學分
3 學分
當期課號
5059
永久課號
ICN9005
開課單位
電控工程研究所
授課教師
王學誠
校區
光復
類別
選修
上課時間表
週四
7
15:30–16:20
機器人視覺
EE635
3 節連堂
8
16:30–17:20
9
17:30–18:20

* 根據陽明交大上課時間表所列

概述

This course aims at training students to participate world-class competition, and we will target the RobotX Competition (https://www.robotx.org/) in 2018. This course will cover the fundamental and advanced domains in vision for mobility tasks, including the challenges combining object recognition, pose estimation, motion planning, and SLAM. We will systematically study each components from previous winning teams in 2014 and 2016, as well as cutting-edge methods that may better improve the performance. Students will form teams to develop term projects, and we encourage in-class discussions and presentation skills with a white board for class participations. This course is a "learning-by-doing," and include in-class lab/tutorial in each teaching module. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and focus advanced topics using Gazebo, 3D Perception, and deep learning.

先修科目

This course involve a fair amount of probability, linear algebra, and programming. Students are required to take image processing or computer vision. Being familiar with Unix-like system, Git, C++, Robot Operation System (ROS) and Python is needed. Due to the tight competition schedule, we wish to cover more advanced topics directly relevant to the competition. *We will assume that you have been familiar with Duckietown A to H (http://duckietown.nctu.edu.tw/materials.html), which is an open-source, self-learning material. 20 Duckiebots will be available after 1/20. Please feel free to get started early during winter break! *Due to the limited robots/computing resource for Gazebo and Deep Learning, we will ask all attended students to fill in a short self-evaluation and motivation statement. We apologise that we can only enroll a limited number of students according to students' 1) motivation, and knowledge of 2) of Unix/Ubuntu, Vim, Git, 3) Duckietown and ROS, 4) computer vision and image processing, and 5) your own computing resource (such as a native Ubuntu machine with GTX 1060 or above).

教學方式

* Task-oriented: We aim at the RobotX competition (https://www.robotx.org/) in 2018. * Learning by Doing: We have lecture and lab sections, and include hand-on tutorial/lab materials each week. * In-class Discussion: We encourage discussions and presentation skills using a white board each team for class participation. We also wish to train students' presentation skills. * Project-based learning: each team will work on a term project related to RobotX Competition.

評分方式

1.學期作業: We have in-class tutorial/lab each week, and the lab materials typically include 3 specific tasks (programming/algorithm/system work). and students are expected to finish the lab materials during the class. 2. 考試狀況: There will be no midterm/final exams. 3.評量方法: In-Class Lab/Tutorials (40%), Midterm Project Proposal (20%) Final Presentation and Term Paper/Report (40%)

週次計畫
週次主題
第 1 週Introduction to Robotic Vision and RobotX Competition
第 2 週Part I: Gazebo Gazebo and Virtual Challenges Lab01: Subscribe/Publish ROS Messages in Gazebo
第 3 週Gazebo for Marine Robotics Lab02: Gazebo USV
第 4 週Duckietown Lane Following Revisit Lab03: Duckietown Virtual Lane Following
第 5 週Part II: From Duckietown to RobotX AprilTag; How to Read a Research Paper Lab04: AprilTag Navi
第 6 週HSV Filter & FSM Lab05: Light Buoy Sequence Detection
第 7 週Image Features: Harris Corner, FAST, SIFT, & MSER Lab06: Placard Detector with Image Feature
第 8 週Bayes Filter Lab07: GPS Navi
第 9 週Midterm Project Proposal Pitch
第 10 週Part III: 3D Perception 3D Sensors and Data Logging Velodyne & RGBD Camera Calibration
第 11 週Point Cloud and ICP Lab06: PCL Normal RANSAC ICP
第 12 週Laser-Based Feature Detection Lab07: 3D Feature Tracking
第 13 週Part IV: Deep Learning Intro to Deep Learning Lab11: Layer Computation
第 14 週Network Structure Lab12: Network Structure and Surgery
第 15 週DL Prediction Lab13: Prediction from Pre-trained Models
第 16 週DL Training Lab14: Training with Freiburg Groceries
第 17 週Feature Engineering vs. Deep Learning Lab15: Placard Detector with Deep Learning
第 18 週Final Presentation
教科書

1. Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010. 2. Robotics, Vision, and Control, Peter Croke, Springer, 2011. 3. Introduction to Autonomous Robots, Nikolaus Correll, 2015.