隨機時序決策與分析
Sequential Decision Modeling and Analytics
| 節 | 週五 |
|---|---|
2 09:00–09:50 | 隨機時序決策與分析 MB506 3 節連堂 |
3 10:10–11:00 | |
4 11:10–12:00 |
* 根據陽明交大上課時間表所列
This course provides an in-depth exploration of sequential decision making and its industrial applications. Students will gain a solid foundation in stochastic modeling, Markov Decision Processes (MDPs), and Reinforcement Learning (RL), with a focus on practical applications in optimization, automation, and decision-making under uncertainty. Hands-on experience through project work and presentations will ensure students can apply these concepts to real-world industrial problems.
Basic probability theory, operations research
Python-language programming
•Homework Assignments: 10% •Midterm Exam: 30% •Project: 30% •Final Exam: 30%
- Markov Decision Process (MDP)
- Reinforcement Learning (RL)
- Preliminary
| 週次 | 主題 |
|---|---|
| 第 1 週 | Introduction to Sequential Decision Making and Analytics |
| 第 2 週 | Stochastic Modeling: Basic Probability, Conditional Probabilities |
| 第 3 週 | Stochastic Modeling: Markov Chain Properties |
| 第 4 週 | MDP: Overview of MDP |
| 第 5 週 | MDP: Policy and Value Functions |
| 第 6 週 | MDP: Bellman Equations |
| 第 7 週 | MDP: Finite-Horizon and Infinite-Horizon MDPs |
| 第 8 週 | MDP: Policy and Value Iteration Methods |
| 第 9 週 | Midterm Exam |
| 第 10 週 | RL: Introduction to Reinforcement Learning |
| 第 11 週 | RL: Q-Learning and SARSA |
| 第 12 週 | RL: Temporal Difference (TD) Learning |
| 第 13 週 | Multi-Armed Bandits: Basics and Exploration Strategies |
| 第 14 週 | Multi-Armed Bandits: Advanced Topics and Thompson sampling |
| 第 15 週 | Final Exam |
| 第 16 週 | Project Presentation |
• Ross, Sheldon M. (2014) Introduction to probability models. Academic press. (optional) • Puterman, M. L. (2014). Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons. (optional) • Sutton R. & Barto A. (2020). Reinforcement Learning: An Introduction (2nd Edition). Cambridge: The MIT Press. (free online)
- 地點
- MB512
- 時間
- Mon. 12:00 – 14:00 (or by appointment)
- 聯絡方式
- kaiwen.tien@nycu.edu.tw