消息理論

Information Theory deals with some fundamental limits in communication systems. For example, we normally would like to use as few bits (or bits per second) as possible to represent an information source, either at little distortion or at no distortion at all. But how few can one go? On the other hand, we usually would like to transmit as many bits (or bits per second) as possible over a noisy communication channel, at a close-to-zero error probability. But how many can one go? Such are some of the questions addressed in Information Theory, where the answered are phrased in such terms as entropy, rate-distortion function, channel capacity, etc.

1. 必備:大學部層次「機率與統計」。 (Must have: Undergraduate-level "Probability and Statistics.") 2. 可能非常有助:大學部層次「線性代數」、「訊號與系統」、「通訊原理」、「數位通訊原理」。 (May be very helpful: Undergraduate-level "Linear Algebra," "Signals and Systems," "Principles of Communication Systems," and "Principles of Digital Communication.")

http://cwww.ee.nctu.edu.tw/~dwlin/courses/18it

課程進行方式暫定包括課堂講授、作業、及三次考試。評分方式於第一堂課及講義中公佈。 The course will be conducted as a regular lecture course. There will be homework assignments and three exams (tentative). Details of the grading method will be described in the course notes and announced during the first lecture.

• 1. Introduction 2. Information and entropy 3. Source coding theorem 4. Channel capacity and channel coding theorem 5. Continuous source, differential entropy, and Gaussian channel 6. Rate-distortion theory 7. Introduction to network information theory

T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed., Wiley, 2006.

地點

Discussed in the first class meeting.

時間

Discussed in the first class meeting.

聯絡方式

Discussed in the first class meeting.