課程綱要表

課程名稱：消息理論 (Information Theory)

授課老師：韓永祥

課程目標：本課程之目標是教導學生基本數位通訊相關數學

成績考查方式：期中考試佔40％，期末報告50％，平常成績佔10％

There is no required text. A set of copyrighted class notes, which is part of a textbook in preparation, will be provided in installments. You may obtain the newest version of the lecture notes from http://shannon.cm.nctu.edu.tw/

The following is a list of recommended texts:

1. Elements of Information Theory, Thomas M. Cover and Joy A.Thomas, John Wiley & Sons, Inc., 2006.

2. Principles and Practices of Information Theory, Richard E. Blahut, Addison Wesley, 1988.

期中考預定在11月13日舉行

Your final grade for the course will be based on your performance in the midterm exam, as well as a final study report on a material on Information Theory and a two-hour oral presentation on your report. Since it is an advanced course for which the objective is mainly to provide you with the necessary background on underlying communication theories, your attendance to each lecture is important.

1. Introduction

2. Review of Real Analysis

3. Review of Probability Theory

4. Information Measures

5. Lossless Data Compression

6. Channel Capacity

7. Lossy Data Compression