4280-Information Theory  (Spring 2017)   (   to Main Page)

Spring 2017 Calendar ( to Main page )
January 9-11-13: Introduction, Entropy, definitions and properties,
                               CT Chap.  2

January 18-20 & 23: Entropy, CT Chap.  2
   (Jan 16 is Martin Luther King's Day)
Homework #1:  ( to Main page)
  CT Chap. 2, p.43-54       Problems # 2.2, 2.3, 2.4, 2.5, 2.7, 2.10, 2.12, 2.14, 2.16
  Due date: Friday January 27th
January 25-27: Asymptotic, equipartition property, Stochastic Processes,
                              CT Chap.  3 & 4

Jan. 30-Feb. 1-3: Stochastic Processes, Data compression, CT Chap.  4 & 5

Homework #2:  ( to Main page)
  CT Chap. 3, p.64-69         Problems # 3.1, 3.4
  CT Chap. 4, p.88-100       Problems # 4.1, 4.4, 4.6, 4.7, 4.33
  CT Chap. 5, p.142-157     Problems # 5.3,

  Due date: Friday February 17th
February 6-8-10: Data compression, CT Chap.  5
February 13-15-17: Channel Capacity, CT Chap.  7

Homework #3:  ( to Main page)
  CT Chap. 5, p.142-157     Problems # 5.4, 5.16
  CT Chap. 7, p.223-224     Problems # 7.1, 7.2, 7.4, 7.5, 7.3, 7.6

  Due date: Friday March 10th
February 20-22-24: Channel Capacity, CT Chap.  7.7-7.11
February 27 & March 1-3: Channel Capacity, CT Chap.  7.12-7.13
                                     Differential Entropy, CT Chap.  8

March 6-8-10: Gaussian Channels CT Chap.  9.1-9.6

Homework #4:  ( to Main page)
  CT Chap. 7, p.227-236       Problems # 7.14, 7.15, 7.28
  CT Chap. 8, p.256-258       Problems # 8.1, 8.8, 8.9

  Due date: Friday March 31st
March 13-15-17: Gaussian Channels, CT Chap.  9.6
                                Rate Distortion Theory CT Chap.  10.1-10.3

March 20-22-24: Spring Break
March 27-29-31 Rate Distortion Theory, CT Chap. 10.4-10.8
April 3-5-7: Kolmogorov Complexity, Turing Machines CT Chap. 14.1-14.3

Homework #5:  ( to Main page)
  CT Chap. 9, p.290-292       Problems # 9.1, 9.2, 9.3, 9.5, 9.10, 9.20 (long)
  CT Chap. 10, p.336-338     Problems # 10.1, 10.2, 10.6

  Due date: Friday April 14th
April 10-12-14: Kolmogorov Complexity CT Chap. 14.4-14.10,
April 17-19-21: Kolmogorov Complexity, CT Chap. 14.11-14.13
April 24-26-28: Review week,

Final Exam: Wednesday May 3rd, 2:50-5:40pm Skiles 268