4280-Information Theory  (Spring 2016)   (   to Main Page)

Spring 2016 Calendar ( to Main page )
January 11-13-15: Introduction, Entropy, definitions and properties,
                               CT Chap.  2

January 20-22 & 25: Entropy,
                               CT Chap.  2

   (Jan 18 is Martin Luther King's Day)

Homework #1:  ( to Main page)
  CT Chap. 2, p.43-54       Problems # 2.2, 2.3, 2.4, 2.5, 2.7, 2.10, 2.12, 2.14, 2.16
  Due date: Friday January 29th
January 27-29: Asymptotic, equipartition property, Stochastic Processes,
                              CT Chap.  3 & 4

February 1-3-5: Stochastic Processes, Data compression, CT Chap.  4 & 5

Homework #2:  ( to Main page)
  CT Chap. 3, p.64-69         Problems # 3.1, 3.4
  CT Chap. 4, p.88-100       Problems # 4.1, 4.4, 4.6, 4.7, 4.33
  CT Chap. 5, p.142-157     Problems # 5.3,

  Due date: Friday February 19th
February 8-10-12: Data compression, CT Chap.  5
February 15-17-19: Channel Capacity, CT Chap.  7

Homework #3:  ( to Main page)
  CT Chap. 5, p.142-157     Problems # 5.4, 5.16
  CT Chap. 7, p.223-224     Problems # 7.1, 7.2, 7.4, 7.5, 7.3, 7.6

  Due date: Friday March 11th
February 22-24-26: Channel Capacity, CT Chap.  7.7-7.11
February 29 & March 2-4: Channel Capacity, CT Chap.  7.12-7.13
                                     Differential Entropy, CT Chap.  8

March 7-9-11: Gaussian Channels CT Chap.  9.1-9.6

Homework #4:  ( to Main page)
  CT Chap. 7, p.227-236       Problems # 7.14, 7.15, 7.28
  CT Chap. 8, p.256-258       Problems # 8.1, 8.8, 8.9

  Due date: Friday April 1st
March 14-16-18: Gaussian Channels, CT Chap.  9.6
                                Rate Distortion Theory CT Chap.  10.1-10.3

March 21-23-25: Spring Break
March 28-30 & April 1st: Rate Distortion Theory, CT Chap. 10.4-10.8
April 4-6-8: Kolmogorov Complexity, Turing Machines CT Chap. 14.1-14.3

Homework #5:  ( to Main page)
  CT Chap. 9, p.290-292       Problems # 9.1, 9.2, 9.3, 9.5, 9.10, 9.20 (long)
  CT Chap. 10, p.336-338     Problems # 10.1, 10.2, 10.6

  Due date: Friday April 15th
April 11-13-15: Kolmogorov Complexity CT Chap. 14.4-14.10,
April 18-20-22: Kolmogorov Complexity, CT Chap. 14.11-14.13
April 25-27: Review week,

Final Exam: Friday April 29th, 11:30am-2:20pm Skiles 311