4280-Information Theory  (Spring 2014)   (   to Main Page)

Spring 2014 Calendar ( to Main page )
January 6-8-10: Introduction, Entropy, definitions and properties,
                               CT Chap.  2

January 13-15-17: Entropy, Asymptotic, equipartition property,
                               CT Chap.  2 & 3


Homework #1:
  CT Chap. 2, p.43-54       Problems # 2.2, 2.3, 2.4, 2.5, 2.7, 2.10, 2.12, 2.14, 2.16
  Due date: January 24th
January 22-24: Stochastic Processes, Data compression, CT Chap.  4 & 5
   (Jan 20 is Martin Luther King's Day)
January 27-29-31: Data compression, CT Chap.  5

Homework #2:
  CT Chap. 3, p.64-69         Problems # 3.1, 3.4
  CT Chap. 4, p.88-100       Problems # 4.1, 4.4, 4.6, 4.7, 4.33
  CT Chap. 5, p.142-157     Problems # 5.3,

  Due date: February 17th
February 3-5-7: Data compression, CT Chap.  5
February 10-12-14: Data compression, CT Chap.  5,
    (February 12 canceled, weather conditions)  
Channel Capacity, CT Chap.  7.1


Homework #3:
  CT Chap. 5, p.142-157     Problems # 5.4, 5.16
  CT Chap. 7, p.223-224     Problems # 7.1, 7.2, 7.4, 7.5, 7.3, 7.6

  Due date: March 3rd
February 17-19-21: Channel Capacity, CT Chap.  7.2-7.5-7.7
February 24-26-28: Channel Capacity, CT Chap.  7.2-7.5-7.7
March 3-5-7: Differential Entropy CT Chap.  8

Homework #4:
  CT Chap. 7, p.227-236       Problems # 7.14, 7.15, 7.28
  CT Chap. 8, p.256-258       Problems # 8.1, 8.8, 8.9

  Due date: March 24th
March 10-12-14: Gaussian Channels, CT Chap.  9.1-9.3

     Make up class: March 10 7:05-7:55pm Skiles 270

March 17-19-21: Spring Break
March 24-26-28: Gaussian Channels, CT Chap. 9.4-9.6
March 31 April 2-4: Rate Distorsion Theory, CT Chap. 10.1-10.3

Homework #5:  ( to Main page)
  CT Chap. 9, p.290-292       Problems # 9.1, 9.2, 9.3, 9.5, 9.10, 9.20 (long)
  CT Chap. 10, p.336-338     Problems # 10.1, 10.2, 10.6

  Due date: April 11th
April 7-9-11: Rate Distorsion Theory, CT Chap. 10.7-10.8,
                          Kolmogorov complexity CT Chap. 14.1-14.2,

April 14-16-18: Kolmogorov Complexity, CT Chap. 14.1-14.3
April 21-23-25: Kolmogorov Complexity, CT Chap. 14.4-14.8

Final Exam: April 30th, 8-11am Skiles 271