4280-Information Theory  (Spring 2011)   (to main page)


Calendar

January 11th & 13th: Introduction, Entropy, definitions and properties, CT Chap.  2
January 18th & 20th: Entropy, Asymptotic equipartition property, CT Chap.  2 & 3

Homework #1: CT Chap. 2, p.43-54    # 2.2, 2.3, 2.4, 2.5, 2.7, 2.10, 2.12, 2.14, 2.16
   Due date: Jan. 25th, 3pm

January 25th & 27th: Stochastic Processes, Data compression, CT Chap.  4 & 5
February  1st &  3rd: Data compression, CT Chap.  5

Homework #2: CT Chap. 3, p.64-69     # 3.1, 3.4
CT Chap. 4, p.88-100    # 4.1, 4.4, 4.6, 4.7, 4.33
   Due date: Feb. 8th, 3pm CT Chap. 5, p.142-157   # 5.3

February   8th & 10th: Data Compression, CT Chap.  5
February 15th & 17th: Channel Capacity, CT Chap.  7.1-7.5

Homework #3: CT Chap. 5, p.142-157  # 5.4, 5.16
CT Chap. 7, p.223-224  # 7.1, 7.2, 7.4, 7.5, 7.3, 7.6
   Due date: Feb. 22nd, 3pm

February 22th & 23rd: Channel Capacity, CT Chap.  7.6-7.7
March  1st &  3rd: Differential Entropy, CT Chap.  8
March 8th & 10th: Channel Capacity, CT Chap.  7.8-7.13 

Homework #4: CT Chap. 7, p.227-236  # 7.14, 7.15, 7.28
CT Chap. 8, p.256-258  # 8.1, 8.8, 8.9
   Due date: March 15th, 3pm

March 15th & 17th: Gaussian Channels, CT Chap.  9.1-9.3
March 29th & 31th: Gaussian Channels, CT Chap.  9.4-9.6
April 5th & 7th: Rate Distorsion Theory, CT Chap.  10.1-10.3

Homework #5: CT Chap.   9, p.290-292  # 9.1, 9.2, 9.3, 9.5, 9.10, 9.20 (long)
CT Chap. 10, p.336-338  # 10.1, 10.2, 10.6
   Due date: April 12th, 3pm   Spring break: March 21-25

April 12th & 14th: Rate Distorsion Theory, CT Chap.  10.4-10.8
April 19th & 21th: Kolmogorov Complexity, CT Chap.  14.1-14.3
April 26th & 28th: Kolmogorov Complexity, CT Chap.  14.4-14.8

Final Exam: May 5th, 2011, 11:30am-2:20pm, Skiles 170