EE 377: Information Theory and Statistics (STATS 311)

Course Description

Information theoretic techniques in probability and statistics. Fano, Assouad,and Le Cam methods for optimality guarantees in estimation. Large deviationsand concentration inequalities (Sanov's theorem, hypothesis testing, theentropy method, concentration of measure). Approximation of (Bayes) optimalprocedures, surrogate risks, f-divergences. Penalized estimators and minimumdescription length. Online game playing, gambling, no-regret learning. Prerequisites: EE 276 (or equivalent) or STATS 300A. This course is offered every other year.