COMP 353 Information Theory

An introduction to information theory which will focus on (1) Data: transmission storage lossless data compression (such as ZIP LZW) lossy data compression (found in JPG or MP3 formats) channel capacity; (2) Coding: optimal codes error correcting codes the several coding theorems of Claude Shannon; (3) Measures of information: entropy relative entropy relation between entropy and information content; (4) Application topics which vary from year to year which might include: signal processing image processing pattern recognition cryptography and data security quantum computing data analysis and more.