COMP 353 Information Theory

An introduction to information theory that will focus on: (1) data: transmission, storage, lossless data compression (such as ZIP and LZW), lossy data compression (found in JPG or MP3 formats), channel capacity; (2) coding: optimal codes, error correcting codes, the several coding theorems of Claude Shannon; (3) measures of information: entropy, relative entropy, relation between entropy and information content; and (4) application topics that vary from year to year and might include: signal processing, image processing, pattern recognition, cryptography and data security, quantum computing, data analysis, and more.

Sub-field: THEORY