TEL 517 - Information Theory

Course Objectives

To provide basic concepts of information theory.
To teach limitations of the source and channel coding techniques.
To teach basic source and channel coding techniques.

Course Description

Measure of information, properties of entropy, joint and conditional entropy. Noiseless coding technique: Kraft inequality, noiseless coding theorem, Huffman codes, Lempel-Ziv Algorithm. Sources with memory. Discrete memoryless channels, channel capacity and calculation methods. Optimum, maximum likelihood decision rules. Noisy-channel coding theorem. Error correcting coding: Linear block codes, generator and parity check matrices, error syndrome. Hamming codes, cyclic codes, BCH codes, convolutional codes and their properties, encoder and decoder structures.