TEL 517 - Information Theory

Course Objectives

To convey the basic concepts of information theory
To introduce the fundamental limits of source and channel coding
To teach the basic source and channel coding techniques

Course Description

Information measure, entropy, its properties, joint and conditional entropy. Noiseless coding technique: Kraft inequality, noiseless coding theorem, Huffman codes, Lempel-Ziv algorithm. Sources with memory. Discrete memoryless channels, channel capacity and computing methods. Optimum and maximum likelihood decoding techniques. Noisy coding theorem. Error correcting codes: Linear block codes, generator and parity check matrices, syndrome. Hamming codes, cyclic codes, BCH codes, convolutional codes, properties, encoder and decoder structures.