TEL 517 - Information Theory

Course Objectives

This is a 3-credit course that focuses on measure of information, properties of entropy, joint and conditional entropy. Noiseless coding technique: Kraft inequality, noiseless coding theorem, Huffman codes, Lempel-Ziv Algorithm. Sources with memory. Discrete memoryless channels, channel capacity and calculation methods. Optimum, maximum likelihood decision rules. Noisy-channel coding theorem. Error correcting coding: Linear block codes, generator and parity check matrices, error syndrome. Hamming codes, cyclic codes, BCH codes, convolutional codes and their properties, encoder and decoder structures.

Course Description

This is a 3-credit course that focuses on measure of information, properties of entropy, joint and conditional entropy. Noiseless coding technique: Kraft inequality, noiseless coding theorem, Huffman codes, Lempel-Ziv Algorithm. Sources with memory. Discrete memoryless channels, channel capacity and calculation methods. Optimum, maximum likelihood decision rules. Noisy-channel coding theorem. Error correcting coding: Linear block codes, generator and parity check matrices, error syndrome. Hamming codes, cyclic codes, BCH codes, convolutional codes and their properties, encoder and decoder structures.