Information Theory for Communication Systems

The aim of this module is to provide an appreciation of the important contributions made by Claude Shannon to communications, including the fundamental limits of data compression, channel capacity, and the source-channel separation principle. Students will obtain an understanding of the concept of “a bit of information” in Shannon’s sense. Coding, modulation and demodulation will be briefly covered, but all at the most basic level of trying to transfer a bit of information reliably from sender to receiver. Topics are as follows: introduction to communications, including standardized interfaces and layering, communication system blocks, source-channel separation principle; coding for discrete sources; channels, modulation and demodulation of binary signals; coding and Shannon capacity; Gaussian channels.

Login Required