ESTI008-13 Information Theory and Codes (4-0-4)
Syllabus:
Review of Probability Theory and examples in Digital Communications; Information and Entropy; Discrete
Memoryless Source Coding; Theorem of Source Coding; Classification of codes: fixed-length, non-sigular,
prefix, uniquely decodable, instantaneous; Optimal Source Coding (Shanon-Fano, Huffman and Lempel-Ziv);
Discrete Memoryless Channel; Theorem of Channel Coding; Continuous Channel Capacity; Applications of
Information Theory: performance of communication systems; Notions of Numeric Fields and polynomial
rings; Block Codes; Cyclic Codes; Convolutional Codes; Applications of convolutional codes in
communications.
Recommendation:
Digital Communication.
Required texts:
●
●
COVER, T. M. ; THOMAS, J. A. Elements of Information Theory, John Wiley & Sons, 2a Ed., 2006.
LIN, S. ; COSTELLO, D. J. Error Control Coding – Fundamentals and Applications, Prentice Hall, 2a ed.,
2004.
● MOON, T. K. Error Correction Coding Mathematical Methods and Algorithms, John Wiley and Sons, 1a
ed., 2005.
Additional texts:
● HAYKIN, S.; Sistemas de Comunicação: Analógicos e Digitais, Bookman, 4ª Ed., 2004.
● LATHI, B. P.; Modern Digital and Analog Communication Systems, Oxford, 4ª Ed., 2010
● CARLSON, A. B.; CRILLY, P. B.; RUTLEDGE, J.; Communications Systems: An Introduction to Signals and
Noise in Electrical Communications, MacGraw-Hill, 4ª Ed., 2001.
● HSU, H.; Theory and Problems of Analog and Digital Communications, 2ª Ed., McGraw-Hill, 2003.
● GALLAGER, R.; Principles of Digital Communication, Cambridge University Press, 2008 V.S.
● PLESS, V. S.; HUFFMAN, W.C.; Fundamentals of error-correcting codes, Cambridge University Press,
2003.