![[Univ of Cambridge]](http://www.eng.cam.ac.uk/images/house_style/uniban-s.gif){kind=small}
![[Dept of Engineering]](http://www.eng.cam.ac.uk/images/house_style/engban-s.gif){kind=small}
ENGINEERING TRIPOS PART IIB – 2013/2014 (module did not run 2012/13)
Module 4F5 - Advanced Communications and Coding
|
Leader: |
Dr Ramji Venkataramanan |
|
Timing: |
Michaelmas Term |
|
Prerequisites: |
The main pre-requisite is a good background in probability. 3F1 recommended; 3F4 useful but not required. |
|
Structure: |
16 lectures (including examples classes) |
| Assessment: | Material / Format / Timing / Marks Lecture Syllabus / Written exam (1.5 hours) / Start of Easter Term / 100 % |
AIM
This course will introduce students to the principles of information theory and coding theory, which form the foundations of modern communications and data storage systems. The first part of the course will describe the concepts used to measure information, and show how these can be used to characterize the information-carrying capacity of communication systems. The second part will introduce error correcting codes, which are practical techniques to achieve high data rates in the presence of noise. We discuss classical codes such as Reed-Solomon codes (used in DVDs and DSL) as well as modern techniques such LDPC codes (used in wireless communication and hard drives). The third part of the course will introduce the key features of wireless multi-user communication and discuss the information capacity of cellular systems.
Objectives
At the end of the module, students should
- Have a good understanding of why entropy and channel capacity arise as fundamental limits for data compression and transmission, respectively.
- Be able to implement decoders for error-correcting codes such as Reed-Solomon and LDPC
- Understand the concept of fading in wireless channels and how diversity techniques can be used to combat fading.
- Be familiar with techniques used in practical wireless systems.
Lecture Syllabus
Principles of Information Theory(5L,Dr Ramji Venkataramanan)
- Review of basic concepts:
- The end-to-end communication system – sources, channels, encoders & decoders
- How do we measure information? Entropy, Conditional Entropy, Mutual Information
- Types, Typical sequences and the Asymptotic Equipartition Property (AEP). Consequences of the AEP: Data compression
- Channel capacity & the noisy channel coding theorem
- Capacity of channels with additive Gaussian noise
Error-correcting Codes (6L, Dr. Jossy Sayir)
- Linear Block Codes
- Convolutional Codes, Reed-Solomon Codes
- LDPC codes and iterative decoding
Wireless Channels and Multi-user Communication (5L, Dr Ramji Venkataramanan)
- Modelling a wireless channel; Combating fading with diversity in time/frequency/space
- Cellular Systems: Multiple access and Interference Management
- Multiple-access (uplink) and Broadcast (downlink) channels
Useful References
Information Theory
- Elements of Information Theory, T. M. Cover & J. A. Thomas, Wiley-Interscience,2nd Ed. 2006
- Information Theory, Inference, and Learning Algorithms, D. Mackay, Cambridge Univ. Press. (Available free online)
- Information Theory and Reliable Communication, R. Gallager, John Wiley & Sons
Coding Theory
- Modern Coding Theory, T. Richardson & R. Urbanke, Cambridge Univ. Press. (this books covers LDPC codes)
- The Theory of Error-Correcting Codes, F. J. MacWilliams & N. J. A. Sloane, North Holland. (covers classical coding theory)
Wireless Communication:
- Fundamentals of Wireless Communication, D. Tse & P.Viswanath, Cambridge Univ. Press 2005. (Available free online)
- Wireless Communications, A. Goldsmith, Cambridge Univ. Press 2005.
Last updated: May 2013