Introduction. Shannon’s information measures. Entropy rate of a stationary process. The source coding theorem. Kraft inequality. Huffman code. Redundancy of a prefix code. The channel coding theorem. Rate-distortion theory. Universal data compression.

Course
IERG5154/ENGG5301 – Information Theory
IERG Elective MIEG Elective Postgraduate
Co-requisite(s):
Unit(s):
3
Pre-requisite(s):
Exclusion:
ENGG5301
Term Offered:
Teacher:
Remarks: