(IC 1.1) Information theory and Coding - Outline of topics

Information theory & coding
Information theory & coding

Closely related fields:

  • Cryptography & Cryptanalysis
  • Algorithmic information theory (Kolmogorov complexity & minimum description length)
  • Network information theory
  • (less closely) Statistics & Machine learning
  • (also) Portfolio theorry
  • (also) Gambling

(IC 1.2) Applications of Compression codes

“Source coding”

Huffman codes
Huffman codes
Arithmetic coding
Arithmetic coding
Lempel-Ziv
Lempel-Ziv

(IC 1.3) Applications of Error-correcting codes

“Channel coding”

Hamming codes
Hamming codes
Reed-Solomon codes
Reed-Solomon codes
Turbo codes
Turbo codes
Gallager (LDPC) codes
Gallager (LDPC) codes

(IC 1.4) Source-channel separation


To be added..