Fundamental principles of communication theory, information measures, entropy, mutual information, divergence; source encoding, Huffman codes, lossless source coding theorem; channel capacity, noisy channel coding theorem, information transmission theorem; continuous-alphabet channels; capacity of discrete-time and band-limited continuous-time Gaussian channels, channels with memory, rate distortion theory. Given jointly with MATH 874*. PREREQUISITE
