About this document
Entropy and Mutual Information in COMP2610 by Muhammad Abdul Jabbar is a document available to read on EtoBox.
This document summarizes a lecture on information theory. It reviews concepts like information content, entropy, and joint/conditional entropies. It then previews topics to be covered in the current lecture, including the decomposability of entropy, relative entropy/KL divergence, and mutual information. Mutual information is defined as the reduction in uncertainty of one random variable due to knowledge of another. The document provides an example to illustrate the decomposability of entropy into separate
- Author
- Muhammad Abdul Jabbar
- Language
- EN