Introduction
What this guide covers
Introduction Introduction Probabilistic, Algebraic and Advanced Mathematical Analysis
Overview
Topics covered
- Introduction
- Information Theory: Communication Channels and Capacity
- Historical perspective and Shannon's paradigm
- Mathematical foundations and measurement spaces
- 1. Shannon entropy
- 2. Joint and Conditional Entropy
Related concepts
Main connections
Compatible notation
Mathematical sample in LaTeX
The expression is rendered accessibly, with its LaTeX source preserved below.
View LaTeX source
H(X) = -\sum_{x \in \mathcal{X}} p(x) \log_b p(x) = \mathbb{E}\left[\log_b \frac{1}{p(X)}\right]