Introduction
What this guide covers
Introduction Statistical Geometry and Divergence Measures
Overview
Topics covered
- Introduction
- Information Theory and Statistical Inference
- Shannon Entropy, Differential and Axiomatic Entropy
- 1.1 Differential Entropy: The transition to the continuum
- Divergences of Information and Sanov's Theorem
- 2.1 Fundamental Analytical Properties
Related concepts
Main connections
Compatible notation
Mathematical sample in LaTeX
The expression is rendered accessibly, with its LaTeX source preserved below.
View LaTeX source
H(X) = -\sum_{x \in \mathcal{X}} p(x) \log_b p(x) = \mathbb{E} \left[ \log_b \frac{1}{p(X)} \right]