Introduction
What this guide covers
Introduction Information Analysis and Computing
Overview
Topics covered
- Introduction
- Information Theory and its modern applications
- Fundamentals and Shannon Entropy
- 1.1 Khinchin's axiomatic derivation
- 1.2 Joint and Conditional Entropy
- 1.3 Mutual Information
Related concepts
Main connections
Compatible notation
Mathematical sample in LaTeX
The expression is rendered accessibly, with its LaTeX source preserved below.
View LaTeX source
I(x_i) = -\log_b p_i = \log_b \left(\frac{1}{p_i}\right)