Machine Learning & Artificial Intelligence · Machine Learning & Ensembles

Statistical Learning Theory — Rigorous Mathematical Reference

Public introduction · full guide in Eikos

Introduction

What this guide covers

Introduction Introduction Mathematics of Learning · Expert Level AI

Overview

Topics covered

  • Introduction
  • Fundamentals of Statistical Learning Theory
  • Epistemological Nature of Learning Theory
  • The Dilemma of Induction and the Need for Delimitation
  • Probability Space and Risk Formulation
  • Formal Definition of the Sampling Environment

Related concepts

Main connections

  • Variance & standard deviation
  • Linear algebra & matrices
  • Regularization (Lasso / Ridge / Elastic Net)
  • Calculus & differentiation
  • Mathematical expectation & moments
  • Linear regression

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

S={(X1,Y1),(X2,Y2),…,(Xn,Yn)}∈(𝒳×𝒴)n
View LaTeX sourceS = \{(X_1, Y_1), (X_2, Y_2), \ldots, (X_n, Y_n)\} \in (\mathcal{X} \times \mathcal{Y})^n