Machine Learning & Artificial Intelligence · Machine Learning & Ensembles

Advanced Supervised Learning and Kernel Methods

Public introduction · full guide in Eikos

Introduction

What this guide covers

Introduction Introduction Artificial Intelligence and Statistical Learning at Doctoral Level

Overview

Topics covered

  • Introduction
  • Statistical Learning Theory and Complexity
  • Rademacher complexity
  • Vapnik-Chervonenkis (VC) dimension
  • Regularization and Optimization in Functional Spaces
  • Regularization vs : Ridge and Lasso

Related concepts

Main connections

  • Linear algebra & matrices
  • Calculus & differentiation
  • Regularization (Lasso / Ridge / Elastic Net)
  • Supervised machine learning
  • Bayes' theorem & priors
  • Principal component analysis (PCA)

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

R(h)=E(X,Y)∼ℙ[ℓ(h(X),Y)]=∫𝐗×𝐘ℓ(h(x),y)dℙ(x,y).
View LaTeX sourceR(h) = \E_{(X,Y) \sim \mathbb{P}}[\ell(h(X), Y)] = \int_{\X \times \Y} \ell(h(x), y) \dd \mathbb{P}(x, y).