Machine Learning & Artificial Intelligence · Artificial Intelligence & Deep Learning

Deep Learning Theory — Artificial Intelligence

Public introduction · full guide in Eikos

Introduction

What this guide covers

Rigorous mathematical foundations, optimization in non-convex spaces, regularization dynamics and deep representation architectures.

Overview

Topics covered

  • Introduction
  • Deep Learning
  • Mathematical Foundations of Deep Learning
  • Fundamentals of Multilinear Algebra and Tensors
  • Information Theory and Probability Divergences
  • The Artificial Neuron and the Multilayer Perceptron (MLP)

Related concepts

Main connections

  • Calculus & differentiation
  • Regularization (Lasso / Ridge / Elastic Net)
  • Neural networks & deep learning
  • Linear algebra & matrices
  • Variance & standard deviation
  • Self-attention & Transformer architectures

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

F(x)=∑i=1kβiσ(𝐰iT𝐱+vi)
View LaTeX sourceF(x) = \sum_{i=1}^{k} \beta_i \sigma\left(\mathbf{w}_i^T \mathbf{x} + v_i\right)