Statistical Modeling & Regression · Multivariate Analysis

Multivariate analysis: Classification and discriminant analysis · Advanced reference manual

Public introduction · full guide in Eikos

Introduction

What this guide covers

Multivariate analysis addresses the statistical study of units on which a vector of simultaneous observations is measured. Unlike conventional univariate analysis, the multivariate framework assumes that internal covariation between variables has critical information for decision making.

Overview

Topics covered

  • Introduction
  • Classification and Discriminant Analysis
  • Fundamentals of Multivariate Analysis and Taxonomy of Classification
  • The Geometry of Multivariate Space
  • Taxonomy: Supervised vs. Unsupervised Learning
  • Bayesian Decision Theory and Classification Rules

Related concepts

Main connections

  • Linear algebra & matrices
  • Bayes' theorem & priors
  • Supervised machine learning
  • Residual analysis & diagnostics
  • Regularization (Lasso / Ridge / Elastic Net)
  • Diagnostic test evaluation & ROC

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

DM(𝐱,𝐲)=(𝐱−𝐲)⊤𝚺−1(𝐱−𝐲)
View LaTeX sourceD_M(\mathbf{x}, \mathbf{y}) = \sqrt{(\mathbf{x} - \mathbf{y})^{\top}\boldsymbol{\Sigma}^{-1}(\mathbf{x} - \mathbf{y})}