Mathematical Foundations · Linear Algebra

Linear Algebra: Applications in Statistics

Public introduction · full guide in Eikos

Introduction

What this guide covers

Introduction Introduction Geometry of multivariate analysis · Algebraic foundations

Overview

Topics covered

  • Introduction
  • Vector spaces and the geometry of multivariate data
  • Projection matrices and the centering operator
  • Quadratic forms and their statistical moments
  • The multivariate normal distribution
  • Linearity Property

Related concepts

Main connections

  • Linear algebra & matrices
  • Variance & standard deviation
  • Linear regression
  • Residual analysis & diagnostics
  • Principal component analysis (PCA)
  • Analysis of variance (ANOVA)

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

X=[x11x12⋯x1px21x22⋯x2p⋮⋮⋱⋮xn1xn2⋯xnp]=[𝐱1⋅T𝐱2⋅T⋮𝐱n⋅T]=[𝐱⋅1𝐱⋅2⋯𝐱⋅p]
View LaTeX sourceX = \begin{bmatrix} x_{11} & x_{12} & \cdots & x_{1p} \\ x_{21} & x_{22} & \cdots & x_{2p} \\ \vdots & \vdots & \ddots & \vdots \\ x_{n1} & x_{n2} & \cdots & x_{np} \end{bmatrix} = \begin{bmatrix} \mathbf{x}_{1\cdot}^T \\ \mathbf{x}_{2\cdot}^T \\ \vdots \\ \mathbf{x}_{n\cdot}^T \end{bmatrix} = \begin{bmatrix} \mathbf{x}_{\cdot 1} & \mathbf{x}_{\cdot 2} & \cdots & \mathbf{x}_{\cdot p} \end{bmatrix}