Statistical Modeling & Regression · Generalized Linear Models (GLM)

Generalized linear models and the exponential family of distributions · Advanced reference treatise

Public introduction · full guide in Eikos

Introduction

What this guide covers

The classical general linear model (OLS or ordinary least squares regression) has been the core of empirical analysis for decades. However, its formulation rests on restrictive mathematical assumptions that are often unsustainable given the intrinsic nature of observational and experimental empirical data.

Overview

Topics covered

  • Introduction
  • Introduction Generalized Linear Models
  • Deficiencies of the Classical Linear Model and Beginnings of the GLM
  • Critical Limitations of the Classical Approach
  • The Unification of Nelder and Wedderburn
  • The Exponential Family of Distributions: Unified Formulation

Related concepts

Main connections

  • Variance & standard deviation
  • Maximum likelihood estimation
  • Linear algebra & matrices
  • Poisson distribution
  • Calculus & differentiation
  • Mean & expected value

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

Y=𝐗𝛃+𝛆
View LaTeX sourceY = \mathbf{X}\boldsymbol{\beta} + \boldsymbol{\varepsilon}