Statistical Modeling & Regression · Generalized Linear Models (GLM)

Generalized linear models: quasi-likelihood and generalized estimating equations (GEE)

Public introduction · full guide in Eikos

Introduction

What this guide covers

Generalized Linear Models (GLM), introduced by Nelder and Wedderburn (1972), were a milestone in the unification of regression analysis for non-Gaussian response variables. However, its theoretical and practical validity is strictly subject to compliance with severe probabilistic restrictions.

Overview

Topics covered

  • Introduction
  • Generalized Linear Models, Quasi-likelihood and Generalized Estimating Equations (GEE)
  • 1. Fundamentals and Limitations of Classic GLMs
  • Moment Structure in the Exponential Family
  • The Collapse of Assumptions: The Phenomenon of Overdispersion
  • The Dimension of Correlated Data

Related concepts

Main connections

  • Variance & standard deviation
  • Maximum likelihood estimation
  • Linear algebra & matrices
  • Mean & expected value
  • Poisson distribution
  • Residual analysis & diagnostics

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

f(yi;θi,ϕ)=exp{yiθi−b(θi)a(ϕ)+c(yi,ϕ)}
View LaTeX sourcef(y_i; \theta_i, \phi) = \exp \left\{ \frac{y_i \theta_i - b(\theta_i)}{a(\phi)} + c(y_i, \phi) \right\}