Statistical Modeling & Regression · Non-Parametric Statistics

Nonparametric statistics: Nonparametric regression and smoothing

Public introduction · full guide in Eikos

Introduction

What this guide covers

A comprehensive and mathematically rigorous treatment of functional estimation, kernel smoothing, local polynomials, penalized splines, and additive models, fundamental to modern distribution-free statistical inference.

Overview

Topics covered

  • Introduction
  • Non-Parametric Regression and Smoothing Methods
  • Theoretical Framework of Non-Parametric Regression
  • The Fundamental Dilemma: Bias-Variance Tradeoff
  • Kernel-Based Estimators (Kernel Smoothing)
  • The Nadaraya-Watson Estimator

Related concepts

Main connections

  • Linear algebra & matrices
  • Calculus & differentiation
  • Variance & standard deviation
  • Mean & expected value
  • Non-parametric tests
  • Cross-validation & train/test splits

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

m(x)=𝔼[Y∣X=x]=∫ℝyfY|X(y|x)dy
View LaTeX sourcem(x) = \mathbb{E}[Y \mid X = x] = \int_{\mathbb{R}} y \, f_{Y|X}(y|x) \, dy