Advanced & Applied Topics · Operations Research & Optimization

Dynamic programming in operations research — Doctoral-level scientific reference

Public introduction · full guide in Eikos

Introduction

What this guide covers

Introduction Introduction Operations Research · Optimal Control

Overview

Topics covered

  • Introduction
  • Mathematical Modeling of Dynamic Programming
  • Epistemological Foundations and History of the Paradigm
  • Historical Genesis and the Principle of Optimality
  • Overlapping Subproblem Structures and Optimal Substructure
  • Structural Comparison: PD versus other Optimization Schemes

Related concepts

Main connections

  • Linear algebra & matrices
  • Calculus & differentiation
  • Bayes' theorem & priors
  • Neural networks & deep learning
  • Mathematical expectation & moments
  • Directed acyclic graphs (DAGs)

Compatible notation

Mathematical sample in LaTeX

The expression is rendered accessibly, with its LaTeX source preserved below.

V*(s)=maxa∈A{R(s,a)+γ∑s'P(s'|s,a)V*(s')}
View LaTeX sourceV^*(s) = \max_{a \in A} \left\{ R(s,a) + \gamma \sum_{s'} P(s'|s,a) V^*(s') \right\}