Zahri-Edu University › Probability & Statistics

STAT 301

Stochastic Processes

Markov chains, Poisson processes, continuous-time Markov processes, martingales and an introduction to Brownian motion.

In preparation

The lecture notes for this course are being written. Below is the planned table of contents; chapters will be published one by one.

Table of contents

6 chapters · 19 sections

1

Introduction

  1. 1.1Random processes
  2. 1.2Examples
2

Discrete-Time Markov Chains

  1. 2.1Transition matrices
  2. 2.2Classification of states
  3. 2.3Stationary distributions
  4. 2.4Convergence to equilibrium
  5. 2.5Random walks
3

Poisson Process

  1. 3.1Definition
  2. 3.2Interarrival times
  3. 3.3Thinning and superposition
4

Continuous-Time Markov Chains

  1. 4.1Generators
  2. 4.2Birth–death processes
  3. 4.3Queues
5

Martingales

  1. 5.1Conditional expectation
  2. 5.2Martingales and stopping times
  3. 5.3Optional stopping theorem
6

Brownian Motion

  1. 6.1Definition
  2. 6.2Reflection principle
  3. 6.3Towards stochastic calculus