Lecture 11: Stability in reinforcement learning

(Big slides Download Big slides) (Small slides Download Small slides) (Recording)

This lecture is about

  • Model Predictive Control
  • Stability and constrained controllability
  • Contraction of the Bellman operator
  • An abstract view on contraction and stability

Read sections 2.5.1, 2.5.2, 4.2 in Bertsekas' book Links to an external site. and section 3 in his tutorial paper Lessons from AlphaZero.