Exercise 7: Approximation in policy space

Paper Exercises

In this exercise we will explore

  • The Bellman equation
  • Policy iteration in continuous space
  • Policy iteration in discrete space

Paper exercises and solutions can be found in the exercise compendium.

It is recommended that you complete this paper exercise before moving on to the computer exercise.

Computer Exercises

Computer Exercise

  • Rocket Landing: Affine policy

Complete the Computer Exercise 7 (available on the lab computers).