Volume 5, Number 1, January 2009, pp. 169-181
Roy Cerqueti
Key words:
dynamic programming, stochastic optimal control, exit time, measurable selection
Mathematices Subject Classification: 90C39, 93E20
ONLINE SUBSCRIPTION (Institutional Subscription Only)
Copyright© 2008 Yokohama Publishers
Back

Abstract:
The aim of this paper is to provide an original step-by-step proof of the optimality principle, for a certain class of stochastic control problems with exit time. The presence of exit time is responsible of measurability problems involving the control processes. Therefore, in order to prove the dynamic programming principle, we proceed by measurable selection. The measurable selection theorem comes from an important result in functional analysis due to Jankov and von Neumann, and it is also obtained by formalizing the main properties of the admissible region and of the state variable.
Dynamic programming via measurable selection