Skip to search boxSkip to navigationSkip to main content

On the use of stochastic differential games against nature to ergodic control problems with unknown parameters

Research Output: Contribution to journal Article Peer-review

Publication Information

Output type

Research Output: Contribution to journal Article Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 897-909 (13 pages)

Journal (Volume, Issue Number)

International Journal of Control (Volume 88, Issue 5)

Publication milestones

  • Published - 04/05/2015

Publication status

Published - 04/05/2015

ISSN

0020-7179

Publication IDs

  • Scopus: 84926421176

Abstract

In this paper, we propose an application of the so-called games against nature for giving solution to an ergodic control problem governed by a general class of Markov diffusion processes whose coefficients depend on an unknown and non-observable parameter. To this end, we assume that the values of the parameter are taken by means of actions made by some opposite player of the controller (the nature). Then, the problem reduces to finding optimality for the controller given that the nature has chosen its best strategy. Such a control is also known as the worst case optimal control. Our analysis is based on the use of the dynamic programming technique by showing, among other facts, the existence of classical (twice differentiable) solutions of the so called Hamilton Jacobi Bellman equation. We also provide an example on economic welfare to illustrate our results.