On the Expected Total Reward with Unbounded Returns for Markov Decision Processes - Inria - Institut national de recherche en sciences et technologies du numérique
Journal Articles Applied Mathematics and Optimization Year : 2020

On the Expected Total Reward with Unbounded Returns for Markov Decision Processes

Abstract

We consider a discrete-time Markov decision process with Borel state and action spaces. The performance criterion is to maximize a total expected utility determined by unbounded return function. It is shown the existence of optimal strategies under general conditions allowing the reward function to be unbounded both from above and below and the action sets available at each step to the decision maker to be not necessarily compact. To deal with unbounded reward functions, a new characterization for the weak convergence of probability measures is derived. Our results are illustrated by examples.

Dates and versions

hal-01953985 , version 1 (13-12-2018)

Identifiers

Cite

François Dufour, Alexandre Genadot. On the Expected Total Reward with Unbounded Returns for Markov Decision Processes. Applied Mathematics and Optimization, 2020, 82 (2), pp.433-450. ⟨10.1007/s00245-018-9533-6⟩. ⟨hal-01953985⟩
44 View
0 Download

Altmetric

Share

More