A Closer Look at MOMDPs - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2010

A Closer Look at MOMDPs

Mauricio Araya-López
  • Function : Author
  • PersonId : 881106
Vincent Thomas
Olivier Buffet

Abstract

The difficulties encountered in sequential decision-making problems under uncertainty are often linked to the large size of the state space. Exploiting the structure of the problem, for example by employing a factored representation, is usually an efficient approach but, in the case of partially observable Markov decision processes, the fact that some state variables may be visible has not been sufficiently appreciated. In this article, we present a complementary analysis and discussion about MOMDPs, a formalism that exploits the fact that the state space may be factored in one visible part and one hidden part. Starting from a POMDP description, we dig into the structure of the belief update, value function, and the consequences in value iteration, specifically how classical algorithms can be adapted to this factorization, and demonstrate the resulting benefits through an empirical evaluation.
Fichier principal
Vignette du fichier
ictai10.pdf (312.63 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00535559 , version 1 (11-11-2010)

Identifiers

  • HAL Id : inria-00535559 , version 1

Cite

Mauricio Araya-López, Vincent Thomas, Olivier Buffet, François Charpillet. A Closer Look at MOMDPs. 22nd International Conference on Tools with Artificial Intelligence - ICTAI 2010, Oct 2010, Arras, France. ⟨inria-00535559⟩
252 View
1441 Download

Share

Gmail Facebook X LinkedIn More