A Decision-Theoretic Scheduling of Resource-Bounded Agents in Dynamic Environments - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2005

A Decision-Theoretic Scheduling of Resource-Bounded Agents in Dynamic Environments

Résumé

Markov Decision processes have been widely used to control the execution of a static set of tasks with limited resources. But little attention has been paid to adapt these techniques to cope with changes in the environment. This is a problem of the dynamic optimisation of resource allocation to a changing set of tasks. We transform this problem into a dynamic composition of local policies (each of which controls a task) to approximate the optimal control policy. Our main claim in this paper is that it is possible to dynamically compute good decisions without completely calculating the optimal policy. We develop an approach which provides more flexibility for MDPs to deal with dynamic environments. This approach is made up of two steps. The first step consists of an off-line pre-processing of tasks and the compilation of policies for all possible available resources. The second step concerns a quick on-line approximation of the policy of executing the current task taking into account the current state of the queue. We present a preliminary analysis of the performance of our approach.
Fichier principal
Vignette du fichier
icaps05.pdf (99.3 Ko) Télécharger le fichier
Loading...

Dates et versions

inria-00000414 , version 1 (10-10-2005)

Identifiants

  • HAL Id : inria-00000414 , version 1

Citer

Simon Le Gloannec, Abdel-Illah Mouaddib, François Charpillet. A Decision-Theoretic Scheduling of Resource-Bounded Agents in Dynamic Environments. International Conference on Automated Planning and Scheduling - ICAPS 2005, Jul 2005, Monterey, California/USA, United States. ⟨inria-00000414⟩
147 Consultations
93 Téléchargements

Partager

Gmail Facebook X LinkedIn More