Discrete Time Markov chains competing over resources: product form steady-state distribution - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2008

Discrete Time Markov chains competing over resources: product form steady-state distribution

Abstract

We consider discrete time Markov chains in competition over a set of resources. We build a multidimensional Markov process based on the Cartesian product of the states space and on competition rules between the chains. When a resource is owned by a chain it affects the transition probabilities of the other components of the process. We prove that under some competition rules the steady-state distribution of the chain has a product form. This work extends Boucherie's theory based on continuous-time chains. The effects of the competition are slightly different from the restricted transitions studied by Boucherie. The proof is much more general and relies on algebraic properties of the generalized tensor product defined by Plateau and Stewart.
No file

Dates and versions

hal-00953623 , version 1 (28-02-2014)

Identifiers

Cite

Jean-Michel Fourneau. Discrete Time Markov chains competing over resources: product form steady-state distribution. Fith International Conference on the Quantitative Evaluation of Systems (QEST 2008), 2008, St. Malo, France. ⟨10.1109/QEST.2008.31⟩. ⟨hal-00953623⟩
113 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More