States Reduction on Markov Processes - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Master Thesis Year : 2016

States Reduction on Markov Processes

Alexis Papic
  • Function : Author
  • PersonId : 989289


A Markov process is a stochastic process that satisfies the Markov property, in which the future is independent of the past given the present. We first consider a Markov process over the real line with values on a finite set, where the law is defined by exponentially distributed jumps and a transition measure according to which the location of the process at the jump time is chosen; or indistinctly by the generator matrix. We also study Piecewise deterministic Markov processes, a more complex process that consists on two sub-processes: one on a continuous-space and the other on a discrete-space, and together are a Markov process involving a deterministic motion punctuated by random jumps. In the case when there are multiple weakly irreducible classes and the generator matrix can be rewritten as a double scales generator for a small parameter ε, we present a method to approximate the process to a two-scales process: a slow-process on a reduced state space and fast-process inside each new class, and we prove an approximation error of the laws of order ε. We present simulation examples and an application to the sodium channel in the Hodgkin and Huxley model, where we separate the voltage-gates of type h and m into two different time scales.
Fichier principal
Vignette du fichier
Alexis_Papic_stage_2016.pdf (560.07 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01369707 , version 1 (21-09-2016)


  • HAL Id : hal-01369707 , version 1


Alexis Papic. States Reduction on Markov Processes. Probability [math.PR]. 2016. ⟨hal-01369707⟩
193 View
114 Download


Gmail Facebook Twitter LinkedIn More