States Reduction on Markov Processes - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Mémoires D'étudiants -- Hal-Inria+ Année : 2016

States Reduction on Markov Processes

Alexis Papic
  • Fonction : Auteur
  • PersonId : 989289

Résumé

A Markov process is a stochastic process that satisfies the Markov property, in which the future is independent of the past given the present. We first consider a Markov process over the real line with values on a finite set, where the law is defined by exponentially distributed jumps and a transition measure according to which the location of the process at the jump time is chosen; or indistinctly by the generator matrix. We also study Piecewise deterministic Markov processes, a more complex process that consists on two sub-processes: one on a continuous-space and the other on a discrete-space, and together are a Markov process involving a deterministic motion punctuated by random jumps. In the case when there are multiple weakly irreducible classes and the generator matrix can be rewritten as a double scales generator for a small parameter ε, we present a method to approximate the process to a two-scales process: a slow-process on a reduced state space and fast-process inside each new class, and we prove an approximation error of the laws of order ε. We present simulation examples and an application to the sodium channel in the Hodgkin and Huxley model, where we separate the voltage-gates of type h and m into two different time scales.
Fichier principal
Vignette du fichier
Alexis_Papic_stage_2016.pdf (560.07 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01369707 , version 1 (21-09-2016)

Identifiants

  • HAL Id : hal-01369707 , version 1

Citer

Alexis Papic. States Reduction on Markov Processes. Probability [math.PR]. 2016. ⟨hal-01369707⟩
199 Consultations
118 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More