We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Probability

Title: Langevin dynamics for the probability of Markov jumping processes

Authors: Wuchen Li
Abstract: We study gradient drift-diffusion processes on a probability simplex set with finite state Wasserstein metrics, namely the Wasserstein common noise. A fact is that the Kolmogorov transition equation of finite reversible Markov jump processes forms the gradient flow of entropy in finite state Wasserstein space. This paper proposes to perturb finite state Markov jump processes with Wasserstein common noises and formulate stochastic reversible Markov jumping processes. We also define a Wasserstein Q-matrix for this stochastic Markov jumping process. We then derive the functional Fokker-Planck equation in probability simplex, whose stationary distribution is a Gibbs distribution of entropy functional in a simplex set. Finally, we present several examples of Wasserstein drift-diffusion processes on a two-point state space.
Comments: Correct some typos
Subjects: Probability (math.PR); Optimization and Control (math.OC)
Cite as: arXiv:2307.00678 [math.PR]
  (or arXiv:2307.00678v2 [math.PR] for this version)

Submission history

From: Wuchen Li [view email]
[v1] Sun, 2 Jul 2023 22:40:36 GMT (1233kb,D)
[v2] Mon, 17 Jul 2023 18:27:58 GMT (1230kb,D)

Link back to: arXiv, form interface, contact.