We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Monte Carlo sampling with integrator snippets

Abstract: Assume interest is in sampling from a probability distribution $\mu$ defined on $(\mathsf{Z},\mathscr{Z})$. We develop a framework to construct sampling algorithms taking full advantage of numerical integrators of ODEs, say $\psi\colon\mathsf{Z}\rightarrow\mathsf{Z}$ for one integration step, to explore $\mu$ efficiently and robustly. The popular Hybrid/Hamiltonian Monte Carlo (HMC) algorithm [Duane, 1987], [Neal, 2011] and its derivatives are example of such a use of numerical integrators. However we show how the potential of integrators can be exploited beyond current ideas and HMC sampling in order to take into account aspects of the geometry of the target distribution. A key idea is the notion of integrator snippet, a fragment of the orbit of an ODE numerical integrator $\psi$, and its associate probability distribution $\bar{\mu}$, which takes the form of a mixture of distributions derived from $\mu$ and $\psi$. Exploiting properties of mixtures we show how samples from $\bar{\mu}$ can be used to estimate expectations with respect to $\mu$. We focus here primarily on Sequential Monte Carlo (SMC) algorithms, but the approach can be used in the context of Markov chain Monte Carlo algorithms as discussed at the end of the manuscript. We illustrate performance of these new algorithms through numerical experimentation and provide preliminary theoretical results supporting observed performance.
Subjects: Computation (stat.CO); Methodology (stat.ME)
MSC classes: 65C05, 65C35
ACM classes: I.6.8; G.3
Cite as: arXiv:2404.13302 [stat.CO]
  (or arXiv:2404.13302v1 [stat.CO] for this version)

Submission history

From: Christophe Andrieu [view email]
[v1] Sat, 20 Apr 2024 07:16:46 GMT (1220kb,D)

Link back to: arXiv, form interface, contact.