Litcius/Paper detail

Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions: Continuous dynamics

Oren Mangoubi, Aaron Smith

2021The Annals of Applied Probability11 citationsDOI

Abstract

We obtain several quantitative bounds on the mixing properties of an “ideal” Hamiltonian Monte Carlo (HMC) Markov chain for a strongly log-concave target distribution π on Rd. Our main result says that the HMC Markov chain generates a sample with Wasserstein error ϵ in roughly O(κ2log(1ϵ)) steps, where the condition number κ=M2 m2 is the ratio of the maximum M2 and minimum m2 eigenvalues of the Hessian of −log(π). In particular, this mixing bound does not depend explicitly on the dimension d. These results significantly extend and improve previous quantitative bounds on the mixing of ideal HMC, and can be used to analyze more realistic HMC algorithms. The main ingredient of our argument is a proof that initially “parallel” Hamiltonian trajectories contract over much longer steps than would be predicted by previous heuristics based on the Jacobi manifold.

Topics & Concepts

MathematicsHessian matrixMarkov chainMarkov chain Monte CarloMixing (physics)Monte Carlo methodHamiltonian (control theory)Applied mathematicsStatistical physicsUpper and lower boundsCombinatoricsEigenvalues and eigenvectorsMathematical analysisMathematical optimizationStatisticsQuantum mechanicsPhysicsMarkov Chains and Monte Carlo MethodsStatistical Methods and InferenceStochastic processes and statistical mechanics