Mixing Time Estimation in Reversible Markov Chains from a Single Sample Path. Hsu, D., Kontorovich, A., Levin, D. A., Peres, Y., Szepesvári, C., & Wolfer, G. Annals of Applied Probability, 29(4):2439–2480, 07, 2019.
Mixing Time Estimation in Reversible Markov Chains from a Single Sample Path [pdf]Paper  abstract   bibtex   4 downloads  
The spectral gap of a finite, ergodic, and reversible Markov chain is an important parameter measuring the asymptotic rate of convergence. In applications, the transition matrix P may be unknown, yet one sample of the chain up to a fixed time n may be observed. We consider here the problem of estimating the spectral gap from this data and give a fully empirical interval estimate, whose width is essentially unimprovable (shortened abstract).

Downloads: 4