Gradient Scan Gibbs Sampler: An Efficient Algorithm for High-Dimensional Gaussian Distributions. Féron, O., Orieux, F., & Giovannelli, J. IEEE Journal of Selected Topics in Signal Processing, 10(2):343–352, March, 2016. pdf: https://hal-supelec.archives-ouvertes.fr/hal-01252598/file/gsgs-paper.pdf
Gradient Scan Gibbs Sampler: An Efficient Algorithm for High-Dimensional Gaussian Distributions [link]Paper  doi  abstract   bibtex   
This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e., the drawn samples are asymptotically distributed according to the target distribution. Our main motivation is in inverse problems related to general linear observation models and their solution in a hierarchical Bayesian framework implemented through sampling algorithms. It finds direct applications in semi-blind/unsupervised methods as well as in some non-Gaussian methods. The paper provides an illustration focused on the unsupervised estimation for super-resolution methods.
@article{feron_gradient_2016,
	title = {Gradient {Scan} {Gibbs} {Sampler}: {An} {Efficient} {Algorithm} for {High}-{Dimensional} {Gaussian} {Distributions}},
	volume = {10},
	copyright = {All rights reserved},
	issn = {1932-4553},
	url = {https://hal-supelec.archives-ouvertes.fr/hal-01252598},
	doi = {10.1109/JSTSP.2015.2510961},
	abstract = {This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e., the drawn samples are asymptotically distributed according to the target distribution. Our main motivation is in inverse problems related to general linear observation models and their solution in a hierarchical Bayesian framework implemented through sampling algorithms. It finds direct applications in semi-blind/unsupervised methods as well as in some non-Gaussian methods. The paper provides an illustration focused on the unsupervised estimation for super-resolution methods.},
	number = {2},
	journal = {IEEE Journal of Selected Topics in Signal Processing},
	author = {Féron, Olivier and Orieux, François and Giovannelli, Jean-François},
	month = mar,
	year = {2016},
	note = {pdf: https://hal-supelec.archives-ouvertes.fr/hal-01252598/file/gsgs-paper.pdf},
	keywords = {Bayesian, Gaussian, Inverse problems, MCMC, Markov processes, Non-Gaussian, Optimization, Sampling, Signal-Resolution, Super-Resolution, Unsupervised, \_orieux\_publis, general linear observation models},
	pages = {343--352},
}

Downloads: 0