Variational Bayesian Methods For Multimedia Problems

Variational Bayesian Methods For Multimedia Problems. Chen, Z., Babacan, S. D., Molina, R., & Katsaggelos, A. K. IEEE Transactions on Multimedia, 16(4):1000–1017, IEEE, jun, 2014.

Paper doi abstract bibtex

In this paper we present an introduction to Variational Bayesian (VB) methods in the context of probabilistic graphical models, and discuss their application in multimedia related problems. VB is a family of deterministic probability distribution approximation procedures that offer distinct advantages over alternative approaches based on stochastic sampling and those providing only point estimates. VB inference is flexible to be applied in different practical problems, yet is broad enough to subsume as its special cases several alternative inference approaches including Maximum A Posteriori (MAP) and the Expectation-Maximization (EM) algorithm. In this paper we also show the connections between VB and other posterior approximation methods such as the marginalization-based Loopy Belief Propagation (LBP) and the Expectation Propagation (EP) algorithms. Specifically, both VB and EP are variational methods that minimize functionals based on the Kullback-Leibler (KL) divergence. LBP, traditionally developed using graphical models, can also be viewed as a VB inference procedure. We present several multimedia related applications illustrating the use and effectiveness of the VB algorithms discussed herein. We hope that by reading this tutorial the readers will obtain a general understanding of Bayesian methods and establish connections among popular algorithms used in practice. © 1999-2012 IEEE.

@article{chen2014variational,
abstract = {In this paper we present an introduction to Variational Bayesian (VB) methods in the context of probabilistic graphical models, and discuss their application in multimedia related problems. VB is a family of deterministic probability distribution approximation procedures that offer distinct advantages over alternative approaches based on stochastic sampling and those providing only point estimates. VB inference is flexible to be applied in different practical problems, yet is broad enough to subsume as its special cases several alternative inference approaches including Maximum A Posteriori (MAP) and the Expectation-Maximization (EM) algorithm. In this paper we also show the connections between VB and other posterior approximation methods such as the marginalization-based Loopy Belief Propagation (LBP) and the Expectation Propagation (EP) algorithms. Specifically, both VB and EP are variational methods that minimize functionals based on the Kullback-Leibler (KL) divergence. LBP, traditionally developed using graphical models, can also be viewed as a VB inference procedure. We present several multimedia related applications illustrating the use and effectiveness of the VB algorithms discussed herein. We hope that by reading this tutorial the readers will obtain a general understanding of Bayesian methods and establish connections among popular algorithms used in practice. {\textcopyright} 1999-2012 IEEE.},
author = {Chen, Zhaofu and Babacan, S. Derin and Molina, Rafael and Katsaggelos, Aggelos K.},
doi = {10.1109/TMM.2014.2307692},
issn = {1520-9210},
journal = {IEEE Transactions on Multimedia},
keywords = {Bayes methods,graphical models,inverse problems,multimedia signal processing,variational Bayes},
month = {jun},
number = {4},
pages = {1000--1017},
publisher = {IEEE},
title = {{Variational Bayesian Methods For Multimedia Problems}},
url = {http://ieeexplore.ieee.org/document/6747301/},
volume = {16},
year = {2014}
}

Downloads: 0

{"_id":"Q5qsyLpzuaZpfsCQs","bibbaseid":"chen-babacan-molina-katsaggelos-variationalbayesianmethodsformultimediaproblems-2014","author_short":["Chen, Z.","Babacan, S. D.","Molina, R.","Katsaggelos, A. K."],"bibdata":{"bibtype":"article","type":"article","abstract":"In this paper we present an introduction to Variational Bayesian (VB) methods in the context of probabilistic graphical models, and discuss their application in multimedia related problems. VB is a family of deterministic probability distribution approximation procedures that offer distinct advantages over alternative approaches based on stochastic sampling and those providing only point estimates. VB inference is flexible to be applied in different practical problems, yet is broad enough to subsume as its special cases several alternative inference approaches including Maximum A Posteriori (MAP) and the Expectation-Maximization (EM) algorithm. In this paper we also show the connections between VB and other posterior approximation methods such as the marginalization-based Loopy Belief Propagation (LBP) and the Expectation Propagation (EP) algorithms. Specifically, both VB and EP are variational methods that minimize functionals based on the Kullback-Leibler (KL) divergence. LBP, traditionally developed using graphical models, can also be viewed as a VB inference procedure. We present several multimedia related applications illustrating the use and effectiveness of the VB algorithms discussed herein. We hope that by reading this tutorial the readers will obtain a general understanding of Bayesian methods and establish connections among popular algorithms used in practice. © 1999-2012 IEEE.","author":[{"propositions":[],"lastnames":["Chen"],"firstnames":["Zhaofu"],"suffixes":[]},{"propositions":[],"lastnames":["Babacan"],"firstnames":["S.","Derin"],"suffixes":[]},{"propositions":[],"lastnames":["Molina"],"firstnames":["Rafael"],"suffixes":[]},{"propositions":[],"lastnames":["Katsaggelos"],"firstnames":["Aggelos","K."],"suffixes":[]}],"doi":"10.1109/TMM.2014.2307692","issn":"1520-9210","journal":"IEEE Transactions on Multimedia","keywords":"Bayes methods,graphical models,inverse problems,multimedia signal processing,variational Bayes","month":"jun","number":"4","pages":"1000–1017","publisher":"IEEE","title":"Variational Bayesian Methods For Multimedia Problems","url":"http://ieeexplore.ieee.org/document/6747301/","volume":"16","year":"2014","bibtex":"@article{chen2014variational,\nabstract = {In this paper we present an introduction to Variational Bayesian (VB) methods in the context of probabilistic graphical models, and discuss their application in multimedia related problems. VB is a family of deterministic probability distribution approximation procedures that offer distinct advantages over alternative approaches based on stochastic sampling and those providing only point estimates. VB inference is flexible to be applied in different practical problems, yet is broad enough to subsume as its special cases several alternative inference approaches including Maximum A Posteriori (MAP) and the Expectation-Maximization (EM) algorithm. In this paper we also show the connections between VB and other posterior approximation methods such as the marginalization-based Loopy Belief Propagation (LBP) and the Expectation Propagation (EP) algorithms. Specifically, both VB and EP are variational methods that minimize functionals based on the Kullback-Leibler (KL) divergence. LBP, traditionally developed using graphical models, can also be viewed as a VB inference procedure. We present several multimedia related applications illustrating the use and effectiveness of the VB algorithms discussed herein. We hope that by reading this tutorial the readers will obtain a general understanding of Bayesian methods and establish connections among popular algorithms used in practice. {\\textcopyright} 1999-2012 IEEE.},\nauthor = {Chen, Zhaofu and Babacan, S. Derin and Molina, Rafael and Katsaggelos, Aggelos K.},\ndoi = {10.1109/TMM.2014.2307692},\nissn = {1520-9210},\njournal = {IEEE Transactions on Multimedia},\nkeywords = {Bayes methods,graphical models,inverse problems,multimedia signal processing,variational Bayes},\nmonth = {jun},\nnumber = {4},\npages = {1000--1017},\npublisher = {IEEE},\ntitle = {{Variational Bayesian Methods For Multimedia Problems}},\nurl = {http://ieeexplore.ieee.org/document/6747301/},\nvolume = {16},\nyear = {2014}\n}\n","author_short":["Chen, Z.","Babacan, S. D.","Molina, R.","Katsaggelos, A. K."],"key":"chen2014variational","id":"chen2014variational","bibbaseid":"chen-babacan-molina-katsaggelos-variationalbayesianmethodsformultimediaproblems-2014","role":"author","urls":{"Paper":"http://ieeexplore.ieee.org/document/6747301/"},"keyword":["Bayes methods","graphical models","inverse problems","multimedia signal processing","variational Bayes"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://sites.northwestern.edu/ivpl/files/2023/06/IVPL_Updated_publications-1.bib","dataSources":["KTWAakbPXLGfYseXn","ePKPjG8C6yvpk4mEK","37Qfzv6wRptYkoSCL","zFPgsTDAW8aDnb5iN","E6Bth2QB5BYjBMZE7","nbnEjsN7MJhurAK9x","PNQZj6FjzoxxJk4Yi","7FpDWDGJ4KgpDiGfB","bod9ms4MQJHuJgPpp","QR9t5P2cLdJuzhfzK","D8k2SxfC5dKNRFgro","7Dwzbxq93HWrJEhT6","qhF8zxmGcJfvtdeAg","fvDEHD49E2ZRwE3fb","H7crv8NWhZup4d4by","DHqokWsryttGh7pJE","vRJd4wNg9HpoZSMHD","sYxQ6pxFgA59JRhxi","w2WahSbYrbcCKBDsC","XasdXLL99y5rygCmq","3gkSihZQRfAD2KBo3","t5XMbyZbtPBo4wBGS","bEpHM2CtrwW2qE8FP","teJzFLHexaz5AQW5z"],"keywords":["bayes methods","graphical models","inverse problems","multimedia signal processing","variational bayes"],"search_terms":["variational","bayesian","methods","multimedia","problems","chen","babacan","molina","katsaggelos"],"title":"Variational Bayesian Methods For Multimedia Problems","year":2014}