Discovering Thematic Objects in Image Collections and Videos. Yuan, J., Zhao, G., Fu, Y., Li, Z., Katsaggelos, A. K., Wu, Y., Junsong Yuan, Gangqiang Zhao, Yun Fu, Zhu Li, Katsaggelos, A. K., & Ying Wu IEEE Transactions on Image Processing, 21(4):2207–2219, apr, 2012.
Discovering Thematic Objects in Image Collections and Videos [link]Paper  doi  abstract   bibtex   
Given a collection of images or a short video sequence, we define a thematic object as the key object that frequently appears and is the representative of the visual contents. Successful discovery of the thematic object is helpful for object search and tagging, video summarization and understanding, etc. However, this task is challenging because 1) there lacks a priori knowledge of the thematic objects, such as their shapes, scales, locations, and times of re-occurrences, and 2) the thematic object of interest can be under severe variations in appearances due to viewpoint and lighting condition changes, scale variations, etc. Instead of using a top-down generative model to discover thematic visual patterns, we propose a novel bottom-up approach to gradually prune uncommon local visual primitives and recover the thematic objects. A multilayer candidate pruning procedure is designed to accelerate the image data mining process. Our solution can efficiently locate thematic objects of various sizes and can tolerate large appearance variations of the same thematic object. Experiments on challenging image and video data sets and comparisons with existing methods validate the effectiveness of our method. © 2011 IEEE.
@article{Yuan2012,
abstract = {Given a collection of images or a short video sequence, we define a thematic object as the key object that frequently appears and is the representative of the visual contents. Successful discovery of the thematic object is helpful for object search and tagging, video summarization and understanding, etc. However, this task is challenging because 1) there lacks a priori knowledge of the thematic objects, such as their shapes, scales, locations, and times of re-occurrences, and 2) the thematic object of interest can be under severe variations in appearances due to viewpoint and lighting condition changes, scale variations, etc. Instead of using a top-down generative model to discover thematic visual patterns, we propose a novel bottom-up approach to gradually prune uncommon local visual primitives and recover the thematic objects. A multilayer candidate pruning procedure is designed to accelerate the image data mining process. Our solution can efficiently locate thematic objects of various sizes and can tolerate large appearance variations of the same thematic object. Experiments on challenging image and video data sets and comparisons with existing methods validate the effectiveness of our method. {\textcopyright} 2011 IEEE.},
author = {Yuan, Junsong and Zhao, Gangqiang and Fu, Yun and Li, Zhu and Katsaggelos, Aggelos K. and Wu, Ying and {Junsong Yuan} and {Gangqiang Zhao} and {Yun Fu} and {Zhu Li} and Katsaggelos, Aggelos K. and {Ying Wu}},
doi = {10.1109/TIP.2011.2181952},
issn = {1057-7149},
journal = {IEEE Transactions on Image Processing},
keywords = {Image data mining,thematic object discovery},
month = {apr},
number = {4},
pages = {2207--2219},
pmid = {22207639},
title = {{Discovering Thematic Objects in Image Collections and Videos}},
url = {http://ieeexplore.ieee.org/document/6112717/},
volume = {21},
year = {2012}
}

Downloads: 0