Hierarchical spatiotemporal feature extraction using recurrent online clustering

Hierarchical spatiotemporal feature extraction using recurrent online clustering. Young, S. R., Davis, A., Mishtal, A., & Arel, I. Pattern Recognition Letters, 37:115–123, February, 2014.

Paper doi abstract bibtex

Deep machine learning offers a comprehensive framework for extracting meaningful features from complex observations in an unsupervised manner. The majority of deep learning architectures described in the literature primarily focus on extracting spatial features. However, in real-world settings, capturing temporal dependencies in observations is critical for accurate inference. This paper introduces an enhancement to DeSTIN – a compositional deep learning architecture in which each layer consists of multiple instantiations of a common node – that learns to represent spatiotemporal patterns in data based on a novel recurrent clustering algorithm. Contrary to mainstream deep architectures, such as deep belief networks where layer-by-layer training is assumed, each of the nodes in the proposed architecture is trained independently and in parallel. Moreover, top-down and bottom-up information flows facilitate rich feature formation. A semi-supervised setting is demonstrated achieving state-of-the-art results on the MNIST classification benchmarks. A GPU implementation is discussed further accentuating the scalability properties of the proposed framework.

@article{young_hierarchical_2014,
	series = {Partially {Supervised} {Learning} for {Pattern} {Recognition}},
	title = {Hierarchical spatiotemporal feature extraction using recurrent online clustering},
	volume = {37},
	issn = {0167-8655},
	url = {https://www.sciencedirect.com/science/article/pii/S0167865513002869},
	doi = {10.1016/j.patrec.2013.07.013},
	abstract = {Deep machine learning offers a comprehensive framework for extracting meaningful features from complex observations in an unsupervised manner. The majority of deep learning architectures described in the literature primarily focus on extracting spatial features. However, in real-world settings, capturing temporal dependencies in observations is critical for accurate inference. This paper introduces an enhancement to DeSTIN – a compositional deep learning architecture in which each layer consists of multiple instantiations of a common node – that learns to represent spatiotemporal patterns in data based on a novel recurrent clustering algorithm. Contrary to mainstream deep architectures, such as deep belief networks where layer-by-layer training is assumed, each of the nodes in the proposed architecture is trained independently and in parallel. Moreover, top-down and bottom-up information flows facilitate rich feature formation. A semi-supervised setting is demonstrated achieving state-of-the-art results on the MNIST classification benchmarks. A GPU implementation is discussed further accentuating the scalability properties of the proposed framework.},
	language = {en},
	urldate = {2021-10-01},
	journal = {Pattern Recognition Letters},
	author = {Young, S. R. and Davis, A. and Mishtal, A. and Arel, I.},
	month = feb,
	year = {2014},
	keywords = {Deep machine learning, Online clustering, Pattern recognition, Recurrent clustering, Spatiotemporal signals, Unsupervised feature extraction},
	pages = {115--123},
}

Downloads: 0

{"_id":"4LcXJYWXAJ7dyMuYr","bibbaseid":"young-davis-mishtal-arel-hierarchicalspatiotemporalfeatureextractionusingrecurrentonlineclustering-2014","downloads":0,"creationDate":"2018-10-05T11:34:46.707Z","title":"Hierarchical spatiotemporal feature extraction using recurrent online clustering","author_short":["Young, S. R.","Davis, A.","Mishtal, A.","Arel, I."],"year":2014,"bibtype":"article","biburl":"https://bibbase.org/zotero/mh_lenguyen","bibdata":{"bibtype":"article","type":"article","series":"Partially Supervised Learning for Pattern Recognition","title":"Hierarchical spatiotemporal feature extraction using recurrent online clustering","volume":"37","issn":"0167-8655","url":"https://www.sciencedirect.com/science/article/pii/S0167865513002869","doi":"10.1016/j.patrec.2013.07.013","abstract":"Deep machine learning offers a comprehensive framework for extracting meaningful features from complex observations in an unsupervised manner. The majority of deep learning architectures described in the literature primarily focus on extracting spatial features. However, in real-world settings, capturing temporal dependencies in observations is critical for accurate inference. This paper introduces an enhancement to DeSTIN – a compositional deep learning architecture in which each layer consists of multiple instantiations of a common node – that learns to represent spatiotemporal patterns in data based on a novel recurrent clustering algorithm. Contrary to mainstream deep architectures, such as deep belief networks where layer-by-layer training is assumed, each of the nodes in the proposed architecture is trained independently and in parallel. Moreover, top-down and bottom-up information flows facilitate rich feature formation. A semi-supervised setting is demonstrated achieving state-of-the-art results on the MNIST classification benchmarks. A GPU implementation is discussed further accentuating the scalability properties of the proposed framework.","language":"en","urldate":"2021-10-01","journal":"Pattern Recognition Letters","author":[{"propositions":[],"lastnames":["Young"],"firstnames":["S.","R."],"suffixes":[]},{"propositions":[],"lastnames":["Davis"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Mishtal"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Arel"],"firstnames":["I."],"suffixes":[]}],"month":"February","year":"2014","keywords":"Deep machine learning, Online clustering, Pattern recognition, Recurrent clustering, Spatiotemporal signals, Unsupervised feature extraction","pages":"115–123","bibtex":"@article{young_hierarchical_2014,\n\tseries = {Partially {Supervised} {Learning} for {Pattern} {Recognition}},\n\ttitle = {Hierarchical spatiotemporal feature extraction using recurrent online clustering},\n\tvolume = {37},\n\tissn = {0167-8655},\n\turl = {https://www.sciencedirect.com/science/article/pii/S0167865513002869},\n\tdoi = {10.1016/j.patrec.2013.07.013},\n\tabstract = {Deep machine learning offers a comprehensive framework for extracting meaningful features from complex observations in an unsupervised manner. The majority of deep learning architectures described in the literature primarily focus on extracting spatial features. However, in real-world settings, capturing temporal dependencies in observations is critical for accurate inference. This paper introduces an enhancement to DeSTIN – a compositional deep learning architecture in which each layer consists of multiple instantiations of a common node – that learns to represent spatiotemporal patterns in data based on a novel recurrent clustering algorithm. Contrary to mainstream deep architectures, such as deep belief networks where layer-by-layer training is assumed, each of the nodes in the proposed architecture is trained independently and in parallel. Moreover, top-down and bottom-up information flows facilitate rich feature formation. A semi-supervised setting is demonstrated achieving state-of-the-art results on the MNIST classification benchmarks. A GPU implementation is discussed further accentuating the scalability properties of the proposed framework.},\n\tlanguage = {en},\n\turldate = {2021-10-01},\n\tjournal = {Pattern Recognition Letters},\n\tauthor = {Young, S. R. and Davis, A. and Mishtal, A. and Arel, I.},\n\tmonth = feb,\n\tyear = {2014},\n\tkeywords = {Deep machine learning, Online clustering, Pattern recognition, Recurrent clustering, Spatiotemporal signals, Unsupervised feature extraction},\n\tpages = {115--123},\n}\n\n\n\n","author_short":["Young, S. R.","Davis, A.","Mishtal, A.","Arel, I."],"key":"young_hierarchical_2014","id":"young_hierarchical_2014","bibbaseid":"young-davis-mishtal-arel-hierarchicalspatiotemporalfeatureextractionusingrecurrentonlineclustering-2014","role":"author","urls":{"Paper":"https://www.sciencedirect.com/science/article/pii/S0167865513002869"},"keyword":["Deep machine learning","Online clustering","Pattern recognition","Recurrent clustering","Spatiotemporal signals","Unsupervised feature extraction"],"metadata":{"authorlinks":{}},"downloads":0,"html":""},"search_terms":["hierarchical","spatiotemporal","feature","extraction","using","recurrent","online","clustering","young","davis","mishtal","arel"],"keywords":["deep machine learning","online clustering","pattern recognition","recurrent clustering","spatiotemporal signals","unsupervised feature extraction"],"authorIDs":[],"dataSources":["EmYaiv9TCHbg7caTW","iwKepCrWBps7ojhDx"]}