Differentiable Pooling for Hierarchical Feature Learning. Zeiler, M. D. & Fergus, R. June, 2012. arXiv:1207.0151 [cs]
Differentiable Pooling for Hierarchical Feature Learning [link]Paper  doi  abstract   bibtex   
We introduce a parametric form of pooling, based on a Gaussian, which can be optimized alongside the features in a single global objective function. By contrast, existing pooling schemes are based on heuristics (e.g. local maximum) and have no clear link to the cost function of the model. Furthermore, the variables of the Gaussian explicitly store location information, distinct from the appearance captured by the features, thus providing a what/where decomposition of the input signal. Although the differentiable pooling scheme can be incorporated in a wide range of hierarchical models, we demonstrate it in the context of a Deconvolutional Network model (Zeiler et al. ICCV 2011). We also explore a number of secondary issues within this model and present detailed experiments on MNIST digits.
@misc{zeiler_differentiable_2012,
	title = {Differentiable {Pooling} for {Hierarchical} {Feature} {Learning}},
	url = {http://arxiv.org/abs/1207.0151},
	doi = {10.48550/arXiv.1207.0151},
	abstract = {We introduce a parametric form of pooling, based on a Gaussian, which can be optimized alongside the features in a single global objective function. By contrast, existing pooling schemes are based on heuristics (e.g. local maximum) and have no clear link to the cost function of the model. Furthermore, the variables of the Gaussian explicitly store location information, distinct from the appearance captured by the features, thus providing a what/where decomposition of the input signal. Although the differentiable pooling scheme can be incorporated in a wide range of hierarchical models, we demonstrate it in the context of a Deconvolutional Network model (Zeiler et al. ICCV 2011). We also explore a number of secondary issues within this model and present detailed experiments on MNIST digits.},
	language = {en},
	urldate = {2023-07-30},
	publisher = {arXiv},
	author = {Zeiler, Matthew D. and Fergus, Rob},
	month = jun,
	year = {2012},
	note = {arXiv:1207.0151 [cs]},
	keywords = {\#CNN, /unread, Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning},
}

Downloads: 0