Harmonic Networks with Limited Training Samples

Harmonic Networks with Limited Training Samples. Ulicny, M., Krylov, V. A., & Dahyot, R. In 2019 27th European Signal Processing Conference (EUSIPCO), pages 1-5, Sep., 2019. Github: https://github.com/matej-ulicny/harmonic-networks and paper also on arxiv http://arxiv.org/abs/1905.00135

Paper doi abstract bibtex

Convolutional neural networks (CNNs) are very popular nowadays for image processing. CNNs allow one to learn optimal filters in a (mostly) supervised machine learning context. However this typically requires abundant labelled training data to estimate the filter parameters. Alternative strategies have been deployed for reducing the number of parameters and / or filters to be learned and thus decrease overfitting. In the context of reverting to preset filters, we propose here a computationally efficient harmonic block that uses Discrete Cosine Transform (DCT) filters in CNNs. In this work we examine the performance of harmonic networks in limited training data scenario. We validate experimentally that its performance compares well against scattering networks that use wavelets as preset filters.

@INPROCEEDINGS{8902831, 
author= {M. {Ulicny} and V. A. {Krylov} and R. {Dahyot}}, 
booktitle= {2019 27th European Signal Processing Conference (EUSIPCO)},
url={https://www.eurasip.org/Proceedings/Eusipco/eusipco2019/Proceedings/papers/1570533913.pdf},
title= {Harmonic Networks with Limited Training Samples}, 
year= {2019}, 
volume= {}, 
number= {}, 
pages= {1-5}, 
abstract={Convolutional neural networks (CNNs) are very popular nowadays for image processing. CNNs allow one to learn optimal filters in a (mostly) supervised machine learning context. However this typically requires abundant labelled training data to estimate the filter parameters. Alternative strategies have been deployed for reducing the number of parameters and / or filters to be learned and thus decrease overfitting. In the context of reverting to preset filters, we propose here a computationally efficient harmonic block that uses Discrete Cosine Transform (DCT) filters in CNNs. In this work we examine the performance of harmonic networks in limited training data scenario. We validate experimentally that its performance compares well against scattering networks that use wavelets as preset filters.},
keywords= {Lapped Discrete Cosine Transform;harmonic network;convolutional filter;limited data}, 
doi= {10.23919/EUSIPCO.2019.8902831},
note={Github: https://github.com/matej-ulicny/harmonic-networks and paper also on arxiv http://arxiv.org/abs/1905.00135},
archivePrefix = {arXiv},
eprint    = {1905.00135},
ISSN= {2219-5491}, month= {Sep.}}

Downloads: 0