Visualization of feature evolution during convolutional neural network training. Punjabi, A. & Katsaggelos, A. K. In 2017 25th European Signal Processing Conference (EUSIPCO), pages 311-315, Aug, 2017.
Visualization of feature evolution during convolutional neural network training [pdf]Paper  doi  abstract   bibtex   
Convolutional neural networks (CNNs) are a staple in the fields of computer vision and image processing. These networks perform visual tasks with state-of-the-art accuracy; yet, the understanding behind the success of these algorithms is still lacking. In particular, the process by which CNNs learn effective task-specific features is still unclear. This work elucidates such phenomena by applying recent deep visualization techniques during different stages of the training process. Additionally, this investigation provides visual justification to the benefits of transfer learning. The results are in line with previously discussed notions of feature specificity, and show a new facet of a particularly vexing machine learning pitfall: overfitting.

Downloads: 0