Distributional Smoothing by Virtual Adversarial Examples. Miyato, T., Maeda, S., Koyama, M., Nakae, K., & Ishii, S. arXiv.org, stat.ML, 2015.
abstract   bibtex   
We propose a novel regularization technique for supervised and semi-supervised training of large models like deep neural network. By including into objective function the local smoothness of predictive distribution around each training data point, not only were we able to extend the Adversarial training to the setting of semi-supervised training, we were also able to eclipse current state of the art supervised and semi-supervised methods on the permutation invariant MNIST classification task.
@Article{Miyato2015a,
author = {Miyato, Takeru and Maeda, Shin-ichi and Koyama, Masanori and Nakae, Ken and Ishii, Shin}, 
title = {Distributional Smoothing by Virtual Adversarial Examples}, 
journal = {arXiv.org}, 
volume = {stat.ML}, 
number = {}, 
pages = {}, 
year = {2015}, 
abstract = {We propose a novel regularization technique for supervised and semi-supervised training of large models like deep neural network. By including into objective function the local smoothness of predictive distribution around each training data point, not only were we able to extend the Adversarial training to the setting of semi-supervised training, we were also able to eclipse current state of the art supervised and semi-supervised methods on the permutation invariant MNIST classification task.}, 
location = {}, 
keywords = {}}

Downloads: 0