A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks. Hendrycks, D. & Gimpel, K.
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks [link]Paper  abstract   bibtex   
We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater maximum softmax probabilities than erroneously classified and out-of-distribution examples, allowing for their detection. We assess performance by defining several tasks in computer vision, natural language processing, and automatic speech recognition, showing the effectiveness of this baseline across all. We then show the baseline can sometimes be surpassed, demonstrating the room for future research on these underexplored detection tasks.
@article{hendrycksBaselineDetectingMisclassified2016,
  archivePrefix = {arXiv},
  eprinttype = {arxiv},
  eprint = {1610.02136},
  primaryClass = {cs},
  title = {A {{Baseline}} for {{Detecting Misclassified}} and {{Out}}-of-{{Distribution Examples}} in {{Neural Networks}}},
  url = {http://arxiv.org/abs/1610.02136},
  abstract = {We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater maximum softmax probabilities than erroneously classified and out-of-distribution examples, allowing for their detection. We assess performance by defining several tasks in computer vision, natural language processing, and automatic speech recognition, showing the effectiveness of this baseline across all. We then show the baseline can sometimes be surpassed, demonstrating the room for future research on these underexplored detection tasks.},
  urldate = {2019-01-30},
  date = {2016-10-07},
  keywords = {Computer Science - Computer Vision and Pattern Recognition,Computer Science - Machine Learning,Computer Science - Neural and Evolutionary Computing},
  author = {Hendrycks, Dan and Gimpel, Kevin},
  file = {/home/dimitri/Nextcloud/Zotero/storage/KDTHENRP/Hendrycks and Gimpel - 2016 - A Baseline for Detecting Misclassified and Out-of-.pdf;/home/dimitri/Nextcloud/Zotero/storage/JRETA5IS/1610.html}
}
Downloads: 0