The Expected Performance Curve: a New Assessment Measure for Person Authentication. Bengio, S. & Mari�thoz, J. In Proceedings of Odyssey 2004: The Speaker and Language Recognition Workshop, 2004.
The Expected Performance Curve: a New Assessment Measure for Person Authentication [link]Paper  abstract   bibtex   
ROC and DET curves are often used in the field of person authentication to assess the quality of a model or even to compare several models. We argue in this paper that this measure can be misleading as it compares performance measures that cannot be reached simultaneously by all systems. We propose instead new curves, called Expected Performance Curves (EPC). These curves enable the comparison between several systems according to a criterion, decided by the application, which is used to set thresholds according to a separate validation set. A free sofware is available to compute these curves. A real case study is used throughout the paper to illustrate it. Finally, note that while this study was done on an authentication problem, it also applies to most 2-class classification tasks.
@inproceedings{bengio:2004:odyssey,
  author = {S. Bengio and J. Mari�thoz},
  title = {The Expected Performance Curve: a New Assessment Measure for Person Authentication},
  booktitle = {Proceedings of Odyssey 2004: The Speaker and Language Recognition Workshop},
  year = 2004,
  page = {279--284},
  url = {publications/ps/bengio_2004_odyssey.ps.gz},
  pdf = {publications/pdf/bengio_2004_odyssey.pdf},
  djvu = {publications/djvu/bengio_2004_odyssey.djvu},
  original = {2004/epc_odyssey},
  idiap = {publications/pdf/rr03-84.pdf},
  topics = {biometric_authentication},
  web = {http://www.isca-speech.org/archive/odyssey_04/ody4_279.html},
  abstract = {ROC and DET curves are often used in the field of person authentication to assess the quality of a model or even to compare several models. We argue in this paper that this measure can be misleading as it compares performance measures that cannot be reached simultaneously by all systems. We propose instead new curves, called Expected Performance Curves (EPC). These curves enable the comparison between several systems according to a criterion, decided by the application, which is used to set thresholds according to a separate validation set. A free sofware is available to compute these curves. A real case study is used throughout the paper to illustrate it. Finally, note that while this study was done on an authentication problem, it also applies to most 2-class classification tasks.},
  categorie = {C},
}

Downloads: 0