Multi-class ROC Analysis. Wandishin, M., S. & Mullen, S., J. Technical Report The University Of Arizona.
Multi-class ROC Analysis [pdf]Paper  abstract   bibtex   
Receiver Operating Characteristic (ROC) curves have become a common analysis tool for evaluating forecast discrimination: the ability of a forecast system to distinguish between events and non-events. As is implicit in that statement, application of the ROC curve is limited to forecasts involving only two possible outcomes, such as rain and no rain. However, many forecast scenarios exist for which there are multiple possible outcomes, such as rain, snow, and freezing rain. An extension of the ROC curve to multi-class forecast problems is explored. The full extension involves high-dimensional hyper-surfaces that cannot be visualized and that present other problems. Therefore, several different approximations to the full extension are introduced using both artificial and actual forecast data sets. These approximations range from sets of simple two-class ROC curves to sets of three-dimensional ROC surfaces. No single approximation is superior for all forecast problems, thus the specific aims in evaluating the forecast must be considered.

Downloads: 0