No free lunch but a cheaper supper: A general framework for streaming anomaly detection. Calikus, E., Nowaczyk, S., Sant’Anna, A., & Dikmen, O. Expert Systems with Applications, 155:113453, October, 2020. ![No free lunch but a cheaper supper: A general framework for streaming anomaly detection [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex In recent years, research interest in detecting anomalies in temporal streaming data has increased significantly. A variety of algorithms are being developed in the data mining community. They can be broadly divided into two categories, namely general-purpose and ad hoc ones. In most cases, general approaches assume a one-size-fits-all solution model, and strive to design a single “optimal” anomaly detector which can detect all anomalies in any domain. To date, there exists no universal method that has been shown to outperform the others across different anomaly types, use cases and datasets. In this paper, we propose SAFARI, a framework created by abstracting and unifying the fundamental tasks within the streaming anomaly detection. SAFARI provides a flexible and extensible anomaly detection procedure to overcome the limitations of one-size-fits-all solutions. Such abstraction helps to facilitate more elaborate algorithm comparisons by allowing us to isolate the effects of shared and unique characteristics of diverse algorithms on the performance. Using the framework, we have identified a research gap that motivated us to propose a novel learning strategy. We implemented twenty different anomaly detectors and conducted an extensive evaluation study, comparing their performances using real-world benchmark datasets with different properties. The results indicate that there is no single superior detector which works perfectly for every case, proving our hypothesis that “there is no free lunch” in the streaming anomaly detection world. Finally, we discuss the benefits and drawbacks of each method in-depth, drawing a set of conclusions and guidelines to guide future users of SAFARI.
@article{calikus_no_2020,
title = {No free lunch but a cheaper supper: {A} general framework for streaming anomaly detection},
volume = {155},
issn = {0957-4174},
shorttitle = {No free lunch but a cheaper supper},
url = {https://www.sciencedirect.com/science/article/pii/S0957417420302773},
doi = {10.1016/j.eswa.2020.113453},
abstract = {In recent years, research interest in detecting anomalies in temporal streaming data has increased significantly. A variety of algorithms are being developed in the data mining community. They can be broadly divided into two categories, namely general-purpose and ad hoc ones. In most cases, general approaches assume a one-size-fits-all solution model, and strive to design a single “optimal” anomaly detector which can detect all anomalies in any domain. To date, there exists no universal method that has been shown to outperform the others across different anomaly types, use cases and datasets. In this paper, we propose SAFARI, a framework created by abstracting and unifying the fundamental tasks within the streaming anomaly detection. SAFARI provides a flexible and extensible anomaly detection procedure to overcome the limitations of one-size-fits-all solutions. Such abstraction helps to facilitate more elaborate algorithm comparisons by allowing us to isolate the effects of shared and unique characteristics of diverse algorithms on the performance. Using the framework, we have identified a research gap that motivated us to propose a novel learning strategy. We implemented twenty different anomaly detectors and conducted an extensive evaluation study, comparing their performances using real-world benchmark datasets with different properties. The results indicate that there is no single superior detector which works perfectly for every case, proving our hypothesis that “there is no free lunch” in the streaming anomaly detection world. Finally, we discuss the benefits and drawbacks of each method in-depth, drawing a set of conclusions and guidelines to guide future users of SAFARI.},
language = {en},
urldate = {2023-05-21},
journal = {Expert Systems with Applications},
author = {Calikus, Ece and Nowaczyk, Sławomir and Sant’Anna, Anita and Dikmen, Onur},
month = oct,
year = {2020},
keywords = {Anomaly detection, Online learning, Reservoir sampling, Stream mining},
pages = {113453},
}
Downloads: 0
{"_id":"QDZahTd4PStnpvHc4","bibbaseid":"calikus-nowaczyk-santanna-dikmen-nofreelunchbutacheapersupperageneralframeworkforstreaminganomalydetection-2020","author_short":["Calikus, E.","Nowaczyk, S.","Sant’Anna, A.","Dikmen, O."],"bibdata":{"bibtype":"article","type":"article","title":"No free lunch but a cheaper supper: A general framework for streaming anomaly detection","volume":"155","issn":"0957-4174","shorttitle":"No free lunch but a cheaper supper","url":"https://www.sciencedirect.com/science/article/pii/S0957417420302773","doi":"10.1016/j.eswa.2020.113453","abstract":"In recent years, research interest in detecting anomalies in temporal streaming data has increased significantly. A variety of algorithms are being developed in the data mining community. They can be broadly divided into two categories, namely general-purpose and ad hoc ones. In most cases, general approaches assume a one-size-fits-all solution model, and strive to design a single “optimal” anomaly detector which can detect all anomalies in any domain. To date, there exists no universal method that has been shown to outperform the others across different anomaly types, use cases and datasets. In this paper, we propose SAFARI, a framework created by abstracting and unifying the fundamental tasks within the streaming anomaly detection. SAFARI provides a flexible and extensible anomaly detection procedure to overcome the limitations of one-size-fits-all solutions. Such abstraction helps to facilitate more elaborate algorithm comparisons by allowing us to isolate the effects of shared and unique characteristics of diverse algorithms on the performance. Using the framework, we have identified a research gap that motivated us to propose a novel learning strategy. We implemented twenty different anomaly detectors and conducted an extensive evaluation study, comparing their performances using real-world benchmark datasets with different properties. The results indicate that there is no single superior detector which works perfectly for every case, proving our hypothesis that “there is no free lunch” in the streaming anomaly detection world. Finally, we discuss the benefits and drawbacks of each method in-depth, drawing a set of conclusions and guidelines to guide future users of SAFARI.","language":"en","urldate":"2023-05-21","journal":"Expert Systems with Applications","author":[{"propositions":[],"lastnames":["Calikus"],"firstnames":["Ece"],"suffixes":[]},{"propositions":[],"lastnames":["Nowaczyk"],"firstnames":["Sławomir"],"suffixes":[]},{"propositions":[],"lastnames":["Sant’Anna"],"firstnames":["Anita"],"suffixes":[]},{"propositions":[],"lastnames":["Dikmen"],"firstnames":["Onur"],"suffixes":[]}],"month":"October","year":"2020","keywords":"Anomaly detection, Online learning, Reservoir sampling, Stream mining","pages":"113453","bibtex":"@article{calikus_no_2020,\n\ttitle = {No free lunch but a cheaper supper: {A} general framework for streaming anomaly detection},\n\tvolume = {155},\n\tissn = {0957-4174},\n\tshorttitle = {No free lunch but a cheaper supper},\n\turl = {https://www.sciencedirect.com/science/article/pii/S0957417420302773},\n\tdoi = {10.1016/j.eswa.2020.113453},\n\tabstract = {In recent years, research interest in detecting anomalies in temporal streaming data has increased significantly. A variety of algorithms are being developed in the data mining community. They can be broadly divided into two categories, namely general-purpose and ad hoc ones. In most cases, general approaches assume a one-size-fits-all solution model, and strive to design a single “optimal” anomaly detector which can detect all anomalies in any domain. To date, there exists no universal method that has been shown to outperform the others across different anomaly types, use cases and datasets. In this paper, we propose SAFARI, a framework created by abstracting and unifying the fundamental tasks within the streaming anomaly detection. SAFARI provides a flexible and extensible anomaly detection procedure to overcome the limitations of one-size-fits-all solutions. Such abstraction helps to facilitate more elaborate algorithm comparisons by allowing us to isolate the effects of shared and unique characteristics of diverse algorithms on the performance. Using the framework, we have identified a research gap that motivated us to propose a novel learning strategy. We implemented twenty different anomaly detectors and conducted an extensive evaluation study, comparing their performances using real-world benchmark datasets with different properties. The results indicate that there is no single superior detector which works perfectly for every case, proving our hypothesis that “there is no free lunch” in the streaming anomaly detection world. Finally, we discuss the benefits and drawbacks of each method in-depth, drawing a set of conclusions and guidelines to guide future users of SAFARI.},\n\tlanguage = {en},\n\turldate = {2023-05-21},\n\tjournal = {Expert Systems with Applications},\n\tauthor = {Calikus, Ece and Nowaczyk, Sławomir and Sant’Anna, Anita and Dikmen, Onur},\n\tmonth = oct,\n\tyear = {2020},\n\tkeywords = {Anomaly detection, Online learning, Reservoir sampling, Stream mining},\n\tpages = {113453},\n}\n\n","author_short":["Calikus, E.","Nowaczyk, S.","Sant’Anna, A.","Dikmen, O."],"key":"calikus_no_2020","id":"calikus_no_2020","bibbaseid":"calikus-nowaczyk-santanna-dikmen-nofreelunchbutacheapersupperageneralframeworkforstreaminganomalydetection-2020","role":"author","urls":{"Paper":"https://www.sciencedirect.com/science/article/pii/S0957417420302773"},"keyword":["Anomaly detection","Online learning","Reservoir sampling","Stream mining"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://bibbase.org/zotero/mh_lenguyen","dataSources":["iwKepCrWBps7ojhDx"],"keywords":["anomaly detection","online learning","reservoir sampling","stream mining"],"search_terms":["free","lunch","cheaper","supper","general","framework","streaming","anomaly","detection","calikus","nowaczyk","sant’anna","dikmen"],"title":"No free lunch but a cheaper supper: A general framework for streaming anomaly detection","year":2020}