Comparing operating systems using robustness benchmarks. Koopman, P., Sung, J., Dingman, C., Siewiorek, D., & Marz, T. In , The Sixteenth Symposium on Reliable Distributed Systems, 1997. Proceedings, pages 72–79, October, 1997.
doi  abstract   bibtex   
When creating mission-critical distributed systems using off-the-shelf components, it is important to assess the dependability of not only the hardware, but the software as well. This paper proposes a way to test operating system dependability. The concept of response regions is presented as a way to visualize erroneous system behavior and gain insight into failure mechanisms. A 5-point “CRASH” (catastrophic, restart, abort, silent, hindering) scale is defined for grading the severity of robustness vulnerabilities encountered. Test results from five operating systems are analyzed for robustness vulnerabilities, and exhibit a range of dependability. Robustness benchmarking comparisons of this type may provide important information to both users and designers of off-the-shelf software for dependable systems
@inproceedings{koopman_comparing_1997,
	title = {Comparing operating systems using robustness benchmarks},
	doi = {10.1109/RELDIS.1997.632800},
	abstract = {When creating mission-critical distributed systems using off-the-shelf components, it is important to assess the dependability of not only the hardware, but the software as well. This paper proposes a way to test operating system dependability. The concept of response regions is presented as a way to visualize erroneous system behavior and gain insight into failure mechanisms. A 5-point “CRASH” (catastrophic, restart, abort, silent, hindering) scale is defined for grading the severity of robustness vulnerabilities encountered. Test results from five operating systems are analyzed for robustness vulnerabilities, and exhibit a range of dependability. Robustness benchmarking comparisons of this type may provide important information to both users and designers of off-the-shelf software for dependable systems},
	booktitle = {, {The} {Sixteenth} {Symposium} on {Reliable} {Distributed} {Systems}, 1997. {Proceedings}},
	author = {Koopman, P. and Sung, J. and Dingman, C. and Siewiorek, Daniel and Marz, T.},
	month = oct,
	year = {1997},
	keywords = {Benchmark testing, CRASH scale, erroneous system behavior visualization, Failure analysis, failure mechanisms, Hardware, mission-critical distributed systems, Mission critical systems, network operating systems, off-the-shelf components, Operating systems, response regions, Robustness, robustness benchmarks, robustness vulnerability severity grading, software dependability assessment, Software design, software reliability, Software systems, System testing, Visualization},
	pages = {72--79},
	file = {IEEE Xplore Abstract Record:C\:\\Users\\Lena\\AppData\\Roaming\\Zotero\\Zotero\\Profiles\\2vs1gusf.default\\zotero\\storage\\WT66BTTD\\articleDetails.html:text/html}
}
Downloads: 0