How Developers Debug Software — The DBGBENCH Dataset. Bohme, M., Soremekun, E., O., Chattopadhyay, S., Ugherughe, E., J., & Zeller, A. In 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), pages 244-246, 5, 2017. IEEE.
Paper
Website abstract bibtex How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error – all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. the judgement of human experts.
@inProceedings{
title = {How Developers Debug Software — The DBGBENCH Dataset},
type = {inProceedings},
year = {2017},
identifiers = {[object Object]},
keywords = {Bug Diagnosis,Debugging in Practice,Fault Localization,Software Repair,Tool Evaluation,User as Tool Benchmark},
pages = {244-246},
websites = {http://ieeexplore.ieee.org/document/7965318/},
month = {5},
publisher = {IEEE},
id = {571db94c-eb26-33e7-9387-107ddb563353},
created = {2017-11-29T18:08:10.249Z},
accessed = {2017-11-29},
file_attached = {true},
profile_id = {8d214556-773a-380a-b867-8b4d2dcccf5d},
group_id = {b7c8e963-2986-3101-94ed-d4191d2b71cd},
last_modified = {2017-12-04T20:12:20.817Z},
read = {false},
starred = {false},
authored = {false},
confirmed = {true},
hidden = {false},
private_publication = {false},
abstract = {How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error – all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. the judgement of human experts.},
bibtype = {inProceedings},
author = {Bohme, Marcel and Soremekun, Ezekiel Olamide and Chattopadhyay, Sudipta and Ugherughe, Emamurho Juliet and Zeller, Andreas},
booktitle = {2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C)}
}
Downloads: 0
{"_id":"hHDRyWHK4AgaZGoBs","bibbaseid":"bohme-soremekun-chattopadhyay-ugherughe-zeller-howdevelopersdebugsoftwarethedbgbenchdataset-2017","downloads":0,"creationDate":"2017-12-06T15:11:30.903Z","title":"How Developers Debug Software — The DBGBENCH Dataset","author_short":["Bohme, M.","Soremekun, E., O.","Chattopadhyay, S.","Ugherughe, E., J.","Zeller, A."],"year":2017,"bibtype":"inProceedings","biburl":null,"bibdata":{"title":"How Developers Debug Software — The DBGBENCH Dataset","type":"inProceedings","year":"2017","identifiers":"[object Object]","keywords":"Bug Diagnosis,Debugging in Practice,Fault Localization,Software Repair,Tool Evaluation,User as Tool Benchmark","pages":"244-246","websites":"http://ieeexplore.ieee.org/document/7965318/","month":"5","publisher":"IEEE","id":"571db94c-eb26-33e7-9387-107ddb563353","created":"2017-11-29T18:08:10.249Z","accessed":"2017-11-29","file_attached":"true","profile_id":"8d214556-773a-380a-b867-8b4d2dcccf5d","group_id":"b7c8e963-2986-3101-94ed-d4191d2b71cd","last_modified":"2017-12-04T20:12:20.817Z","read":false,"starred":false,"authored":false,"confirmed":"true","hidden":false,"private_publication":false,"abstract":"How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error – all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. the judgement of human experts.","bibtype":"inProceedings","author":"Bohme, Marcel and Soremekun, Ezekiel Olamide and Chattopadhyay, Sudipta and Ugherughe, Emamurho Juliet and Zeller, Andreas","booktitle":"2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C)","bibtex":"@inProceedings{\n title = {How Developers Debug Software — The DBGBENCH Dataset},\n type = {inProceedings},\n year = {2017},\n identifiers = {[object Object]},\n keywords = {Bug Diagnosis,Debugging in Practice,Fault Localization,Software Repair,Tool Evaluation,User as Tool Benchmark},\n pages = {244-246},\n websites = {http://ieeexplore.ieee.org/document/7965318/},\n month = {5},\n publisher = {IEEE},\n id = {571db94c-eb26-33e7-9387-107ddb563353},\n created = {2017-11-29T18:08:10.249Z},\n accessed = {2017-11-29},\n file_attached = {true},\n profile_id = {8d214556-773a-380a-b867-8b4d2dcccf5d},\n group_id = {b7c8e963-2986-3101-94ed-d4191d2b71cd},\n last_modified = {2017-12-04T20:12:20.817Z},\n read = {false},\n starred = {false},\n authored = {false},\n confirmed = {true},\n hidden = {false},\n private_publication = {false},\n abstract = {How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error – all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. the judgement of human experts.},\n bibtype = {inProceedings},\n author = {Bohme, Marcel and Soremekun, Ezekiel Olamide and Chattopadhyay, Sudipta and Ugherughe, Emamurho Juliet and Zeller, Andreas},\n booktitle = {2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C)}\n}","author_short":["Bohme, M.","Soremekun, E., O.","Chattopadhyay, S.","Ugherughe, E., J.","Zeller, A."],"urls":{"Paper":"http://bibbase.org/service/mendeley/8d214556-773a-380a-b867-8b4d2dcccf5d/file/520b6721-0d7a-2eb7-3c28-81435b60d39b/2017-How_Developers_Debug_Software__The_DBGBENCH_Dataset.pdf.pdf","Website":"http://ieeexplore.ieee.org/document/7965318/"},"bibbaseid":"bohme-soremekun-chattopadhyay-ugherughe-zeller-howdevelopersdebugsoftwarethedbgbenchdataset-2017","role":"author","keyword":["Bug Diagnosis","Debugging in Practice","Fault Localization","Software Repair","Tool Evaluation","User as Tool Benchmark"],"downloads":0,"html":""},"search_terms":["developers","debug","software","dbgbench","dataset","bohme","soremekun","chattopadhyay","ugherughe","zeller"],"keywords":["bug diagnosis","debugging in practice","fault localization","software repair","tool evaluation","user as tool benchmark"],"authorIDs":[]}