Improving Model Inspection Processes with Crowdsourcing: Findings from a Controlled Experiment. Winkler, D., Sabou, M., Petrovic, S., Carneiro, G., Kalinowski, M., & Biffl, S. In Systems, Software and Services Process Improvement - 24th European Conference, EuroSPI 2017, Ostrava, Czech Republic, September 6-8, 2017, Proceedings, pages 125-137, 2017.
Improving Model Inspection Processes with Crowdsourcing: Findings from a Controlled Experiment [pdf]Author version  doi  abstract   bibtex   
The application of best-practice software inspection processes for early defect detection requires considerable human effort. Crowdsourcing approaches can support inspection activities (a) by distributing inspection effort among a group of human experts and (b) by increasing inspection control. Thus, the application of crowdsourcing techniques aims at making inspection processes more effective and efficient. In this paper, we present a crowdsourcing-supported model inspection (CSI) process and investigate its defect detection effectiveness and efficiency when inspecting an Extended Entity Relationship (EER) model. The CSI process uses so-called Expected Model Elements (EMEs) to guide CSI inspectors during defect detection. We conducted a controlled experiment on defect detection effectiveness, efficiency, and false positives. While CSI effectiveness and efficiency is lower for CSI inspectors, the number of false positives decreases. However, CSI was found promising for increasing the control of defect detection and supports the inspection of large-scale engineering models.

Downloads: 0