Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil. Alves, A., Kalinowski, M., Mendez, D., Villamizar, H., Azevedo, K., Escovedo, T., & Lopes, H. In Anais do XXXVIII Simpósio Brasileiro de Engenharia de Software, pages 224–233, 2024. SBC. SBES 2024 Distinguished Paper Award!![Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil [pdf]](https://bibbase.org/img/filetypes/pdf.svg "pdf")
Author version doi abstract bibtex 6 downloads [Context] In Brazil, 41% of companies use machine learning (ML) to some extent. However, several challenges have been reported when engineering ML-enabled systems, including unrealistic customer expectations and vagueness in ML problem specifications. Literature suggests that Requirements Engineering (RE) practices and tools may help to alleviate these issues, yet there is insufficient understanding of RE’s practical application and its perception among practitioners. [Goal] This study aims to investigate the application of RE in developing ML-enabled systems in Brazil, creating an overview of current practices, perceptions, and problems in the Brazilian industry. [Method] To this end, we extracted and analyzed data from an international survey focused on ML-enabled systems, concentrating specifically on responses from practitioners based in Brazil. We analyzed the cluster of RE-related answers gathered from 72 practitioners involved in data-driven projects. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative studies on the reported problems involving open and axial coding procedures. [Results] Our findings highlight distinct aspects of RE implementation in ML projects in Brazil. For instance, (i) RErelated tasks are predominantly conducted by data scientists; (ii) the most common techniques for eliciting requirements are interviews and workshop meetings; (iii) there is a prevalence of interactive notebooks in requirements documentation; (iv) practitioners report problems that include a poor understanding of the problem to solve and the business domain, low customer engagement, and difficulties managing stakeholders expectations. [Conclusion] These results provide an understanding of RE-related practices in the Brazilian ML industry, helping to guide research and initiatives toward improving the maturity of RE for ML-enabled systems.
@inproceedings{AlvesKMVAEL24,
author = {Antonio Alves and Marcos Kalinowski and Daniel Mendez and Hugo Villamizar and Kelly Azevedo and Tatiana Escovedo and Helio Lopes},
title = {Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil},
abstract = {[Context] In Brazil, 41% of companies use machine learning (ML) to some extent. However, several challenges have been reported when engineering ML-enabled systems, including unrealistic customer expectations and vagueness in ML problem specifications. Literature suggests that Requirements Engineering (RE) practices and tools may help to alleviate these issues, yet there is insufficient understanding of RE’s practical application and its perception among practitioners. [Goal] This study aims to investigate the application of RE in developing ML-enabled systems in Brazil, creating an overview of current practices, perceptions, and problems in the Brazilian industry. [Method] To this end, we extracted and analyzed data from an international survey focused on ML-enabled systems, concentrating specifically on responses from practitioners based in Brazil. We analyzed the cluster of RE-related answers gathered from 72 practitioners involved in data-driven projects. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative studies on the reported problems involving open and axial coding procedures. [Results] Our findings highlight distinct aspects of RE implementation in ML projects in Brazil. For instance, (i) RErelated tasks are predominantly conducted by data scientists; (ii) the most common techniques for eliciting requirements are interviews and workshop meetings; (iii) there is a prevalence of interactive notebooks in requirements documentation; (iv) practitioners report problems that include a poor understanding of the problem to solve and the business domain, low customer engagement, and difficulties managing stakeholders expectations. [Conclusion] These results provide an understanding of RE-related practices in the Brazilian ML industry, helping to guide research and initiatives toward improving the maturity of RE for ML-enabled systems.},
booktitle = {Anais do XXXVIII Simpósio Brasileiro de Engenharia de Software},
note={<font color="red">SBES 2024 Distinguished Paper Award!</font>},
location = {Curitiba/PR},
year = {2024},
keywords = {Requirements Engineering, Machine Learning, Survey, Brazil},
issn = {0000-0000},
pages = {224--233},
publisher = {SBC},
doi = {10.5753/sbes.2024.3371},
urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/AlvesKMVAEL24.pdf}
}
Downloads: 6
{"_id":"ecnRWf8krdAH323YQ","bibbaseid":"alves-kalinowski-mendez-villamizar-azevedo-escovedo-lopes-industrialpracticesofrequirementsengineeringformlenabledsystemsinbrazil-2024","author_short":["Alves, A.","Kalinowski, M.","Mendez, D.","Villamizar, H.","Azevedo, K.","Escovedo, T.","Lopes, H."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","author":[{"firstnames":["Antonio"],"propositions":[],"lastnames":["Alves"],"suffixes":[]},{"firstnames":["Marcos"],"propositions":[],"lastnames":["Kalinowski"],"suffixes":[]},{"firstnames":["Daniel"],"propositions":[],"lastnames":["Mendez"],"suffixes":[]},{"firstnames":["Hugo"],"propositions":[],"lastnames":["Villamizar"],"suffixes":[]},{"firstnames":["Kelly"],"propositions":[],"lastnames":["Azevedo"],"suffixes":[]},{"firstnames":["Tatiana"],"propositions":[],"lastnames":["Escovedo"],"suffixes":[]},{"firstnames":["Helio"],"propositions":[],"lastnames":["Lopes"],"suffixes":[]}],"title":"Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil","abstract":"[Context] In Brazil, 41% of companies use machine learning (ML) to some extent. However, several challenges have been reported when engineering ML-enabled systems, including unrealistic customer expectations and vagueness in ML problem specifications. Literature suggests that Requirements Engineering (RE) practices and tools may help to alleviate these issues, yet there is insufficient understanding of RE’s practical application and its perception among practitioners. [Goal] This study aims to investigate the application of RE in developing ML-enabled systems in Brazil, creating an overview of current practices, perceptions, and problems in the Brazilian industry. [Method] To this end, we extracted and analyzed data from an international survey focused on ML-enabled systems, concentrating specifically on responses from practitioners based in Brazil. We analyzed the cluster of RE-related answers gathered from 72 practitioners involved in data-driven projects. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative studies on the reported problems involving open and axial coding procedures. [Results] Our findings highlight distinct aspects of RE implementation in ML projects in Brazil. For instance, (i) RErelated tasks are predominantly conducted by data scientists; (ii) the most common techniques for eliciting requirements are interviews and workshop meetings; (iii) there is a prevalence of interactive notebooks in requirements documentation; (iv) practitioners report problems that include a poor understanding of the problem to solve and the business domain, low customer engagement, and difficulties managing stakeholders expectations. [Conclusion] These results provide an understanding of RE-related practices in the Brazilian ML industry, helping to guide research and initiatives toward improving the maturity of RE for ML-enabled systems.","booktitle":"Anais do XXXVIII Simpósio Brasileiro de Engenharia de Software","note":"<font color=\"red\">SBES 2024 Distinguished Paper Award!</font>","location":"Curitiba/PR","year":"2024","keywords":"Requirements Engineering, Machine Learning, Survey, Brazil","issn":"0000-0000","pages":"224–233","publisher":"SBC","doi":"10.5753/sbes.2024.3371","urlauthor_version":"http://www.inf.puc-rio.br/~kalinowski/publications/AlvesKMVAEL24.pdf","bibtex":"@inproceedings{AlvesKMVAEL24,\r\n author = {Antonio Alves and Marcos Kalinowski and Daniel Mendez and Hugo Villamizar and Kelly Azevedo and Tatiana Escovedo and Helio Lopes},\r\n title = {Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil},\r\n abstract = {[Context] In Brazil, 41% of companies use machine learning (ML) to some extent. However, several challenges have been reported when engineering ML-enabled systems, including unrealistic customer expectations and vagueness in ML problem specifications. Literature suggests that Requirements Engineering (RE) practices and tools may help to alleviate these issues, yet there is insufficient understanding of RE’s practical application and its perception among practitioners. [Goal] This study aims to investigate the application of RE in developing ML-enabled systems in Brazil, creating an overview of current practices, perceptions, and problems in the Brazilian industry. [Method] To this end, we extracted and analyzed data from an international survey focused on ML-enabled systems, concentrating specifically on responses from practitioners based in Brazil. We analyzed the cluster of RE-related answers gathered from 72 practitioners involved in data-driven projects. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative studies on the reported problems involving open and axial coding procedures. [Results] Our findings highlight distinct aspects of RE implementation in ML projects in Brazil. For instance, (i) RErelated tasks are predominantly conducted by data scientists; (ii) the most common techniques for eliciting requirements are interviews and workshop meetings; (iii) there is a prevalence of interactive notebooks in requirements documentation; (iv) practitioners report problems that include a poor understanding of the problem to solve and the business domain, low customer engagement, and difficulties managing stakeholders expectations. [Conclusion] These results provide an understanding of RE-related practices in the Brazilian ML industry, helping to guide research and initiatives toward improving the maturity of RE for ML-enabled systems.},\r\n booktitle = {Anais do XXXVIII Simpósio Brasileiro de Engenharia de Software},\r\n note={<font color=\"red\">SBES 2024 Distinguished Paper Award!</font>}, \r\n location = {Curitiba/PR},\r\n year = {2024},\r\n keywords = {Requirements Engineering, Machine Learning, Survey, Brazil},\r\n issn = {0000-0000},\r\n pages = {224--233},\r\n publisher = {SBC},\r\n doi = {10.5753/sbes.2024.3371},\r\n urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/AlvesKMVAEL24.pdf}\r\n}\r\n\r\n","author_short":["Alves, A.","Kalinowski, M.","Mendez, D.","Villamizar, H.","Azevedo, K.","Escovedo, T.","Lopes, H."],"key":"AlvesKMVAEL24","id":"AlvesKMVAEL24","bibbaseid":"alves-kalinowski-mendez-villamizar-azevedo-escovedo-lopes-industrialpracticesofrequirementsengineeringformlenabledsystemsinbrazil-2024","role":"author","urls":{"Author version":"http://www.inf.puc-rio.br/~kalinowski/publications/AlvesKMVAEL24.pdf"},"keyword":["Requirements Engineering","Machine Learning","Survey","Brazil"],"metadata":{"authorlinks":{}},"downloads":6},"bibtype":"inproceedings","biburl":"https://bibbase.org/network/files/KuRSiZJF8A6EZiujE","dataSources":["q7rgFjFgwoTSGkm3G","iSfhee4nHcHz4F2WQ"],"keywords":["requirements engineering","machine learning","survey","brazil"],"search_terms":["industrial","practices","requirements","engineering","enabled","systems","brazil","alves","kalinowski","mendez","villamizar","azevedo","escovedo","lopes"],"title":"Industrial Practices of Requirements Engineering for ML-Enabled Systems in Brazil","year":2024,"downloads":7}