Trustworthy AI in practice: an analysis of practitioners' needs and challenges. Baldassarre, M. T., Gigante, D., Kalinowski, M., Ragone, A., & Tibidò, S. In Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering, of EASE '24, pages 293–302, 2024. Association for Computing Machinery.
Author version doi abstract bibtex 1 download Recently, there has been growing attention on behalf of both academic and practice communities towards the ability of Artificial Intelligence (AI) systems to operate responsibly and ethically. As a result, a plethora of frameworks and guidelines have appeared to support practitioners in implementing Trustworthy AI applications (TAI). However, little research has been done to investigate whether such frameworks are being used and how. In this work, we study the vision AI practitioners have on TAI principles, how they address them, and what they would like to have – in terms of tools, knowledge, or guidelines – when they attempt to incorporate such principles into the systems they develop. Through a survey and semi-structured interviews, we systematically investigated practitioners’ challenges and needs in developing TAI systems. Based on these practical findings, we highlight recommendations to help AI practitioners develop Trustworthy AI applications.
@inproceedings{BaldassarreGKRT24,
author = {Baldassarre, Maria Teresa and Gigante, Domenico and Kalinowski, Marcos and Ragone, Azzurra and Tibid\`{o}, Sara},
title = {Trustworthy AI in practice: an analysis of practitioners' needs and challenges},
year = {2024},
isbn = {9798400717017},
publisher = {Association for Computing Machinery},
urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/BaldassarreGKRT24.pdf},
doi = {10.1145/3661167.3661214},
abstract = {Recently, there has been growing attention on behalf of both academic and practice communities towards the ability of Artificial Intelligence (AI) systems to operate responsibly and ethically. As a result, a plethora of frameworks and guidelines have appeared to support practitioners in implementing Trustworthy AI applications (TAI). However, little research has been done to investigate whether such frameworks are being used and how. In this work, we study the vision AI practitioners have on TAI principles, how they address them, and what they would like to have – in terms of tools, knowledge, or guidelines – when they attempt to incorporate such principles into the systems they develop. Through a survey and semi-structured interviews, we systematically investigated practitioners’ challenges and needs in developing TAI systems. Based on these practical findings, we highlight recommendations to help AI practitioners develop Trustworthy AI applications.},
booktitle = {Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering},
pages = {293–302},
numpages = {10},
keywords = {Artificial Intelligence, Mixed-method Research, Semi-structured Interview, Software Engineering, Survey, Systematic Investigation, Trustworthy AI},
location = {Salerno, Italy},
series = {EASE '24}
}
Downloads: 1
{"_id":"M7ngNSfrGFgT4cSXk","bibbaseid":"baldassarre-gigante-kalinowski-ragone-tibid-trustworthyaiinpracticeananalysisofpractitionersneedsandchallenges-2024","author_short":["Baldassarre, M. T.","Gigante, D.","Kalinowski, M.","Ragone, A.","Tibidò, S."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","author":[{"propositions":[],"lastnames":["Baldassarre"],"firstnames":["Maria","Teresa"],"suffixes":[]},{"propositions":[],"lastnames":["Gigante"],"firstnames":["Domenico"],"suffixes":[]},{"propositions":[],"lastnames":["Kalinowski"],"firstnames":["Marcos"],"suffixes":[]},{"propositions":[],"lastnames":["Ragone"],"firstnames":["Azzurra"],"suffixes":[]},{"propositions":[],"lastnames":["Tibidò"],"firstnames":["Sara"],"suffixes":[]}],"title":"Trustworthy AI in practice: an analysis of practitioners' needs and challenges","year":"2024","isbn":"9798400717017","publisher":"Association for Computing Machinery","urlauthor_version":"http://www.inf.puc-rio.br/~kalinowski/publications/BaldassarreGKRT24.pdf","doi":"10.1145/3661167.3661214","abstract":"Recently, there has been growing attention on behalf of both academic and practice communities towards the ability of Artificial Intelligence (AI) systems to operate responsibly and ethically. As a result, a plethora of frameworks and guidelines have appeared to support practitioners in implementing Trustworthy AI applications (TAI). However, little research has been done to investigate whether such frameworks are being used and how. In this work, we study the vision AI practitioners have on TAI principles, how they address them, and what they would like to have – in terms of tools, knowledge, or guidelines – when they attempt to incorporate such principles into the systems they develop. Through a survey and semi-structured interviews, we systematically investigated practitioners’ challenges and needs in developing TAI systems. Based on these practical findings, we highlight recommendations to help AI practitioners develop Trustworthy AI applications.","booktitle":"Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering","pages":"293–302","numpages":"10","keywords":"Artificial Intelligence, Mixed-method Research, Semi-structured Interview, Software Engineering, Survey, Systematic Investigation, Trustworthy AI","location":"Salerno, Italy","series":"EASE '24","bibtex":"@inproceedings{BaldassarreGKRT24,\r\n author = {Baldassarre, Maria Teresa and Gigante, Domenico and Kalinowski, Marcos and Ragone, Azzurra and Tibid\\`{o}, Sara},\r\n title = {Trustworthy AI in practice: an analysis of practitioners' needs and challenges},\r\n year = {2024},\r\n isbn = {9798400717017},\r\n publisher = {Association for Computing Machinery},\r\n urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/BaldassarreGKRT24.pdf}, \r\n doi = {10.1145/3661167.3661214},\r\n abstract = {Recently, there has been growing attention on behalf of both academic and practice communities towards the ability of Artificial Intelligence (AI) systems to operate responsibly and ethically. As a result, a plethora of frameworks and guidelines have appeared to support practitioners in implementing Trustworthy AI applications (TAI). However, little research has been done to investigate whether such frameworks are being used and how. In this work, we study the vision AI practitioners have on TAI principles, how they address them, and what they would like to have – in terms of tools, knowledge, or guidelines – when they attempt to incorporate such principles into the systems they develop. Through a survey and semi-structured interviews, we systematically investigated practitioners’ challenges and needs in developing TAI systems. Based on these practical findings, we highlight recommendations to help AI practitioners develop Trustworthy AI applications.},\r\n booktitle = {Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering},\r\n pages = {293–302},\r\n numpages = {10},\r\n keywords = {Artificial Intelligence, Mixed-method Research, Semi-structured Interview, Software Engineering, Survey, Systematic Investigation, Trustworthy AI},\r\n location = {Salerno, Italy},\r\n series = {EASE '24}\r\n}\r\n\r\n","author_short":["Baldassarre, M. T.","Gigante, D.","Kalinowski, M.","Ragone, A.","Tibidò, S."],"key":"BaldassarreGKRT24","id":"BaldassarreGKRT24","bibbaseid":"baldassarre-gigante-kalinowski-ragone-tibid-trustworthyaiinpracticeananalysisofpractitionersneedsandchallenges-2024","role":"author","urls":{"Author version":"http://www.inf.puc-rio.br/~kalinowski/publications/BaldassarreGKRT24.pdf"},"keyword":["Artificial Intelligence","Mixed-method Research","Semi-structured Interview","Software Engineering","Survey","Systematic Investigation","Trustworthy AI"],"metadata":{"authorlinks":{}},"downloads":1},"bibtype":"inproceedings","biburl":"https://bibbase.org/network/files/KuRSiZJF8A6EZiujE","dataSources":["q7rgFjFgwoTSGkm3G","56kphca3KPjtFZJC6","JxJm4GfaRAd3NEw2w","iSfhee4nHcHz4F2WQ"],"keywords":["artificial intelligence","mixed-method research","semi-structured interview","software engineering","survey","systematic investigation","trustworthy ai"],"search_terms":["trustworthy","practice","analysis","practitioners","needs","challenges","baldassarre","gigante","kalinowski","ragone","tibidò"],"title":"Trustworthy AI in practice: an analysis of practitioners' needs and challenges","year":2024,"downloads":1}