Toward a Quality Model for Hybrid Intelligence Teams. Dell'Anna, D., Murukannaiah, P. K., Dudzik, B., Grossi, D., Jonker, C. M., Oertel, C., & Yolum, P. In Proceedings of the 23rd International Conference on Autonomous Agents and MultiAgent Systems, AAMAS 2024, pages 434–443, 2024.
Toward a Quality Model for Hybrid Intelligence Teams [link]Link  Toward a Quality Model for Hybrid Intelligence Teams [pdf]Paper  Toward a Quality Model for Hybrid Intelligence Teams [pdf]Poster  Toward a Quality Model for Hybrid Intelligence Teams [link]Supplement  doi  abstract   bibtex   1 download  
Hybrid Intelligence (HI) is an emerging paradigm in which artificial intelligence (AI) augments human intelligence. The current literature lacks systematic models that guide the design and evaluation of HI systems. Further, discussions around HI primarily focus on technology, neglecting the holistic human-AI ensemble. In this paper, we take the initial steps toward the development of a quality model for characterizing and evaluating HI systems from a human-AI teams perspective. We conducted a study investigating the adequacy of properties commonly associated with effective human teams to describe HI. Our study, featuring the insights of 50 HI researchers, shows that various human team properties, including boundedness, interdependence, competency, purposefulness, initiative, normativity, and effectiveness, are important for HI systems. Our study also reveals limitations in applying certain human team properties, such as coaching, rewards, and recognition, to HI systems due to the inherent human-AI asymmetry.

Downloads: 1