Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents. Malle, B. F., Scheutz, M., Arnold, T., Voiklis, J., & Cusimano, C. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, of HRI '15, pages 117–124, New York, NY, USA, 2015. ACM.
Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents [link]Paper  doi  abstract   bibtex   
Moral norms play an essential role in regulating human interaction. With the growing sophistication and proliferation of robots, it is important to understand how ordinary people apply moral norms to robot agents and make moral judgments about their behavior. We report the first comparison of people's moral judgments (of permissibility, wrongness, and blame) about human and robot agents. Two online experiments (total N = 316) found that robots, compared with human agents, were more strongly expected to take an action that sacrifices one person for the good of many (a "utilitarian" choice), and they were blamed more than their human counterparts when they did not make that choice. Though the utilitarian sacrifice was generally seen as permissible for human agents, they were blamed more for choosing this option than for doing nothing. These results provide a first step toward a new field of Moral HRI, which is well placed to help guide the design of social robots.
@inproceedings{malleSacrificeOneGood2015,
	address = {New York, NY, USA},
	series = {{HRI} '15},
	title = {Sacrifice {One} {For} the {Good} of {Many}?: {People} {Apply} {Different} {Moral} {Norms} to {Human} and {Robot} {Agents}},
	isbn = {978-1-4503-2883-8},
	shorttitle = {Sacrifice {One} {For} the {Good} of {Many}?},
	url = {http://doi.acm.org/10.1145/2696454.2696458},
	doi = {10.1145/2696454.2696458},
	abstract = {Moral norms play an essential role in regulating human interaction. With the growing sophistication and proliferation of robots, it is important to understand how ordinary people apply moral norms to robot agents and make moral judgments about their behavior. We report the first comparison of people's moral judgments (of permissibility, wrongness, and blame) about human and robot agents. Two online experiments (total N = 316) found that robots, compared with human agents, were more strongly expected to take an action that sacrifices one person for the good of many (a "utilitarian" choice), and they were blamed more than their human counterparts when they did not make that choice. Though the utilitarian sacrifice was generally seen as permissible for human agents, they were blamed more for choosing this option than for doing nothing. These results provide a first step toward a new field of Moral HRI, which is well placed to help guide the design of social robots.},
	booktitle = {Proceedings of the {Tenth} {Annual} {ACM}/{IEEE} {International} {Conference} on {Human}-{Robot} {Interaction}},
	publisher = {ACM},
	author = {Malle, Bertram F. and Scheutz, Matthias and Arnold, Thomas and Voiklis, John and Cusimano, Corey},
	year = {2015},
	keywords = {Human-robot interaction, machine morality, moral psychology, robot ethics},
	pages = {117--124},
}

Downloads: 0