Attributions of intent and moral responsibility to AI agents

Abstract

Moral transactions are increasingly infused with decision input from AI agents. To what extent do observers believe that AI agents are responsible for their own actions? How do these AI agents' socio-psychological features affect observers' judgment of them when they transgress? With full factorial, between-participant designs, we presented participants with vignettes in which an AI agent contributed to a negative outcome either intentionally or unintentionally. We independently manipulated four features of the agent's mind: its adherence to moral values, autonomy, emotional self-awareness, and social connectedness. In Study 1 ( N = 2012), AI agents that intentionally contributed to a negative outcome consistently received harsher judgments than AI agents that contributed unintentionally. For unintentional actions, socially connected AI agents received less harsh judgments than socially disconnected AI agents. In Studies 2a-c ( N = 1507), these judgments were explained by ratings of the socially connected AI agent's ‘mind’ as less distinct from the mind of its programmers (Study 2b) and that this kind of agent also possessed less free will (Study 2c). We discuss the implications of these findings in advancing the field's understanding of the moral psychology—and design—of AI agents. • Moral judgments of AI agents are sensitive to the agents' manipulated intentionality. • AI agents contributing intentionally to negative outcomes received harsher judgments. • AI agents embedded in a human social network received more lenient judgments. • Socially connected AI agents are rated as possessing less free will. • Socially connected AI agents' ‘minds’ are rated as less distinct entities.

Topics & Concepts