Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction

An organization can give control to an automated system while leaving a nominal human nearby. When the system fails, responsibility may collapse onto that person, who had little power to prevent the failure.

Elish calls this the moral crumple zone: the human operator absorbs the moral and legal impact, preserving the integrity of the larger system. The machine keeps its job.