How humans judge machines

Sign up for our newsletter, Artificiality, to get our latest AI insights delivered directly to your email inbox.

As AI diffuses through everything and deployed on a micro scale with multiple, small interactions, understanding how humans judge machine decisions before systems are designed will be an important skill and step in the process.

Humans judge machines according to a simple principle:

people judge humans by their intentionspeople judge machines by their consequences

The implications of this principle are far reaching. It means that people using AI need to be able to intuit the human intent behind it. It means that humans are forgiven for mistakes, as long as their intentions are good, while machines are not forgiven if a decision results in an unfair outcome, even if this outcome was accepted as possible right from the outset.

Because humans attribute agency (and therefore, a degree of intent) to anything that is "active," mental models of how people understand the intent of the machine and the humans behind it are just as important as anticipating consequences.

For AI de...

- - - - -


The rest of this post is available for our Pro Members. Please login if you're a member. And, if you're not, subscribe now to get access to all of our Pro Member content!

Subscribe here.

Email us with any questions.



At Sonder Scheme, we are on a mission to help humans win in the age of AI. We have created a human-centered AI design system that allows leading companies to create AI in an inclusive way. Companies like The New York Times, Starbucks, R/GA, Galp and the National Headstart Association tap us for engaging presentations at team/executive forums, in-depth workshops or long-term learning journeys. We support them with executive coaching and online access to our design system and up-to-the-minute insights into the frontiers of AI technology and ethics.

Share on email
Share on facebook
Share on linkedin
Share on twitter
Scroll to Top