Skip to main content

It might save your life: MIT's Moral Machine asks you to answer moral dilemmas

mit moral machine google self driving car lexus
Image used with permission by copyright holder
We humans err and err often. If it is not a small mistake like leaving the keys in the fridge, then it is a deadly one like leaving the oven on all day. We tend to be reckless, forgetful, overconfident, easily distracted — dangerous traits when steering a two-ton, metal machine across lanes at 70 mph. Four out of the top five causes for car crashes are the result of human error.

Computers, on the other hand, have purely pragmatic minds. They sense data and react in programmed, calculated ways. Self-driving cars already seem to be safer than humans behind the wheel. The rate of progress in artificial intelligence over the past few years has some experts claiming that driving a car will be made illegal by 2030.

“Machine intelligence may have to deal with situations where someone has to die so someone else can live.”

But, as most drivers know, driving can require split-second decisions with no obvious right answer. A squirrel darts into the road — do you swerve and risk hitting other cars or drive straight and hope the squirrel survives. How would you react if a dog ran into the road? Or a criminal? Or a child? Which lives are worth risking? These questions are being asked by teams of researchers around the world. Now they are looking to you for answers.

“Self-driving cars are now practically inevitable,” Massachusetts Institute of Technology graduate student and research assistant Sohan Dsouza told Digital Trends. “That is a good thing, generally, because they would help save countless lives now being lost daily due to human driver error and can offer independent mobility to countless others who cannot drive.”

To that end, Dsouza, Edmond Awad, and their team at the MIT Media Lab developed Moral Machine, a platform that engages users in moral dilemmas and asks them how the self-driving car should respond. A handful of factors play into each scenario, including the age and gender of victims, their social status, and whether they are breaking the law. Participants are asked to make decisions in 13 dilemmas. The results then pooled as crowdsourced data and may one day be used to guide the development of ethical machines. After judging the dilemmas, users can compare their outcomes to others’ and even design their own for others to answer.

“One of our primary goals is provoking debate among the public,” Dsouza said, “and especially dialogue among users, manufacturers, insurers, and transport authorities.

“Not all crashes can be avoided, and the possibility remains that machine intelligence piloting vehicles may have to deal with situations where someone has to die so someone else can live — rather like the classic philosophical thought experiment known as the trolley problem.”

The trolley problem has been pondered for nearly 50 years. In it, a train car is en route to hit five people down the track. You have a switch that can steer the trolley down another set of tracks, where it will hit only one person. Would you intervene or do nothing?

Moral Machine

“There are very few experiment-based studies regarding this possibility,” Dsouza said. “Hence, we needed to create a platform that would be able to generate large numbers of multi-factor scenarios and present them to users in an easy-to-understand, easy-to-use, and engaging way, so as to build a model of how people perceive the morality of machine-made decisions.”

“One of our primary goals is provoking debate among the public.”

Moral Machine has gathered answers on more than 11 million scenarios so far. Although the team has yet to perform a deep analysis, they are noticing regional trends that hint at the rocky road ahead. “On average, respondents from western countries place a relatively higher value on minimizing the number of overall casualties — that is, they approve more utilitarian choices — compared to respondents from eastern countries,” Dsouza said.

Revealing these cultural discrepancies fosters debate and dialogue, which is essential to making progress. “We believe we have already made an impact,” Dsouza said. “This dialogue will eventually help the stakeholders in this scene reach an equilibrium of legislation, liability assessment, moral comfort, and public safety.”

Editors' Recommendations

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Rivian R2 vs R1S: How will Rivian’s cheaper SUV compare?
The front three-quarter view of a 2022 Rivian against a rocky backdrop.

Rivian has finally unveiled the R2, its long-awaited attempt at a more affordable electric SUV. The new vehicle may not be available just yet, but fans of Rivian's design aesthetics and feature set are already looking forward to being able to order the new car. The R2 is targeted at being a more affordable take on the electric SUV and will sit alongside the flagship-tier R1S.

Let's get this out of the way right now: The R1S is most likely going to be a better vehicle than the R2. Rivian isn't replacing the R1S with the R2 — it's releasing the R2 as a more affordable alternative, and there will be some compromises when buying the R2 over the R1S.

Read more
Cybertruck production reportedly halted over pedal issue
Tesla CEO Elon Musk behind the wheel of a Cybertruck.

Tesla CEO Elon Musk behind the wheel of a Cybertruck. Tesla

Tesla’s Cybertruck has been hit by a production delay caused by an issue with a part of the vehicle, a number of media reports have claimed.

Read more
Don’t let the gimmicks fool you. The Ioniq 5 N is a serious track car
2025 Hyundai Ioniq 5 N drifting.

We’re finally getting to the fun part of automakers’ methodical quest to replicate their lineups with electric cars.

Performance versions of ordinary cars have been a staple of the auto industry for decades. But while we’ve already seen some variants of EVs boasting more power and more impressive stats — think Tesla Model S Plaid or Lucid Air Sapphire — the 2025 Hyundai Ioniq 5 N is the first to truly apply that format to an EV.

Read more