Amazon’s facial ID incorrectly identifies members of Congress as criminals

Congress members want a meeting with Jeff Bezos to discuss Rekognition mistakes

amazon rekognition confuses congress criminals
ACLU

Amazon may want to go back to the drawing board for this one. A facial recognition tool the retail giant currently offers developers made quite the mistake in a test conducted by the American Civil Liberties Union (ACLU), The New York Times reports. Rather than identifying 28 members of Congress as members of the country’s legislative branch, the tool instead classified these individuals as police suspects. To make matters worse, a disproportionate number of African-American and Latino Congress members were incorrectly identified, raising questions of how far racial profiling has embedded itself even in our machine learning software.

Now, Congress wants answers. Five of the misidentified lawmakers are requesting an “immediate” meeting with Amazon CEO Jeff Bezos. On Thursday, July 26, Reps. Jimmy Gomez, John Lewis, Luis Gutierrez, and Mark DeSaulnier, as well as Sen. Edward Markey, sent letters to the online retail giant asking why they were mismatched. But beyond the personal effects of these cases of mistaken identity, the congressmen are asking for answers as to “how to address the defects of this technology in order to prevent inaccurate outcomes.”

Amazon has not indicated yet whether its chief executive will accept these meetings.

In a separate statement, Rep. G.K. Butterfield noted, “I am troubled by the inaccurate outcomes associated with this technology, as there are clear blind spots that will have unintended consequences specifically for people of color. While this technology could have far-reaching economic potential, I encourage Amazon to better train its users on best practices for using this technology, be open and up-front about its limitations, and hire more employees of color who can properly assist with addressing the defects of this technology.”

Among the misidentified lawmakers were Reps. John Lewis and Bobby Rush, both of whom are well-known civil rights leaders and members of the Congressional Black Caucus. But instead of being recognized as elected representatives, these two men (along with 26 others), were falsely flagged as criminals. These mistakes occurred when the ACLU took Amazon’s software to analyze images of all members of Congress against a database of 25,000 publicly accessible mugshots. This resulted in the 28 Congress members being incorrectly identified as lawbreakers, which represents a 5 percent error rate.

amazon rekognition confuses congress criminals racial bias
ACLU

“This test confirms that facial recognition is flawed, biased, and dangerous,” Jacob Snow, a technology and civil liberties lawyer with the ACLU of Northern California, told The New York Times.

In response to the test, Nina Lindsey, an Amazon Web Services spokeswoman, said that the ACLU used the face matching tool (called Amazon Rekognition) differently from Amazon’s recommendations. “It is worth noting that in real-world scenarios, Amazon Rekognition is almost exclusively used to help narrow the field and allow humans to expeditiously review and consider options using their judgment,” Lindsey said in a statement.

She further pointed out that the ACLU kept the tool’s “confidence threshold” at the default of 80 percent. This means that the group took into account any face matched as 80 percent similar to the police database. However, it’s worth pointing out that Amazon uses the same threshold in an example on its website, showing how employees’ faces can be matched with their ID badges. Lindsey said that in the case of police departments, Amazon recommends that a threshold of 95 percent similarity be implemented to avoid these sorts of mistakes.

amazon rekognition confuses congress criminals scan
Rep. Sanford Bishop (D-Ga.) was falsely identified by Amazon Rekognition as someone who had been arrested for a crime. ACLU

Amazon has previously come under fire for selling Rekognition. In May, 24 civil liberties groups, led by the ACLU, penned a letter to Amazon’s CEO Jeff Bezos requesting that the software cease being sold to law enforcement agencies. The groups expressed concerns that the software could be used to surveil protestors, immigrants, or general members of the public, rather than just police suspects. Amazon employees, investors, and academics have since made similar demands of Amazon.

For the time being, however, that doesn’t seem to be in the cards for the web giant. As Amazon’s spokesperson said, “We remain excited about how image and video analysis can be a driver for good in the world.”

Updated on July 27: Congress is demanding answers from Amazon regarding the mistakes made by its Rekognition software. 

Mobile

Rekindled yet again, Nokia’s next-gen phones offer more than just nostalgia

HMD Global, a startup that designs and builds Nokia Android smartphones, wants to put the Nokia brand name back “where it belongs.” It helps that it’s made up of ex-Nokia employees. We go behind the scenes to see how HMD formed.
Home Theater

What’s new on Amazon Prime Video (February 2019)

Amazon Prime Video adds new titles each month that are available for free to all Prime members. Check out our list to find all the content hitting Amazon Prime Video in January and February, from new original series to classic films.
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Norsemen’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Emerging Tech

Why wait? Here are some CES 2019 gadgets you can buy right now

Companies come to CES to wow us with their cutting edge technology, but only a few products are slated to hit the market right away. Here is our list of the best CES 2019 tech you can buy right now.
Emerging Tech

Drones: New rules could soon allow flights over people and at night

With commercial operators in mind, the U.S. government is looking to loosen restrictions on drone flights with a set of proposals that would allow the machines greater freedom to fly over populated areas and also at night.
Emerging Tech

Short film celebrates New Yorker’s amazing robot costumes

New York City resident Peter Kokis creates stunning robot costumes out of household trash. His designs are huge, heavy, and extremely intricate, and never fail to turn heads when he's out and about.
Emerging Tech

Yamaha’s new app lets you tune your motorcycle with a smartphone

It used to be that if you wanted to tune your motorcycle’s engine and tweak its performance, you needed specialized tools and even more specialized knowledge. Yamaha’s new Power Tuner app changes that.
Emerging Tech

In a first for humankind, China is growing plants on the moon

Having recently landed a probe on the far side of the moon, China announced that it managed to grow the first plant on the moon, too. Here's why that matters for deep space travel.
Emerging Tech

Ford’s sweaty robot bottom can simulate 10 years of seat use in mere days

Ford has developed 'Robutt,' a sweaty robot bottom that's designed to simulate the effects of having a pair of human buttocks sitting on its car seats for thousands of hours. Check it out.
Emerging Tech

CES 2019 recap: All the trends, products, and gadgets you missed

CES 2019 didn’t just give us a taste of the future, it offered a five-course meal. From 8K and Micro LED televisions to smart toilets, the show delivered with all the amazing gadgetry you could ask for. Here’s a look at all the big…
Emerging Tech

Want to know which drones are flying near you? There’s an app for that

Want to know what that mysterious drone buzzing over your head is up to? A new system developed by AirMap, Google Wing, and Kittyhawk.io could soon tell you -- via a map on your phone.
Emerging Tech

A Japanese hotel fires half its robot staff for being bad at their jobs

Japan’s oddball Henn na Hotel has fired half of its 243 robot staff. The reason? Because these labor-saving machines turned out to be causing way more problems than they were solving.
Emerging Tech

CERN plans to build a massive particle collider that dwarfs the LHC

CERN already has the world's biggest particle accelerator. Now it wants a bigger one. Meet the 9 billion euro Future Circular Collider that will allow physicists to extend their study of the universe and matter at the smallest level.
Emerging Tech

Forget fireworks. Japan will soon have artificial meteor showers on tap

Tokyo-based startup Astro Live Experiences is preparing to launch its first artificial meteor shower over Japan, serving as a showcase of its prowess in the space entertainment sector.