Skip to main content

Facial recognition has a race problem — here’s how Gyfcat is fixing that

facial recognition gyfcat race fbi face mugshot 970x644g
National Institutes of Health
A couple years back, Google was embarrassed when its algorithms incorrectly labeled a black couple as “gorillas.” Unable to stop its image-recognition algorithms working in this way, Google recently “fixed” its them by removing “gorilla” as a classification altogether.

The maker of smart GIF search engine Gfycat recently took on a similar problem — but unlike Google, it did it in a way that didn’t just remove the image identification feature to pretend there was no problem. By training its image recognition on non-white faces, it has been able to develop facial-recognition software that is far better than its rivals at recognizing non-white individuals, specifically those of East Asian descent.

“We wanted to make sure we had content that appealed to East Asian consumers since they make up a big segment of our creators and users,” Richard Rabbat, CEO of Gfycat, told Digital Trends. “We were seeing a ton of K-pop content on our site, for instance. However, when we looked at our facial-recognition results for Asian celebrities, the open-source facial recognition A.I. we use mislabelled Asian celebrities far more often than it did white celebrities. This problem is incredibly common within facial-recognition A.I., and it usually means that the training data didn’t contain enough faces of people of color.”

After discovering that its existing facial-recognition project was unable to even to recognize iconic Asian actor Jackie Chan, Rabbat realized something needed to be done. “After we identified its limitations with the detection of Asian celebrities, we modified it heavily and retrained it to be much more accurate at recognizing Asian faces with a much higher threshold of certainty,” he said.

Having focused heavily on training the algorithm with images of people from East Asia, the system — which has 15,000 GIFs uploaded each day — is now able to differentiate between actresses Lucy Liu and Constance Wu. It was not previously able to do this.

As Rabbat points out, correctly identifying celebrities in GIFs isn’t a serious problem, but this issue is indicative of a much larger problem. “A.I. facial recognition is becoming increasingly important in day-to-day life,” he said. “It’s important that companies think about the impact that their technology has on society. Tech companies can invest more in making sure their technology is inclusive and addresses diversity on day one. We don’t think we can rely on A.I. initiatives by people of color to correct this problem. A.I. right now is dominated by tech giants, and those giants need to make sure they’re creating responsible products.”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Alt+Tab broken by Windows 10 update? Here’s how to fix it
Alt + Tab on Windows 10.

Alt + Tab is a reliable friend to many PC gamers, serving as one of the most useful shortcuts in Windows 10. However, a recent Windows 10 update seems to have broken the shortcut for some users. According to Windows Latest, switching between a game and the desktop will essentially lock some users to the desktop, preventing them from using Alt + Tab to get back into the game.

It seems like the issue applies to two Windows 10 updates. The first rolled out on July 29 (KB5004296), and users started posting about issues on Reddit immediately after its release. "Literally every ful-screen game that I try to play keeps getting minimized. I have done all the steps from various Google searches that have this issue, but I think the issue is this new update," one user wrote.

Read more
Facial recognition tech for bears aims to keep humans safe
A brown bear in Hokkaido, Japan.

If bears could talk, they might voice privacy concerns. But their current inability to articulate thoughts means there isn’t much they can do about plans in Japan to use facial recognition to identify so-called "troublemakers" among its community.

With bears increasingly venturing into urban areas across Japan, and the number of bear attacks on the rise, the town of Shibetsu in the country’s northern prefecture of Hokkaido is hoping that artificial intelligence will help it to better manage the situation and keep people safe, the Mainichi Shimbun reported.

Read more
Hubble has a computer problem and it’s proving difficult to fix
The Hubble Space Telescope is deployed on April 25, 1990 from the space shuttle Discovery. Avoiding distortions of the atmosphere, Hubble has an unobstructed view peering to planets, stars and galaxies, some more than 13.4 billion light years away.

The Hubble Space Telescope is deployed on April 25, 1990, from the space shuttle Discovery. Avoiding distortions of the atmosphere, Hubble has an unobstructed view peering to planets, stars, and galaxies, some more than 13.4 billion light-years away. NASA/Smithsonian Institution/Lockheed Corporation

The beloved Hubble Space Telescope is experiencing a computer problem and is currently not collecting scientific data. NASA engineers are working on fixing the issue, but it's proving difficult to get the 30-year-old telescope operating as it should.

Read more