Skip to main content

Facial recognition has a race problem — here’s how Gyfcat is fixing that

facial recognition gyfcat race fbi face mugshot 970x644g
National Institutes of Health
A couple years back, Google was embarrassed when its algorithms incorrectly labeled a black couple as “gorillas.” Unable to stop its image-recognition algorithms working in this way, Google recently “fixed” its them by removing “gorilla” as a classification altogether.

The maker of smart GIF search engine Gfycat recently took on a similar problem — but unlike Google, it did it in a way that didn’t just remove the image identification feature to pretend there was no problem. By training its image recognition on non-white faces, it has been able to develop facial-recognition software that is far better than its rivals at recognizing non-white individuals, specifically those of East Asian descent.

“We wanted to make sure we had content that appealed to East Asian consumers since they make up a big segment of our creators and users,” Richard Rabbat, CEO of Gfycat, told Digital Trends. “We were seeing a ton of K-pop content on our site, for instance. However, when we looked at our facial-recognition results for Asian celebrities, the open-source facial recognition A.I. we use mislabelled Asian celebrities far more often than it did white celebrities. This problem is incredibly common within facial-recognition A.I., and it usually means that the training data didn’t contain enough faces of people of color.”

After discovering that its existing facial-recognition project was unable to even to recognize iconic Asian actor Jackie Chan, Rabbat realized something needed to be done. “After we identified its limitations with the detection of Asian celebrities, we modified it heavily and retrained it to be much more accurate at recognizing Asian faces with a much higher threshold of certainty,” he said.

Having focused heavily on training the algorithm with images of people from East Asia, the system — which has 15,000 GIFs uploaded each day — is now able to differentiate between actresses Lucy Liu and Constance Wu. It was not previously able to do this.

As Rabbat points out, correctly identifying celebrities in GIFs isn’t a serious problem, but this issue is indicative of a much larger problem. “A.I. facial recognition is becoming increasingly important in day-to-day life,” he said. “It’s important that companies think about the impact that their technology has on society. Tech companies can invest more in making sure their technology is inclusive and addresses diversity on day one. We don’t think we can rely on A.I. initiatives by people of color to correct this problem. A.I. right now is dominated by tech giants, and those giants need to make sure they’re creating responsible products.”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Facial recognition tech for bears aims to keep humans safe
A brown bear in Hokkaido, Japan.

If bears could talk, they might voice privacy concerns. But their current inability to articulate thoughts means there isn’t much they can do about plans in Japan to use facial recognition to identify so-called "troublemakers" among its community.

With bears increasingly venturing into urban areas across Japan, and the number of bear attacks on the rise, the town of Shibetsu in the country’s northern prefecture of Hokkaido is hoping that artificial intelligence will help it to better manage the situation and keep people safe, the Mainichi Shimbun reported.

Read more
Hubble has a computer problem and it’s proving difficult to fix
The Hubble Space Telescope is deployed on April 25, 1990 from the space shuttle Discovery. Avoiding distortions of the atmosphere, Hubble has an unobstructed view peering to planets, stars and galaxies, some more than 13.4 billion light years away.

The Hubble Space Telescope is deployed on April 25, 1990, from the space shuttle Discovery. Avoiding distortions of the atmosphere, Hubble has an unobstructed view peering to planets, stars, and galaxies, some more than 13.4 billion light-years away. NASA/Smithsonian Institution/Lockheed Corporation

The beloved Hubble Space Telescope is experiencing a computer problem and is currently not collecting scientific data. NASA engineers are working on fixing the issue, but it's proving difficult to get the 30-year-old telescope operating as it should.

Read more
How the USPS uses Nvidia GPUs and A.I. to track missing mail
A United States Postal Service USPS truck driving on a tree-lined street.

The United States Postal Service, or USPS, is relying on artificial intelligence-powered by Nvidia's EGX systems to track more than 100 million pieces of mail a day that goes through its network. The world's busiest postal service system is relying on GPU-accelerated A.I. systems to help solve the challenges of locating lost or missing packages and mail. Essentially, the USPS turned to A.I. to help it locate a "needle in a haystack."

To solve that challenge, USPS engineers created an edge A.I. system of servers that can scan and locate mail. They created algorithms for the system that were trained on 13 Nvidia DGX systems located at USPS data centers. Nvidia's DGX A100 systems, for reference, pack in five petaflops of compute power and cost just under $200,000. It is based on the same Ampere architecture found on Nvidia's consumer GeForce RTX 3000 series GPUs.

Read more