Facial recognition has a race problem — here’s how Gyfcat is fixing that

facial recognition gyfcat race fbi face mugshot 970x644g
National Institutes of Health
A couple years back, Google was embarrassed when its algorithms incorrectly labeled a black couple as “gorillas.” Unable to stop its image-recognition algorithms working in this way, Google recently “fixed” its them by removing “gorilla” as a classification altogether.

The maker of smart GIF search engine Gfycat recently took on a similar problem — but unlike Google, it did it in a way that didn’t just remove the image identification feature to pretend there was no problem. By training its image recognition on non-white faces, it has been able to develop facial-recognition software that is far better than its rivals at recognizing non-white individuals, specifically those of East Asian descent.

“We wanted to make sure we had content that appealed to East Asian consumers since they make up a big segment of our creators and users,” Richard Rabbat, CEO of Gfycat, told Digital Trends. “We were seeing a ton of K-pop content on our site, for instance. However, when we looked at our facial-recognition results for Asian celebrities, the open-source facial recognition A.I. we use mislabelled Asian celebrities far more often than it did white celebrities. This problem is incredibly common within facial-recognition A.I., and it usually means that the training data didn’t contain enough faces of people of color.”

After discovering that its existing facial-recognition project was unable to even to recognize iconic Asian actor Jackie Chan, Rabbat realized something needed to be done. “After we identified its limitations with the detection of Asian celebrities, we modified it heavily and retrained it to be much more accurate at recognizing Asian faces with a much higher threshold of certainty,” he said.

Having focused heavily on training the algorithm with images of people from East Asia, the system — which has 15,000 GIFs uploaded each day — is now able to differentiate between actresses Lucy Liu and Constance Wu. It was not previously able to do this.

As Rabbat points out, correctly identifying celebrities in GIFs isn’t a serious problem, but this issue is indicative of a much larger problem. “A.I. facial recognition is becoming increasingly important in day-to-day life,” he said. “It’s important that companies think about the impact that their technology has on society. Tech companies can invest more in making sure their technology is inclusive and addresses diversity on day one. We don’t think we can rely on A.I. initiatives by people of color to correct this problem. A.I. right now is dominated by tech giants, and those giants need to make sure they’re creating responsible products.”

Emerging Tech

Rise of the Machines: Here’s how much robots and A.I. progressed in 2018

2018 has generated no shortage of news, and the worlds of A.I. and robotics are no exception. Here are our picks for the most exciting, game changing examples of both we saw this year.
Photography

Forget painting-style transfers, this A.I. creates realistic portraits of fake people

Do these images look computer-generated? Nvidia researchers recently published a paper on a new variation on style transfer artificial intelligence that's able to generate entirely new portraits.
Smart Home

Ring, Amazon’s smart doorbell maker, explores technology that alerts police

Smart doorbells have been using facial-recognition technology to mark friends and family but a pair of patents filed by Ring could lead to doorbells that automatically identify suspicious persons and notify police.
Mobile

Midrange phones can’t do A.I., but MediaTek’s P90 chip aims to change that

MediaTek has announced the Helio P90 mobile processor, which it says will bring the best A.I. features we see on high-end smartphones, to the mid-range. We spoke to the company about the chip.
Emerging Tech

Researchers create a flying wireless platform using bumblebees

Researchers at the University of Washington have come up with a novel way to create a wireless platform: using bumblebees. As mechanical drones' batteries run out too fast, the team made use of a biology-based solution using living insects.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Booze-filled ski poles and crypto piggy banks

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Meet the MIT scientist who’s growing semi-sentient cyborg houseplants

Elowan is a cybernetic plant that can respond to its surroundings. Tethered by a few wires and silver electrodes, the plant-robot hybrid can move in response to bioelectrochemical signals that reflect the plant’s light demands.
Emerging Tech

Bright ‘hyperactive’ comet should be visible in the sky this weekend

An unusual green comet, 46P/Wirtanen, will be visible in the night sky this month as it makes its closest approach to Earth in 20 years. It may even be possible to see the comet without a telescope.
Emerging Tech

Gorgeous images show storms and cloud formations in the atmosphere of Jupiter

NASA's Juno mission arrived at Jupiter in 2016 and has been collecting data since then. NASA has shared an update on the progress of the mission as it reaches its halfway point, releasing stunning images of the planet as seen from orbit.
Emerging Tech

Beautiful image of young planets sheds new light on planet formation

Researchers examining protoplanetary disks -- the belts of dust that eventually form planets -- have shared fascinating images of the planets from their survey, showing the various stages of planet formation.
Emerging Tech

Delivery robot goes up in flames while out and about in California

A small meal-delivery robot suddenly caught fire in Berkeley, California, on Friday. The blaze was quickly tackled and no one was hurt, but the incident is nevertheless a troubling one for the fledgling robot delivery industry.
Emerging Tech

High-tech dancing robot turns out to be a guy in a costume

A Russian TV audience was impressed recently by an adult-sized "robot" that could dance and talk. But when some people began pointing out that its actions were a bit odd, the truth emerged ... it was a fella in a robot suit.
Emerging Tech

MIT’s smart capsule could be used to release drugs in response to a fever

Researchers have developed a 3D-printed capsule which can monitor patients' vital signs, transmit this information to a connected device, and release drugs in response to symptoms.
Emerging Tech

‘Crop duster’ robot is helping reseed the Great Barrier Reef with coral

In a world first, an undersea robot has delivered microscopic coral larvae to the Great Barrier Reef. Meet Larvalbot: the robot "crop duster" which dispenses coral babies on troubled reefs.