Skip to main content

Facebook utilizes Instagram photos and hashtags to create a smarter A.I.

Image-recognition programs are trained using databases of millions of photographs manually tagged in order to teach the computer to spot different objects. But Facebook has an interesting database of images already at its fingertips: Instagram. During the F8 conference, the social media giant shared how the company trained an artificial intelligence image recognition system by using a combination of public Instagram photos and hashtags.

Labeling an image manually to build a database of millions of photos is a time-consuming process, particularly when getting down to the specific details like a species of a bird rather than just labeling “bird.” Facebook researchers instead decided to see if they could make an existing, already labeled set of images work by using publicly shared Instagram images and their accompanying hashtags.

Recommended Videos

The problem, of course, is that hashtags don’t always detail what is in the photo. While some users may hashtag the breed of dog in the photograph, any A.I. system would also have to sift through hashtags like #tbt (Throwback Thursday) or hashtags with multiple meanings. Facebook calls these irrelevant or non-specific hashtags “incoherent label noise.”

Please enable Javascript to view this content

To break through the noise, Facebook designed an A.I. to supervise the hashtags — essentially, designing an A.I. to then use that to create another A.I. The research group built a hashtag prediction model and then limited the training program to a specific list of hashtags.

The most accurate image recognition system to come from the experiment used a list of 1,500 hashtags and trained on a billion Instagram photos, ending up with an 85.4 percent accuracy rate — a rating that Facebook says is two percent higher than earlier advanced models. That system was more accurate than the model trained with 17,000 hashtags, which led the team to conclude that narrowing the focus of the training data leads to a more accurate image recognition system.

Facebook plans to continue using a similar idea to create more specific computer vision that is able to recognize types of trees, flowers, and birds. A more accurate image recognition system could be used to boost Facebook’s existing program that reads the content of images to the visually impaired, for example. 

Facebook plans to release the training model embeddings as open source for further expansion.

While the access to Instagram’s large datasets could help create more accurate image recognition in less time, others are raising privacy questions. Facebook said only public Instagram images were used in the research.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
I paid Meta to ‘verify’ me — here’s what actually happened
An Instagram profile on an iPhone.

In the fall of 2023 I decided to do a little experiment in the height of the “blue check” hysteria. Twitter had shifted from verifying accounts based (more or less) on merit or importance and instead would let users pay for a blue checkmark. That obviously went (and still goes) badly. Meanwhile, Meta opened its own verification service earlier in the year, called Meta Verified.

Mostly aimed at “creators,” Meta Verified costs $15 a month and helps you “establish your account authenticity and help[s] your community know it’s the real us with a verified badge." It also gives you “proactive account protection” to help fight impersonation by (in part) requiring you to use two-factor authentication. You’ll also get direct account support “from a real person,” and exclusive features like stickers and stars.

Read more
Here’s how to delete your YouTube account on any device
How to delete your YouTube account

Wanting to get out of the YouTube business? If you want to delete your YouTube account, all you need to do is go to your YouTube Studio page, go to the Advanced Settings, and follow the section that will guide you to permanently delete your account. If you need help with these steps, or want to do so on a platform that isn't your computer, you can follow the steps below.

Note that the following steps will delete your YouTube channel, not your associated Google account.

Read more
How to download Instagram photos for free
Instagram app running on the Samsung Galaxy Z Flip 5.

Instagram is amazing, and many of us use it as a record of our lives — uploading the best bits of our trips, adventures, and notable moments. But sometimes you can lose the original files of those moments, leaving the Instagram copy as the only available one . While you may be happy to leave it up there, it's a lot more convenient to have another version of it downloaded onto your phone or computer. While downloading directly from Instagram can be tricky, there are ways around it. Here are a few easy ways to download Instagram photos.

Read more