Skip to main content

Facebook photos just got smarter with new ‘autotags’ for easier searches

facebook journalism grants login smartphone
Image used with permission by copyright holder
Facebook’s auto tagging feature was already impressive — but now the social media network will recognize that the photo you just uploaded is at the Golden Gate Bridge, that you’re wearing a black shirt, and whether or not you are walking, dancing, or perhaps riding a horse.

Today, Joaquin Candela, the network’s director of applied machine learning, shared a blog post detailing how Facebook can now recognize not just the objects in your photographs, but scenes and actions, too, even on posts shared without a single word.

Lumos is the artificially intelligent program that allows the computer to “see” what’s inside the image you just shared, even if you didn’t give it any sort of text description. That machine learning system is behind a number of Facebook’s image-recognition features, from flagging nudity to fighting spam.

Today, that system is getting an upgrade with the ability to recognize actions, not just objects. The network’s automatic alt text, used for describing a photo to the visually impaired, will now recognize 12 different actions, from walking and dancing to actions that can be described by a verb with a noun tacked at the end — like riding a horse or playing an instrument.

While the program stemmed from, and still continues to work toward, giving the visually impaired a better idea of what’s in their newsfeed, the same technology will now allow any Facebook user to search for an image of a particular place, action, or even a particular garment like a black shirt or red dress. While photos with a description may have popped up in the search results previously, the new action-tagging gives the search more accuracy even for photos that were uploaded without any relevant text.

Lumos is a machine learning program, which means that the more photos it labels and the more details the team feeds it, the more accurate those photo labels become. Facebook’s machine learning team taught the program to recognize actions by asking humans to label 130,000 actual Facebook photos. Feeding those descriptions into the machine learning program “taught” the system how to identify actions.

Searching for a particular object or action and then clicking on the “photos” tab in the search results will now display relevant searches from your own newsfeed as well as friends and public images, using the images tagged with the machine learning, not just accompanying captions.

Candela says that the idea will also advance into automatically labeling videos in the future. “While these new developments are noteworthy, we have a long and exciting road ahead and are just scratching the surface of what is possible with a self-serve computer vision platform,” he wrote. “With computer vision models getting pixel perfect and Facebook advancing into video and other immersive formats, Lumos will help unlock new possibilities in a reliable, fast, and scaleable way and pave the road for richer product experiences in the near future.”

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
New bill would make it easier for you to get off Facebook once and for all
Josh Hawley

A new bipartisan bill announced on Tuesday, October 22, aims at making it easier for you to transfer your social media data to other social media platforms, so you might finally be able to get off of Facebook and other social media sites. 

Called the Access Act, the bill applies to online platforms with products or services that have over 100 million monthly active users, according to CNBC. Platforms like Facebook, Facebook Messenger, Instagram, and YouTube would be included based on the criteria.

Read more
How to make a GIF from a YouTube video
woman sitting and using laptop

Sometimes, whether you're chatting with friends or posting on social media, words just aren't enough -- you need a GIF to fully convey your feelings. If there's a moment from a YouTube video that you want to snip into a GIF, the good news is that you don't need complex software to so it. There are now a bunch of ways to make a GIF from a YouTube video right in your browser.

If you want to use desktop software like Photoshop to make a GIF, then you'll need to download the YouTube video first before you can start making a GIF. However, if you don't want to go through that bother then there are several ways you can make a GIF right in your browser, without the need to download anything. That's ideal if you're working with a low-specced laptop or on a phone, as all the processing to make the GIF is done in the cloud rather than on your machine. With these options you can make quick and fun GIFs from YouTube videos in just a few minutes.
Use GIFs.com for great customization
Step 1: Find the YouTube video that you want to turn into a GIF (perhaps a NASA archive?) and copy its URL.

Read more
I paid Meta to ‘verify’ me — here’s what actually happened
An Instagram profile on an iPhone.

In the fall of 2023 I decided to do a little experiment in the height of the “blue check” hysteria. Twitter had shifted from verifying accounts based (more or less) on merit or importance and instead would let users pay for a blue checkmark. That obviously went (and still goes) badly. Meanwhile, Meta opened its own verification service earlier in the year, called Meta Verified.

Mostly aimed at “creators,” Meta Verified costs $15 a month and helps you “establish your account authenticity and help[s] your community know it’s the real us with a verified badge." It also gives you “proactive account protection” to help fight impersonation by (in part) requiring you to use two-factor authentication. You’ll also get direct account support “from a real person,” and exclusive features like stickers and stars.

Read more