Facebook uses AI to help the blind ‘see’ images

facebook ai image reader for blind on blue
Facebook uses AI to read image descriptions for blind people
Facebook is ready to help blind people ‘see’ images via artificial intelligence. The new feature, called automatic alternate text, works with existing screen reader apps used by blind and visually impaired people. The AI-generated descriptions identify objects and scenes but there is no facial recognition –although we can imagine it’s on the way. So you if you share an image with A visually impaired friend it won’t tell him or her who is in the picture or what everyone is wearing, but it might read “Image may contain: three people, smiling, birthday cake.”

There are more than 246 million people around the world with severe visual impairments and 39 million who are blind, according to Facebook. More than 2 billion photos are shared daily on Facebook, Instagram, Messenger, and WhatsApp. Automatic alternate text can help social media be more inclusive.

Facebook’s automatic alternate text introduction follows Twitter’s announcement last week of a 420 image character description field also intended for visually impaired people who use screen readers with mobile devices. With the Twitter app the person who composes the Tweet also writes the description. The Facebook feature automatically attempts to describe the image, with the disclaimer “Image may contain.” Of course, a Facebook post creator has plenty of space to describe images already, while Twitter limits regular text to just 140 characters. In each case blind and visually impaired people get less of a raw deal.

Facebook’s automatic alternate text feature is available now for people who use iOS devices in English in the U.S., U.K., Canada, Australia, and New Zealand. The company plans to support more platforms, languages, and market in the near future.

The accuracy of Facebook’s automatic alternate text feature matters and will likely improve over time.

We imagine that facial recognition is already on the planning board. On the other hand, perhaps it’s better not to attempt to identify people in photos Until the tech is flawless. Imagine if a Facebook screen reader misidentified and called out the wrong names. In some circumstances that could be pretty embarrassing.

Emerging Tech

New brainwave reader tells teachers if students are concentrating

Massachusetts-based startup BrainCo has developed brainwave-reading headbands which can reportedly help reveal if students are concentrating in class. Here's how they're being used.
Computing

Changing a PDF into an EPUB file is easier than you might think

If you like to read on a tablet or ebook reader, you'll find that ePUB files offer a number of advantages over PDFs. With this guide, we'll show you how to convert a PDF to EPUB in a few quick steps.
Photography

Starting your very own vlog? Here are the best cameras to buy

Any camera that shoots video can be used to vlog, but a few models stand out from the crowd thanks to superior image quality, ergonomics, and usability. When it comes to putting your life on YouTube, here are the best cameras for the job.
Emerging Tech

Face-scanning A.I. can help doctors spot unusual genetic disorders

Facial recognition can unlock your phone. Could it also be used to identify whether a person has a rare genetic disorder, based on their facial features? New research suggests it can.
Photography

Going somewhere? Capture more than your phone can with the best travel cams

Hitting the road or doing some globetrotting this year? Bring along the right camera to capture those once-in-a-lifetime vacation memories. Here's a list of some of our current favorites.
Photography

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.
Photography

Authentic, holistic, retro photography is in: Here are 2019’s predicted trends

What types of imagery are we most drawn to? According to recent stock photography data from Adobe, StoryBlocks, and Shutterstock, authentic, holistic, and humanitarian content will be in high demand in 2019.
Photography

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.
Photography

This A.I.-powered camera follows the action to produce epic selfie videos

Want to capture more epic action selfies? The Obsbot Tail is a camera-gimbal combo that uses artificial intelligence to follow the action. Using a handful of different modes, the camera works to keep the action in the frame.
Photography

Sony crams its best camera tech into the new $900 A6400

Love Sony's autofocus, but can't stomach the full-frame price? The Sony A6400 mirrorless camera uses some of the same autofocus technology and the processor of the A9 in a compact, more affordable crop-sensor camera.
Photography

These point-and-shoot cameras make your smartphone pics look like cave paintings

If your smartphone camera just isn't giving you the results you're looking for, maybe it's time to step up your game. The latest and greatest point-and-shoot cameras offer large sensors, tough bodies, and long lenses -- something no phone…
Photography

GoPro bumps resolution on Fusion 360 cam to 5.6K with new firmware

Currently available in public beta, Fusion firmware version 2.0 offers a new 5.8K mode that results in 5.6K output when the 360 camera's two hemispheres are stitched together. It also adds support for 24 fps video and RAW time-lapse…
Photography

With 5-stop optical stabilization, Fujifilm GF 100-200mm is ready for adventure

Fujifilm revealed a new lens designed to deliver on the GFX system's promise of adventure-ready medium-format photography. The GF 100-200mm F5.6 R is a weather resistant, relatively lightweight, 2x telephoto with impressive stabilization.
Photography

Olympus teaser shares glimpse of OM-D camera that’s good for more than sports

Is Olympus about to release a new mirrorless camera geared toward sports photographers? The latest teaser offers a glimpse of an upcoming OM-D camera set to launch on January 24, and by the looks of the teasers, it's capable for landscapes…