Skip to main content

Facebook 3D Photos no longer requires Portrait mode on dual-camera phones

Facebook turned to artificial intelligence so that its 3D Photos feature will no longer require the use of Portrait mode on dual-camera smartphones.

Facebook’s 3D Photos, first revealed at the 2018 F8 developer conference and rolled out a few months later, utilizes the capabilities of dual-camera setups to create images with depth and movement when the smartphone is tilted. While any mobile device is capable of viewing the 3D Photos, the effect could only be created by phones with a Portrait mode.

In a blog post, Facebook said that single-camera smartphones will now be able to make 3D Photos through A.I. that produces 3D images from standard 2D pictures. The system is capable of inferring the 3D structure of any image, whether it was just taken with the smartphone’s camera or if it was taken years ago. This also enables 3D selfies, made with images taken with single front-facing cameras.

Facebook trained a neural network that can estimate the distance from the camera for each pixel, which eliminates the need for the second camera. The A.I. needed to overcome technical challenges that include correctly inferring the position of a wide variety of subject matter, as well as optimizing the system so that mobile devices will be able to complete the process in just a fraction of a second.

In order to overcome the challenges, Facebook said that it trained the neural network on millions of public 3D images and their corresponding depth maps while utilizing various mobile optimization techniques that have previously been developed by Facebook A.I.

The next step in the application of the technology is on videos, though that presents the challenge of consistent frame depths for a seamless transition into 3D effects. However, once Facebook figures this out, it will enable a whole new kind of content that creators can share on the social network.

Facebook’s advancements in 3D Photos are similar to the efforts of LucidPix, an A.I. app teased during CES 2020 that converts 2D pictures into 3D images. During the showcase in January, LucidPix was in beta with more than 250,000 testers and was looking to launch in the second quarter of this year for iOS and Android.

Editors' Recommendations

Aaron Mamiit
Aaron received a NES and a copy of Super Mario Bros. for Christmas when he was 4 years old, and he has been fascinated with…
How to disable 3D and Haptic Touch in iOS
An example of 3D Touch on an iPhone.

In 2015, when Apple launched the iPhone 6S, it also debuted a new iOS interface called 3D Touch. This feature uses the iPhone's pressure-sensitive surface to help you view, navigate, and control some aspects of the device's apps and features. You could use it to call up an app's Quick Actions, preview notifications, operate actions from the Control Center, and "peek and pop" with certain apps without having to launch them.

3D Touch was used in the iPhone 6S, 7, 8, X, and XS models before being replaced by Haptic Touch, which responds only to a finger press's length. While some people could use 3D Touch to their advantage and profoundly miss it, others found it unintuitive at best and annoying at worst. This article explains how to disable 3D Touch on iPhones that have it and disable Haptic Touch.
How to disable 3D Touch and Haptic Touch

Read more
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
I have a mysterious problem with my iPhone 15 Pro Max
iPhone 15 Pro Max laying outside in a park.

There’s an issue with the iPhone I’d like Apple to fix, but I’m not quite sure what it will take to do so. I don't know if it’s a hardware or a software problem or even if I’ll always notice it if the issue has gone away.

It’s the battery life, but not necessarily the length of time the battery lasts on a charge. It’s more about battery life consistency, which is currently (and has been for some time) all over the place.
What’s the issue?

Read more