Skip to main content

Facebook 3D Photos no longer requires Portrait mode on dual-camera phones

Facebook turned to artificial intelligence so that its 3D Photos feature will no longer require the use of Portrait mode on dual-camera smartphones.

Facebook’s 3D Photos, first revealed at the 2018 F8 developer conference and rolled out a few months later, utilizes the capabilities of dual-camera setups to create images with depth and movement when the smartphone is tilted. While any mobile device is capable of viewing the 3D Photos, the effect could only be created by phones with a Portrait mode.

In a blog post, Facebook said that single-camera smartphones will now be able to make 3D Photos through A.I. that produces 3D images from standard 2D pictures. The system is capable of inferring the 3D structure of any image, whether it was just taken with the smartphone’s camera or if it was taken years ago. This also enables 3D selfies, made with images taken with single front-facing cameras.

Facebook trained a neural network that can estimate the distance from the camera for each pixel, which eliminates the need for the second camera. The A.I. needed to overcome technical challenges that include correctly inferring the position of a wide variety of subject matter, as well as optimizing the system so that mobile devices will be able to complete the process in just a fraction of a second.

In order to overcome the challenges, Facebook said that it trained the neural network on millions of public 3D images and their corresponding depth maps while utilizing various mobile optimization techniques that have previously been developed by Facebook A.I.

The next step in the application of the technology is on videos, though that presents the challenge of consistent frame depths for a seamless transition into 3D effects. However, once Facebook figures this out, it will enable a whole new kind of content that creators can share on the social network.

Facebook’s advancements in 3D Photos are similar to the efforts of LucidPix, an A.I. app teased during CES 2020 that converts 2D pictures into 3D images. During the showcase in January, LucidPix was in beta with more than 250,000 testers and was looking to launch in the second quarter of this year for iOS and Android.

Editors' Recommendations

Aaron Mamiit
Aaron received a NES and a copy of Super Mario Bros. for Christmas when he was 4 years old, and he has been fascinated with…
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
Super Mario 3D World + Bowser’s Fury trailer reveals wild new game mode
Super Mario 3D World + Bowser's Fury

Nintendo released a new trailer for Super Mario 3D World + Bowser's Fury, which finally reveals information on the re-release's new mode. Bowser's Fury is an entirely new adventure that features a gigantic Bowser.

Super Mario 3D World + Bowser's Fury is a Nintendo Switch version of the 2013 Wii U game Super Mario 3D World. Nintendo previously revealed that the new edition would feature something called Bowser's Fury, but this is the first time the mode has been shown in any form.

Read more
Qualcomm’s long-awaited second-gen 3D Sonic fingerprint sensor is 50% faster
qualcomm 3d sonic sensor second generation ces 2021 2nd gen

Qualcomm wants to make its in-display fingerprint sensor a little bit more seamless. Its first-generation Sonic Sensor was introduced a few years ago, and at the time offered a decent experience -- but since then, has been overtaken in terms of speed and performance by competing optical sensors. Now, Qualcomm has finally launched a new, second-generation 3D Sonic sensor with big improvements.

The new sensor is 77% larger than Qualcomm's original 3D Sonic Sensor, measuring in at 8mm square, compared to the original's 4mm by 9mm. In other words, you'll be able to place your finger on a larger portion of the screen, making the overall experience a little more seamless.

Read more