Facebook 3D Photos no longer requires Portrait mode on dual-camera phones

By Aaron Mamiit Published April 25, 2023

Facebook turned to artificial intelligence so that its 3D Photos feature will no longer require the use of Portrait mode on dual-camera smartphones.

Recommended Videos

Facebook’s 3D Photos, first revealed at the 2018 F8 developer conference and rolled out a few months later, utilizes the capabilities of dual-camera setups to create images with depth and movement when the smartphone is tilted. While any mobile device is capable of viewing the 3D Photos, the effect could only be created by phones with a Portrait mode.

In a blog post, Facebook said that single-camera smartphones will now be able to make 3D Photos through A.I. that produces 3D images from standard 2D pictures. The system is capable of inferring the 3D structure of any image, whether it was just taken with the smartphone’s camera or if it was taken years ago. This also enables 3D selfies, made with images taken with single front-facing cameras.

Facebook trained a neural network that can estimate the distance from the camera for each pixel, which eliminates the need for the second camera. The A.I. needed to overcome technical challenges that include correctly inferring the position of a wide variety of subject matter, as well as optimizing the system so that mobile devices will be able to complete the process in just a fraction of a second.

In order to overcome the challenges, Facebook said that it trained the neural network on millions of public 3D images and their corresponding depth maps while utilizing various mobile optimization techniques that have previously been developed by Facebook A.I.

The next step in the application of the technology is on videos, though that presents the challenge of consistent frame depths for a seamless transition into 3D effects. However, once Facebook figures this out, it will enable a whole new kind of content that creators can share on the social network.

Facebook’s advancements in 3D Photos are similar to the efforts of LucidPix, an A.I. app teased during CES 2020 that converts 2D pictures into 3D images. During the showcase in January, LucidPix was in beta with more than 250,000 testers and was looking to launch in the second quarter of this year for iOS and Android.

Former Contributor

Aaron received an NES and a copy of Super Mario Bros. for Christmas when he was four years old, and he has been fascinated…

Topics

Phones

Xiaomi 18 Fold has me questioning what a compact phone should look like, or even cost

I love compact phones, but these wide foldables have me rethinking the whole concept now

Xiaomi 18 Fold at IFA 2026

The best part of my job is the access to some of the coolest gadgets, especially the latest and greatest smartphones. Even then, I often found myself gravitating towards compact phones. At this point, I'd even skip a premium foldable just so I could have something a little more handy.

But every now and then, a larger phone would have this one feature or show me why a bigger phone is still so popular. I also want to play games, watch videos, and occasionally keep two apps open without fighting for every inch of screen space. A smaller phone makes many parts of my life easier, but the compromises aren't nonexistent. Simply making the phone wider may solve those problems, but eventually it becomes harder to handle again.

Phones

Xiaomi’s latest foldable has me convinced this design is here to stay

The Xiaomi 18 Fold pairs an unusual wider design with a surprisingly large battery, homegrown silicon, and flagship cameras, all packed into a 219-gram body.

Electronics, Mobile Phone, Phone

September is becoming a very interesting month for foldable phones, and Xiaomi has just added another to the pile. The Xiaomi 18 Fold has launched in China with a shorter, wider shape that looks a little like a passport when closed. It’s quite a departure from the tall and narrow book-style foldables we’ve become used to, but Xiaomi isn't alone in thinking this might be the way forward.

Samsung already went down a similar road with the Galaxy Z Fold 8 in July, giving it a shorter, wider footprint and a 4:3 display when unfolded. Apple is expected to reveal its first foldable iPhone on September 9 — just two days after Xiaomi's launch — and rumors have repeatedly pointed toward a similar passport-style design. Then there's Huawei, which launched the Mate XT 2 today as well, although it is taking things in an entirely different direction with a tri-fold design.

Phones

Huawei’s latest tri-fold can take an ECG, and it’s like the old Galaxy era is back

This Samsung Galaxy S5 feature is getting revived for Huawei's $3000 tri-folding phone

Electronics, Phone, Mobile Phone

Huawei just dropped its new tri-fold as a spectacular piece of hardware. The redesigned Mate XT 2 has a 10.2-inch folding display, a tougher inward-folding mechanism, and a jaw-dropping price tag. But now that Huawei has revealed the full specifications, one of its most interesting features has little to do with the screen.

The Mate XT 2 can record an electrocardiogram, or ECG, using electrodes built into its metal frame. So if a user unfolds the phone and holds the two sides with both hands, the device can capture a 30-second reading. The accompanying software then generates an ECG report that can flag sinus rhythm, atrial fibrillation, premature ventricular contractions, and premature atrial contractions in adults.