Skip to main content

Facebook steps into 3D memories and photos without a specialized camera

Facebook wants your photos to have another dimension. During the F8 conference, Facebook teased 3D photos that will allow users to capture and share a 3D image using only a smartphone. The 3D Photos, slated for a summer arrival, comes alongside a Facebook prototype that uses artificial intelligence to turn those past photos in Memories into 3D.

3D Photos will allow users to share images with a 3D effect without an actual 3D camera. Facebook says the images can be captured using a smartphone. In the News Feed, the images have a more three-dimensional look when scrolling and moving a smartphone from side to side makes slight adjustments to the perspective of the image. Facebook doesn’t clarify exactly how those images will be captured on a smartphone — traditionally, 3D photos and images requires a camera with off-set lenses in order to gather depth data as well as the pixels.

While details on the 3D Photos are slim, Facebook is also expanding the 3D posts type previously launched. The animated 3D objects will soon be turned into augmented reality objects with a feature that takes the graphic from the News Feed to the Facebook Camera in one tap. The tool allows 3D objects from the News Feed to become augmented reality objects in Facebook Camera.

Users can expect to see the new 3D photos and AR integration for 3D objects “soon” — but Facebook is also working on tech that could help turn images that have already been captured into VR. The tech, which is, for now, just an experiment, uses machine learning to create a VR experience from existing images, no specialized camera required.

The VR Memories uses photogrammetry, using A.I. algorithms to build a dimensional recreation using just 2D photos. The tool creates point clouds, or three-dimensional data points used in 3D design and VR, to giver the flat photos dimension. 

Bringing a 2D image into a 3D space isn’t photorealistic, however. In one demo, the tech created a pointillist rendition of a home made up of lots of tiny dots. Using a VR headset, users could look around the space and find thumbnails of the actual snapshots or videos placed against the virtual recreation of the space where those images were captured in real life.

The 3D Photos and the 3D Memories concept were teased during the annual F8 conference alongside announcements for the Oculus Go, new Facebook features, Instagram updates and more. The conference continues through Wednesday, May 2.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
Super Mario 3D World + Bowser’s Fury trailer reveals wild new game mode
Super Mario 3D World + Bowser's Fury

Nintendo released a new trailer for Super Mario 3D World + Bowser's Fury, which finally reveals information on the re-release's new mode. Bowser's Fury is an entirely new adventure that features a gigantic Bowser.

Super Mario 3D World + Bowser's Fury is a Nintendo Switch version of the 2013 Wii U game Super Mario 3D World. Nintendo previously revealed that the new edition would feature something called Bowser's Fury, but this is the first time the mode has been shown in any form.

Read more
Qualcomm’s long-awaited second-gen 3D Sonic fingerprint sensor is 50% faster
qualcomm 3d sonic sensor second generation ces 2021 2nd gen

Qualcomm wants to make its in-display fingerprint sensor a little bit more seamless. Its first-generation Sonic Sensor was introduced a few years ago, and at the time offered a decent experience -- but since then, has been overtaken in terms of speed and performance by competing optical sensors. Now, Qualcomm has finally launched a new, second-generation 3D Sonic sensor with big improvements.

The new sensor is 77% larger than Qualcomm's original 3D Sonic Sensor, measuring in at 8mm square, compared to the original's 4mm by 9mm. In other words, you'll be able to place your finger on a larger portion of the screen, making the overall experience a little more seamless.

Read more