State-of-the-art scanning technique digitizes humans, sticks them in VR

Using an array of high-resolution cameras, scientists at Fraunhofer Heinrich Hertz Institute (HHI) in Berlin, Germany have developed a state-of-the-art scanning technique to capture realistic images of a person and transmit them to a virtual reality environment. The technology, which will be on display at IFA 2017 in Berlin, may make human actors in virtual and augmented reality experiences even more lifelike.

“Today you usually use animated avatars to model a person,” Ingo Feldmann, head of the Immersive Media and Communication group at Fraunhofer HHI, told Digital Trends. “So you create a model of a person in a 3D map and somehow capture the motion from a real actor and then you try to animate this model.”

The method developed by Feldmann and his team instead record high-resolution video using industrial stereo cameras, which capture an image with two lenses, much like a pair of human eyes. The array is made up of 32 of these cameras (Feldmann was tight-lipped about about the camera models) allowing it to record a subject’s movements in 360 degrees, creating a detailed and dynamic representation.

“We film the person directly in 3D,” Feldmann said, “in what we call volumetric video. There are cameras arranged around this actor … and these cameras create 2D images. From these images we create a 3D structure or model that looks completely natural. There are no animations, it’s the real person, and they can be inserted into a VR or AR experience.”

Of course, there’s a lot that goes into inserting the recorded video into a virtual world but, to make the task easier, the researchers created algorithms that can quickly extract the video’s depth data to calculate how the 3D figure should appear. Feldmann said the camera array is capable of capturing some 300 million triangles per person — far too many for a VR device to accommodate — so they must also reduce the complexity of the model.

“We have to adapt the resolution to the device,” he said.

The scientists have now opened a studio at Fraunhofer HHI where people can come to record models for VR and AR.

IFA 2016 was host to another state-of-the-art scanner, Botscan, which used 70 high-resolution DSLRs to capture an incredibly detailed, albeit static, 360-degree image.

Gaming

Minecraft AR teased during Microsoft Build 2019, full reveal arrives on May 17

At the Vision Keynote during the first day of Microsoft Build 2019, we saw a short trailer of what looks to be Minecraft AR, an upcoming experience coming to mobile devices. Watch the video here and join us for the full reveal on May 17.
Outdoors

The best smart helmets are full of cool tech, and totally worth the messy hair

Helmets might be a haircut's worst nightmare, but they're constantly evolving, and have undergone a 21st-century makeover. No matter your sport, here are the best smart helmets currently on the market.
Mobile

Leaked Verizon calendar suggests a late September launch for the next iPhone

The last iPhones just launched, but rumors about the next iPhone are already surfacing. Apple's 2019 flagship could include a variety of upgrades ranging from a new design to enhanced features.
Social Media

These are the best ways to make your own animated GIF to share

Love sharing GIFs with your friends and peers, but wish you could make your own? Here's how to do so in Photoshop, or using a few other methods that don't require you to shell out a premium fee with each calendar year.
Mobile

The OnePlus 7 Pro Almond is so good-looking, you'll want to snack on it

The OnePlus 7 Pro is here, and it's a monster of a phone with a stunning redesign, a pop-up selfie camera, powerful flagship specs, and a price that's hundreds of dollars less than the competition.
Photography

As AR heads to Google search, Lens learns to translate, add tips, and more

Google Lens can soon help you decide what to eat by scanning the menu, then calculate the tip with one look at the receipt. Translation options are also expanding for Lens, while augmented reality tools will be built into search results.
Gaming

Minecraft Earth hands-on preview: The next big AR craze Is coming

Minecraft Earth is a new mobile augmented reality game from Microsoft that has Pokémon Go dead in its sites. The cute monster collect-them-all started the genre, but Minecraft Earth hopes to redefine it.
Mobile

Google’s ARCore is getting better at tracking moving images

Google has announced a series of updates to ARCore that should make the augmented reality experience a whole lot more fluid. For example, ARCore is getting better at tracking moving images through Augmented Images.
Mobile

Nike Fit aims to help you slip into your new sneakers more easily

Nike says a new augmented reality feature for its app should increase the chances of a snug fit for customers buying its shoes online, or even in-store. Nike Fit launches in the U.S. in July and the following month in Europe.
Computing

Dive headfirst into the best VR experiences available now on the Oculus Rift

The Oculus Rift brought back virtual reality and put a modern twist on it. Grab your Touch Controllers, put on your VR headset, and jump into the fun with some of the best Oculus Rift games available now.
Virtual Reality

Your first augmented reality work helmet might be made by Lenovo

A new augmented reality headset from Lenovo could challenge Microsoft's dominance in the commercial AR industry, with the ThinkReality A6 offering an AR experience akin to something between the first and second-generation Hololens headsets.
Gaming

New Sony patents could be PlayStation’s answer to Google Stadia

Google Stadia will be attempting to cut into the home gaming console pie but one of its competitors may already have an answer for the game streaming platform. A new Sony patent shows what could be the PlayStation spin on streaming.
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Mobile

Google’s new $999 augmented reality smartglasses are ready for business

Google unveiled Google Glass Enterprise Edition 2, a new version of its business-focused augmented reality wearable. The company's smartglasses ship with a faster processor, an updated camera, and safety frames from Smith Optics.