State-of-the-art scanning technique digitizes humans, sticks them in VR

Using an array of high-resolution cameras, scientists at Fraunhofer Heinrich Hertz Institute (HHI) in Berlin, Germany have developed a state-of-the-art scanning technique to capture realistic images of a person and transmit them to a virtual reality environment. The technology, which will be on display at IFA 2017 in Berlin, may make human actors in virtual and augmented reality experiences even more lifelike.

“Today you usually use animated avatars to model a person,” Ingo Feldmann, head of the Immersive Media and Communication group at Fraunhofer HHI, told Digital Trends. “So you create a model of a person in a 3D map and somehow capture the motion from a real actor and then you try to animate this model.”

The method developed by Feldmann and his team instead record high-resolution video using industrial stereo cameras, which capture an image with two lenses, much like a pair of human eyes. The array is made up of 32 of these cameras (Feldmann was tight-lipped about about the camera models) allowing it to record a subject’s movements in 360 degrees, creating a detailed and dynamic representation.

“We film the person directly in 3D,” Feldmann said, “in what we call volumetric video. There are cameras arranged around this actor … and these cameras create 2D images. From these images we create a 3D structure or model that looks completely natural. There are no animations, it’s the real person, and they can be inserted into a VR or AR experience.”

Of course, there’s a lot that goes into inserting the recorded video into a virtual world but, to make the task easier, the researchers created algorithms that can quickly extract the video’s depth data to calculate how the 3D figure should appear. Feldmann said the camera array is capable of capturing some 300 million triangles per person — far too many for a VR device to accommodate — so they must also reduce the complexity of the model.

“We have to adapt the resolution to the device,” he said.

The scientists have now opened a studio at Fraunhofer HHI where people can come to record models for VR and AR.

IFA 2016 was host to another state-of-the-art scanner, Botscan, which used 70 high-resolution DSLRs to capture an incredibly detailed, albeit static, 360-degree image.

Virtual Reality

How one fan revived the hair-raising terror of Alien: Isolation VR with a mod

Playing Alien: Isolation's virtual reality mode on modern headsets shouldn't be possible, but one enterprising modder has made it so with MotherVR, a simple and effective mod that makes it playable once again.
Product Review

4K in home security is finally here, thanks to Arlo’s Ultra UHD smart cam

The 4K home security camera is finally here! Class-leading image clarity and a super-wide field of vision makes Arlo Ultra an early contender for the year’s best smart cam. While there are definite quirks to the device, the device…
Photography

Panasonic Lumix S1R vs. Nikon Z 7: When megapixels matter, which do you choose?

The 47-megapixels Lumix S1R and 46-megapixel Nikon Z 7 are the two highest-resolution, full-frame mirrorless cameras on the market. The S1R features a high-resolution mode that can take 187MP images, but the Nikon is lighter and cheaper.
Emerging Tech

Scientists manage to 3D print an actual heart using human cells

Scientists at Tel Aviv University have achieved a world-first by 3D printing a small-scale heart, complete with blood vessels, ventricles, and chambers. Here's why that's so exciting.
Deals

The best budget-friendly GoPro alternatives that won’t leave you broke

Cold weather is here, and a good action camera is the perfect way to record all your adventures. You don't need to shell out the big bucks for a GoPro: Check out these great GoPro alternatives, including some 4K cameras, that won’t leave…
Virtual Reality

Magic Leap One AR headset will be available starting April 1 -- at a high price

The Magic Leap One AR headset is now available for a rather hefty price. Here's everything you need to know about the device, including the price, where it can be purchased, the hardware powering Magic Leap's goggles, and more.
Emerging Tech

Nonny de la Peña wants to put virtual reality within Reach

Telling a story in VR can sometimes pack a punch regular films can’t. As a pioneer in immersive journalism, Nonny de la Peña wants to open that experience to everyone with her Reach platform.
Virtual Reality

Valve Index VR headset revealed, more info coming in May

The Valve Index was teased, confirming rumors that the gaming company is working on its own virtual reality headset. More information about the Valve Index will be coming in May, which could also be the device's release date.
Gaming

Valve may have accidentally leaked the ship date for its VR headset

Due to a mishap, we may have learned that this year will be the summer of Index. Valve published three Index store pages early and, while they featured mostly placeholder text, they revealed the 2019 ship date for the VR headset.
Gaming

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Mobile

A Google patent hints at a new attempt at an augmented reality headset

Google may be working on another augmented reality headset. The company was awarded a patent for an augmented reality headset. Unfortunately, the patent isn't specific as to what the headset will look like.
Gaming

Nintendo is bringing the latest Zelda and Mario games to its VR headset

The Nintendo Labo VR Kit launches this month and two of the Switch's biggest games, Super Mario Odyssey and Breath of the Wild, will get free VR support via an update that goes live a couple of weeks after the VR Kit launch.
Wearables

Army uses modified Microsoft HoloLens 2 for ‘real-life game of Call of Duty’

The U.S. Army gave CNBC an exclusive look at its modified Microsoft HoloLens 2 augmented reality headset. The Integrated Visual Augmentation System, or IVAS, provides various functions for training and combat.