State-of-the-art scanning technique digitizes humans, sticks them in VR

Using an array of high-resolution cameras, scientists at Fraunhofer Heinrich Hertz Institute (HHI) in Berlin, Germany have developed a state-of-the-art scanning technique to capture realistic images of a person and transmit them to a virtual reality environment. The technology, which will be on display at IFA 2017 in Berlin, may make human actors in virtual and augmented reality experiences even more lifelike.

“Today you usually use animated avatars to model a person,” Ingo Feldmann, head of the Immersive Media and Communication group at Fraunhofer HHI, told Digital Trends. “So you create a model of a person in a 3D map and somehow capture the motion from a real actor and then you try to animate this model.”

The method developed by Feldmann and his team instead record high-resolution video using industrial stereo cameras, which capture an image with two lenses, much like a pair of human eyes. The array is made up of 32 of these cameras (Feldmann was tight-lipped about about the camera models) allowing it to record a subject’s movements in 360 degrees, creating a detailed and dynamic representation.

“We film the person directly in 3D,” Feldmann said, “in what we call volumetric video. There are cameras arranged around this actor … and these cameras create 2D images. From these images we create a 3D structure or model that looks completely natural. There are no animations, it’s the real person, and they can be inserted into a VR or AR experience.”

Of course, there’s a lot that goes into inserting the recorded video into a virtual world but, to make the task easier, the researchers created algorithms that can quickly extract the video’s depth data to calculate how the 3D figure should appear. Feldmann said the camera array is capable of capturing some 300 million triangles per person — far too many for a VR device to accommodate — so they must also reduce the complexity of the model.

“We have to adapt the resolution to the device,” he said.

The scientists have now opened a studio at Fraunhofer HHI where people can come to record models for VR and AR.

IFA 2016 was host to another state-of-the-art scanner, Botscan, which used 70 high-resolution DSLRs to capture an incredibly detailed, albeit static, 360-degree image.

Mobile

5G is the swift kick VR and AR gaming needs to come to fruition

There's a lot of hype surrounding augmented reality and virtual reality, but is it really the next big thing? We take a look at where the new mediums stand, as well as how 5G is poised to help them break into the mainstream.
Mobile

Samsung Galaxy S10e vs. iPhone XR: Cut-price flagship showdown

The Samsung Galaxy S10 range has been revealed, and it heralds a new age of powerful technology. The Galaxy S10e packs the new power and design into a cheaper price point. But is it better than the iPhone XR?
Deals

The best budget-friendly GoPro alternatives that won’t leave you broke

Cold weather is here, and a good action camera is the perfect way to record all your adventures. You don't need to shell out the big bucks for a GoPro: Check out these great GoPro alternatives, including some 4K cameras, that won’t leave…
Gaming

This list of PlayStation 4 exclusives puts its competitors to shame

The PlayStation 4's game library and incredible selection of exclusive games could make anyone with an Xbox One or Nintendo Switch think twice. Here's our list of the latest and greatest PS4 exclusives.
Gaming

These are the coolest virtual and augmented reality gadgets from CES 2019

CES 2019 had plenty of VR and AR gadgets on display, including headsets that completely change how you experience virtual reality, and some that don't even require a PC or a phone to run.
Gaming

These shoes let me stroll through ‘Skyrim,’ and I desperately want to go back

After being funded in just two hours on Kickstarter back in October 2018, Cybershoes has earned itself a place among the coolest VR walking and running tech. At CES 2019, we got to try them out and they live up to the hype.
Gaming

The Teslasuit could turn Black Mirror’s terrifying ‘Playtest’ into a reality

We spoke with Teslasuit co-founder Dimitri Mikhalchuk about VR gaming at CES 2019. With all its features, the future of the Teslasuit and virtual reality look bright. And it also sounds a bit like a Black Mirror episode.
Computing

Could the next Microsoft HoloLens be announced at MWC 2019?

After not having a presence at Mobile World Congress for three years, Microsoft is now sending out media invites for a press conference on February 24 during the annual event in Barcelona. Could a next-generation HoloLens be on the way?
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Gaming

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.
Computing

Samsung files a VR patent featuring a curved OLED display

Doubling down on its emphasis on curved displays, Samsung recently filed a design patent for a new virtual reality headset that could feature a curved OLED display, which would be an interesting development in VR.
Gaming

Bringing realism to VR is complex, but these developers found a way in holograms

Making virtual reality feel real is the hardest job of all VR developers. For Awake: Episode One, StartVR used volumetric recording, rather than motion capture, to bring its characters to life like never before.