Skip to main content

State-of-the-art scanning technique digitizes humans, sticks them in VR

IFA 2024
This story is part of our coverage of IFA Berlin 2024

Using an array of high-resolution cameras, scientists at Fraunhofer Heinrich Hertz Institute (HHI) in Berlin, Germany have developed a state-of-the-art scanning technique to capture realistic images of a person and transmit them to a virtual reality environment. The technology, which will be on display at IFA 2017 in Berlin, may make human actors in virtual and augmented reality experiences even more lifelike.

“Today you usually use animated avatars to model a person,” Ingo Feldmann, head of the Immersive Media and Communication group at Fraunhofer HHI, told Digital Trends. “So you create a model of a person in a 3D map and somehow capture the motion from a real actor and then you try to animate this model.”

Recommended Videos

The method developed by Feldmann and his team instead record high-resolution video using industrial stereo cameras, which capture an image with two lenses, much like a pair of human eyes. The array is made up of 32 of these cameras (Feldmann was tight-lipped about about the camera models) allowing it to record a subject’s movements in 360 degrees, creating a detailed and dynamic representation.

“We film the person directly in 3D,” Feldmann said, “in what we call volumetric video. There are cameras arranged around this actor … and these cameras create 2D images. From these images we create a 3D structure or model that looks completely natural. There are no animations, it’s the real person, and they can be inserted into a VR or AR experience.”

Of course, there’s a lot that goes into inserting the recorded video into a virtual world but, to make the task easier, the researchers created algorithms that can quickly extract the video’s depth data to calculate how the 3D figure should appear. Feldmann said the camera array is capable of capturing some 300 million triangles per person — far too many for a VR device to accommodate — so they must also reduce the complexity of the model.

“We have to adapt the resolution to the device,” he said.

The scientists have now opened a studio at Fraunhofer HHI where people can come to record models for VR and AR.

IFA 2016 was host to another state-of-the-art scanner, Botscan, which used 70 high-resolution DSLRs to capture an incredibly detailed, albeit static, 360-degree image.

Dyllan Furness
Former Digital Trends Contributor
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Kagi’s AI search assistant gives you access to all the big models in one place
Kagi search bar in light mode.

Kagi's "Assistant" feature, previously only available to Ultimate subscribers, is now rolling out to all tiers -- including the free trial tier. The feature gives you access to a range of different LLMs for both chatting and web-searching purposes.

If you don't know much about Kagi, it's a paid search engine that borrows its name from the Japanese word for "key." The concept is simple -- with Google, you pay for the service by allowing ads and data collection. With Kagi, you pay for the service with money to get a private and ad-free experience.

Read more
Leaked specs for AMD’s RX 9070 GRE reveal something gamers really need
The XFX logo on the RX 7900 GRE.

AMD's RX 9070 XT made it onto every ranking of the best graphics cards shortly after launch, but many gamers are waiting for more. With spotty availability and trouble finding a GPU at MSRP, we're left hoping that AMD will have new GPUs coming out soon. Good news: It looks like AMD has something up its sleeve, and we just learned the specs. Spoiler alert: One of the specs is something that gamers might love.

VideoCardz leaked the specs for the RX 9070 GRE, which stands for "Great Radeon Edition." In the previous generation, the RX 7900 GRE ended up being one of the top GPUs in terms of value for the money, and it did a good job of bridging the gap between the higher-end and the mainstream cards. It looks like that might be the case in this generation, too, although remember -- this is just a leak and nothing is certain until AMD says so.

Read more
Need new office furniture? Get up to 20% off from the Steelcase Spring Sale
Steelcase office furniture in a home office.

If you want to boost your productivity at your home office or small business, upgrading your devices with desktop computer deals is just the start. Your office furniture should also be designed specifically to meet your needs across long workdays, so that you can stay comfortable and remain focused the whole time. You'll get these benefits with Steelcase office furniture, and you're in luck because the brand just launched a Spring Sale for a 20% discount on office chair deals, standing desk deals, and more.

The Steelcase Spring Sale is an excellent source of savings, whether you're thinking of overhauling your office or you just need to replace one piece of furniture. Feel free to browse everything that's on sale through the link below, or check out our recommendations. Either way, you'll have to act fast because stocks of the brand's more popular items may sell out sooner than you expect.

Read more