Skip to main content

Dancing in digital rain: HoloLens used to see real-time motion capture

Augmented reality headsets might not be able to create entire digital worlds for you to walk around in, but they can do a lot of things that VR headsets cannot, such as layering the visual data from a motion-capture recording over that of the real-world actor. That was something that the WholoDance project played around with during development using a HoloLens headset, and it seemed to work very well.

WholoDance is a program that looks into new ways to teach dance, especially through technology, while preserving cultural history within the movements. HoloLens and augmented reality were an exciting development for the project, as it let the developers try out something very new.

Recommended Videos

Not only could the director of the motion-capture project view the dancer’s digital form while she was dancing next to it, but immediately afterwards, they were able to play back the moving 3D model to the dancer herself, who while wearing the headset, was able to critique her own performance and that of the capture technology.

That in itself could be of great help to dancers, who traditionally rely on 2D recordings to analyze their performance. However, being able to see it so quickly in 3D and be able to walk around their digital ghost could be extremely useful. As motion capture developer, Jasper Brekelmans, said of the project (via RoadtoVR), “Nuances of how the hips moved during balancing or how footwork looked for example became much more apparent and clear when walking around a life-size 3D character in motion than watching the same thing on a 2D screen.”

One aspect that is likely to be improved in the future though, is interaction. In the video above we see Brekelmans and the dancers utilizing an Xbox gamepad for inputs. While there are certainly more intuitive ways to interact with a virtual space, it was felt that a reliable, well tested controller would be better suited than something which the team were less familiar with, like motion controls or voice commands.

The WholoDance project is also interested in experimenting with someone dancing while wearing the headset, potentially giving them a HUD or overlay of information which could help with certain movements, or even learning the dances in the first place.

Please enable Javascript to view this content

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
It’s not your imagination — ChatGPT models actually do hallucinate more now
Deep Research option for ChatGPT.

OpenAI released a paper last week detailing various internal tests and findings about its o3 and o4-mini models. The main differences between these newer models and the first versions of ChatGPT we saw in 2023 are their advanced reasoning and multimodal capabilities. o3 and o4-mini can generate images, search the web, automate tasks, remember old conversations, and solve complex problems. However, it seems these improvements have also brought unexpected side effects.

What do the tests say?

Read more
Ray-Ban Meta Glasses are my favorite AI gadget, and they keep getting better
Ray-Ban Meta Glasses worn by Prakhar Khanna.

Meta announced its Ray-Ban AI Glasses in October 2023, and while the company hasn’t launched a successor yet, it has steadily expanded the feature set, turning them into my favorite AI gadget. These are all quality-of-life upgrades that would ideally be released with the next-gen product. But Meta has announced the expansion of Ray-Ban Meta Glasses to more regions and new Meta AI features rolling out starting this week.

I bought a pair of Headliner Meta Ray-Bans in January 2024, and they’ve been my travel companion ever since. It's not because I can record videos while on the go, but because they are the first AI device that doesn’t scream AI. The ambient presence of tech is what makes them special, and they’re only improving, even after 18 months since launch.

Read more
Apple’s low-cost Vision Pro headset could land sooner than expected
A person pinches while wearing an Apple Vision Pro.

Apple’s Vision Pro headset, despite being the most advanced XR gear of its kind, wasn’t quite the roaring success the company may have expected. An asking price worth $3,500 was certainly a deterrent for enthusiasts, but the lack of a full-fledged computing ecosystem built around it was also a lackluster show.

The company has, however, no intention of giving up. On the contrary, Apple is working on a more affordable, watered-down version, and it could arrive sooner than expected. According to Bloomberg, there’s a chance the headset might make an appearance later this year, possibly around the same window as the iPhone 17 series.

Read more