Skip to main content
  1. Home
  2. Computing
  3. News

Spectator View provides a looking glass for all to see HoloLens holograms

Kevin Parrish
By

microsoft hololens spectator view dslr
Image used with permission by copyright holder
As we saw 30 minutes into Microsoft’s recent Windows 10 Creators Update press event, the company can display what a HoloLens user sees in real time to a general audience. For instance, Microsoft “experience designer” Taj Reid pulled a holographic chair out of a floating web browser and positioned it on the stage. While he experienced all of this in first-person, the audience could see the same objects in a third-person view though the event’s large displays or via the online broadcast. Now Microsoft wants to bring this “spectator view” to all HoloLens developers.

During October’s press event, Microsoft brought out a special camera that captured Taj Reid’s demo in real time while simultaneously rendering the holograms into the live feed. Microsoft wants developers to create a similar camera by offering documentation based on its camera design, aka the Spectator View Camera. The use cases for this setup include snapping images of HoloLens wearers as they interact with holograms, live demonstrations, and video capture.

Recommended Videos

“Since a HoloLens can only be worn by one person, how do you open the view so everyone can see what that person sees? To solve this problem, we developed Mixed Reality Capture (MRC) to aid in the visualization of holograms that the wearer is seeing from a first-person perspective,” said Microsoft’s Brandon Bray in a blog on Monday.

Related

For photo and video capture, Microsoft tested its Mixed Reality Capture technology on the Canon EOS 5D Mark III camera ($2,500) while it tested the Blackmagic Design Production Camera 4K for live demonstrations ($3,000). However, any camera with HDMI output should work, as should any add-on camera lens. Microsoft uses the Canon EF 14mm f/2.8L II USM Ultra-Wide Angle Fixed Lens ($2,100).

The camera setup consists of a tripod, a DSLR camera, a hot shoe fastener to mount a hot shoe adapter, a 3D printed adapter to connect the HoloLens mount to the camera’s hot shoe, and a machined aluminum bracket holding a HoloLens unit. The whole setup can connect to a capture card installed in a PC to preview the composite scene. Microsoft has already tested the setup using the Blackmagic Design Intensity Pro 4K capture card ($190).

On the software side, here is what developers will need:

Instructions on how to build the camera can be found here. Microsoft also provides an online Holograms 240 class showing developers how to create a shared experience through HoloLens and Windows 10 apps via Microsoft’s Universal Windows Platform. Of course, shared experiences require at least two HoloLens headsets, which cost $3,000 each.

The ultimate purpose of Spectator View is to provide a stable, third-person composite view of the HoloLens user and the holograms. Spectators can follow along with the experience without suffering through a nausea-causing “shaky cam” viewpoint created by head-mounted cameras.

Editors' Recommendations

Topics
Kevin Parrish
Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
It’s time to stop believing these PC building myths
Hyte's Thicc Q60 all-in-one liquid cooler.

As far as hobbies go, PC hardware is neither the cheapest nor the easiest one to get into. That's precisely why you may often run into various misconceptions and myths.

These myths have been circulating for so long now that many accept them as a universal truth, even though they're anything but. Below, I'll walk you through some PC beliefs that have been debunked over and over, and, yet, are still prevalent.
Liquid cooling is high-maintenance (and scary)

Read more
AMD’s next-gen CPUs are much closer than we thought
AMD Ryzen 7 7800X3D held between fingertips.

We already knew that AMD would launch its Zen 5 CPUs this year, but recent motherboard updates hint that a release is imminent. Both MSI and Asus have released updates for their 600-series motherboards that explicitly add support for "next-generation AMD Ryzen processors," setting the stage for AMD's next-gen CPUs.

This saga started a few days ago when hardware leaker 9550pro spotted an MSI BIOS update, which they shared on X (formerly Twitter). Since then, Asus has followed suit with BIOS updates of its own featuring a new AMD Generic Encapsulated Software Architecture (AGESA) -- the firmware responsible for starting the CPU -- that brings support for next-gen CPUs (spotted by VideoCardz).

Read more
AMD Zen 5: Everything we know about AMD’s next-gen CPUs
The AMD Ryzen 5 8600G APU installed in a motherboard.

AMD Zen 5 is the next-generation Ryzen CPU architecture for Team Red and is slated for a launch sometime in 2024. We've been hearing tantalizing rumors for a while now and promises of big leaps in performance. In short, Zen 5 could be very exciting indeed.

We don't have all the details, but what we're hearing is very promising. Here's what we know about Zen 5 so far.
Zen 5 release date and availability
AMD confirmed in January 2024 that it was on track to launch Zen 5 sometime in the "second half of the year." Considering the launch of Zen 4 was in September 2022, we would expect to see Zen 5 desktop processors debut around the same timeframe, possibly with an announcement in the summer at Computex.

Read more