Skip to main content

Spectator View provides a looking glass for all to see HoloLens holograms

As we saw 30 minutes into Microsoft’s recent Windows 10 Creators Update press event, the company can display what a HoloLens user sees in real time to a general audience. For instance, Microsoft “experience designer” Taj Reid pulled a holographic chair out of a floating web browser and positioned it on the stage. While he experienced all of this in first-person, the audience could see the same objects in a third-person view though the event’s large displays or via the online broadcast. Now Microsoft wants to bring this “spectator view” to all HoloLens developers.

During October’s press event, Microsoft brought out a special camera that captured Taj Reid’s demo in real time while simultaneously rendering the holograms into the live feed. Microsoft wants developers to create a similar camera by offering documentation based on its camera design, aka the Spectator View Camera. The use cases for this setup include snapping images of HoloLens wearers as they interact with holograms, live demonstrations, and video capture.

Recommended Videos

“Since a HoloLens can only be worn by one person, how do you open the view so everyone can see what that person sees? To solve this problem, we developed Mixed Reality Capture (MRC) to aid in the visualization of holograms that the wearer is seeing from a first-person perspective,” said Microsoft’s Brandon Bray in a blog on Monday.

For photo and video capture, Microsoft tested its Mixed Reality Capture technology on the Canon EOS 5D Mark III camera ($2,500) while it tested the Blackmagic Design Production Camera 4K for live demonstrations ($3,000). However, any camera with HDMI output should work, as should any add-on camera lens. Microsoft uses the Canon EF 14mm f/2.8L II USM Ultra-Wide Angle Fixed Lens ($2,100).

The camera setup consists of a tripod, a DSLR camera, a hot shoe fastener to mount a hot shoe adapter, a 3D printed adapter to connect the HoloLens mount to the camera’s hot shoe, and a machined aluminum bracket holding a HoloLens unit. The whole setup can connect to a capture card installed in a PC to preview the composite scene. Microsoft has already tested the setup using the Blackmagic Design Intensity Pro 4K capture card ($190).

On the software side, here is what developers will need:

Instructions on how to build the camera can be found here. Microsoft also provides an online Holograms 240 class showing developers how to create a shared experience through HoloLens and Windows 10 apps via Microsoft’s Universal Windows Platform. Of course, shared experiences require at least two HoloLens headsets, which cost $3,000 each.

The ultimate purpose of Spectator View is to provide a stable, third-person composite view of the HoloLens user and the holograms. Spectators can follow along with the experience without suffering through a nausea-causing “shaky cam” viewpoint created by head-mounted cameras.

Kevin Parrish
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
These two macOS 26 features would transform the way I use my Mac
Writing tools in Apple Notes.

Apple’s execution with note-taking on macOS leaves a lot of room for improvement. There are so many areas where it feels like an abandoned project, instead of the future-proof experience that native iOS apps often deliver. In fact, the disparity across its own platforms is troubling. 

Take, for example, iPadOS and iOS. You can quickly launch a notes page straight from the control, without having to close the existing app and launch the Notes app. On macOS, you don’t get any such facility. 

Read more
Looking for a 2-in-1 laptop? The Samsung Galaxy Book 5 Pro 360 is $250 off
Samsung Galaxy Book5 Pro 360 front view showing tend mode.

Samsung is a brand that's better known for its smartphones and TVs, but it also has fantastic laptop deals, like this one for the Samsung Galaxy Book 5 Pro 360. You can currently get this 2-in-1 laptop with a $250 discount, which slashes its price from $1,700 to $1,450. We're not sure how much time is remaining on this offer though, so if you're interested in buying this premium device but you want to get it for a lower price than usual, you're going to have to proceed with your purchase immediately.

Why you should buy the Samsung Galaxy Book 5 Pro 360 2-in-1 laptop

Read more
Upgrade to this Alienware 4K QD-OLED gaming monitor while it’s $300 off
Cyberpunk 2077 being played on the Alienware 32 QD-OLED.

The powerful machine you purchased from gaming PC deals should be paired with a premium display, and the 32-inch Alienware 4K QD-OLED gaming monitor comes with our stamp of approval. It's also on sale from Dell right now, with a $300 discount slashing its price from $1,200 to only $900. That's a steal when you consider the capabilities of this screen, so you're going to have to hurry with your purchase as stocks may run out at any moment.

Why you should buy the 32-inch Alienware 4K QD-OLED gaming monitor

Read more