Skip to main content

We now know how Apple’s VR headset may handle video, and it’s pretty awesome

Ever since the first rumors surfaced that Apple was working on a mixed-reality headset, it has been assumed that immersive video would be a key feature of the device. Yet we’ve never really known exactly how this would work — until now.

That’s because Apple has just been granted a patent (USPTO number 11570417) that goes into detail on how a user might watch video content while wearing the headset, which will allegedly be dubbed Reality Pro. And that patent presents an intriguing system that could have uses beyond simple video.

A rendering of an Apple mixed-reality headset (Reality Pro) in a gray color seen from the front.
Ahmed Chenni, Freelancer.com

The patent describes how the headset could take into account the position of the user’s head and show them content based on that position. If the user’s head or gaze moves — for example, if they look to the left or tilt their head downwards — the headset’s viewport would change accordingly.

Recommended Videos

The effect could be like looking through a window, where you see different segments of a larger screen based on where your eyes fall. Apple’s patent uses the metaphor of a headset user being surrounded by a globe, with their current viewport representing one segment of that globe.

Apple’s patent explains that this system could allow Reality Pro to learn where a user is looking and enhance the video fidelity in that area while showing less graphically intensive content around the user’s peripheral vision. That could save on processing power, thereby prolonging the headset’s battery life.

A clever idea with many uses

An image from an Apple patent showing a person wearing a mixed-reality headset. The image describes how a user's viewport could change as they move their head.
Apple

Other uses for the technology could include adjusting resolutions and bitrates depending on where a user is looking or adding content to a buffer depending on where the headset predicts the user will look next.

Aside from video, this system could also work well with virtual reality games, adding a new level of immersion. As your character moves around, for example, you could look left or right and the headset would adjust both the content you see and its visual fidelity accordingly.

It’s a clever idea and is reminiscent of something we’ve heard before. In January 2022, display industry analyst Ross Young explained that the Reality Pro could use three display panels: two for your front-facing gaze and one for peripheral vision. The peripheral panel would run at a lower resolution and would be slightly blurred, helping you to focus on the screens up front.

A rendering of four Apple mixed-reality headsets (Reality Pro) in various colors sitting on a surface.
Ahmed Chenni, Freelancer.com

Incidentally, the patent contains drawings of a headset that bears some resemblance to rumored designs. It also depicts a strap running across the top of a person’s head, which has not been shown in many renders (if any). However, as the illustrations are just meant to be examples, we probably shouldn’t read too much into them.

Apple’s upcoming headset is thought to be a high-end device jam-packed with advanced tech, including high-resolution displays, hand- and eye-tracking, and both virtual reality and augmented reality capabilities. That tech will come with a high price, though — $3,000, according to rumors.

The Reality Pro is expected to be unveiled at a special spring event hosted by Apple. With just a few months until its reported release date, expectations are mounting for the headset. Time will tell if patents like this will help it meet those expectations and avoid becoming an expensive flop, as some have warned.

Alex Blake
Alex Blake has been working with Digital Trends since 2019, where he spends most of his time writing about Mac computers…
Sony’s flip-up XR headset costs even more than an Apple Vision Pro
Sony's SRH-S1 held in a hand at CES 2025.

Sony is one of the biggest names in VR gaming with the popular PlayStation VR2. Now it’s launching a high-end XR headset with specifications that rival the Apple Vision Pro. To be clear, this isn’t the Sony XYN headset powered by Google's new Android XR, and it won’t connect to a PlayStation 5. It’s aimed at enterprise customers that design products, and it costs even more than the ultra-premium Vision Pro.

Priced at $4,750, the Sony SRH-S1 is a powerful system with integrated hardware and software, a flip-up visor, and unique controllers optimized for manipulating virtual 3D objects. Being able to lift the visor for face-to-face conversations is convenient. The halo strap design also removes all facial pressure. A ring on one finger lets you grasp items, and a 3D stylus that looks like something from a sci-fi movie allows precise adjustments.

Read more
Here’s how Apple may make the next Vision headset more affordable
A person wearing an Apple Vision Pro headset.

A new report suggests that Apple may be lining up its plans for the launch of its more budget-friendly Vision headset. As spotted by Wccftech, the report comes from analyst firm TrendForce, which indicates a move away from the high-end micro-OLED panels used in the Vision Pro.

The new options include glass-based OLED displays, as well as a different form of OLED known as LTPO backplane technology, which was first used on the Apple Watch Series 4 back in 2018. Since then, it's become a familiar display technology that's been applied broadly across the industry in smartphones and watches.

Read more
Meta just accidentally revealed its next VR headset
An upscaled image of the Meta Quest 3S from the Quest Link app.

Newly leaked images of Meta's upcoming Quest 3S have surfaced online, including one found in an official Meta app. That leaves no room for doubt when it comes to how the upcoming Quest 3S will look.

If you have the Meta Quest Link app installed, you can see the image for yourself by searching for “oculus-link-hero-panther.png” in your computer’s program files. The image appeared online in a Reddit post by Gary_the_mememachine and was covered by UploadVR.

Read more