Skip to main content

Leap Motion’s prototype augmented reality headset includes hand tracking

Image used with permission by copyright holder

Leap Motion just revealed a new prototype headset that mixes hand tracking with augmented reality. The device, dubbed as North Star, relies on ellipsoidal reflectors, which are typically sections cut from a larger, curved ellipsoid mirror. In this case, the reflectors are based on optical-grade acrylic coated with a thin layer of silver.

For the first version of Leap Motion’s prototype, the company mounted these reflectors inside a huge head-mounted device seemingly ripped out of a 1980s mad scientist movie. On each side of the helmet’s inner wall was a 5.5-inch LCD panel along with bulky ribbon cables connecting to display drivers mounted on the top of the HMD. Needless to say, it wasn’t sleek and compact like Microsoft’s HoloLens. 

“While it might seem a bit funny, it was perhaps the widest field of view, and the highest-resolution AR system ever made,” the company says. “Each eye saw digital content approximately 105 degrees high by 75 degrees wide with a 60 percent stereo overlap, for a combined field of view of 105 degrees by 105 degrees with 1440 × 2560 resolution per eye.” 

Sound confusing? Imagine putting on a helmet, and inside you see two reflective surfaces curving outward, with one end connecting close to the bridge of your nose, and the other end extending forward and out. Meanwhile, there is an LCD screen mounted to the left and right of your eyes, reflected on the curved mirrored surface. This provides a huge field of view both horizontally and vertically. 

Eventually, the team whittled the headset down from a mad scientist contraption to something that looks more like a current VR headset. The prototype now relies on two fast-switching 3.5-inch LCD screens manufactured by BOE Displays that are powered by an Analogix display driver. While it has fewer parts than the previous gargantuan prototype, Leap Motion managed to preserve “most” of our natural field of view. 

In its current state, Leap Motion’s prototype provides a 1,600 x 1,440 resolution for each eye — lower than the hulking first-gen model — running at 120 frames per second. It also sports a field of view “covering over a hundred degrees” with the two screens combined. Meanwhile, the hand-tracking runs at 150 frames per second over a 180- x 180-degree field of view.  

According to the post, the team pulled the reflectors away from the user’s face just slightly to make room for a disassembled wide field-of-view camera manufactured by Logitech to record the augmented reality headset in action. But they’re still not done — other refinement tasks include better cable management, better curves, additional room for enclosed electronics and sensors, and more. 

Once Leap Motion makes those refinements, there are other details that could improve the headset’s AR experience, such as inward-facing cameras for precise augmented image alignment, face tracking, and eye tracking. Head-mounted ambient light sensors would support 360-degree lighting estimation while directional speakers would provide “discrete” localized audio feedback. Micro-actuators could be used to adjust the displays. 

Leap Motion plans to release this design to the open source community next week.  

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
Mass shipment of Apple’s mixed-reality headset may be delayed
Apple VR Headset Concept by Antonio De Rosa

Just days after news emerged that Apple could be close to unveiling its highly anticipated mixed-reality headset, new information suggests that mass shipments of the product may be delayed until the second half of 2023.

The news comes courtesy of analyst Ming-Chi Kuo, whose contacts in Apple’s supply chain have helped him to call it right on other Apple-linked news in the past.

Read more
Apple’s AR/VR headset gets one step closer to a reality
Apple VR Headset Concept by Antonio De Rosa

Apple's rumored first step into AR and VR has been hush-hush, but a new report indicates that the mixed-reality headset may be getting closer to its grand unveiling.

As reported by Bloomberg, Apple's board got a sneak peek at the company's upcoming mixed-reality headset at a quarterly meeting. This meeting was attended by "eight independent directors" and CEO Tim Cook.

Read more
Apple’s mixed-reality headset is running out of time
A virtual reality (VR) headset sitting on a desk.

Recent weeks have seen a huge upsurge in news surrounding Apple’s heavily rumored mixed-reality headset, with leaks speculating on its release date, power capabilities, and even its name. Yet rather than clarify the device, these tidbits have just served to muddy the waters. Assessing the situation, it feels like Apple’s headset is just as ephemeral as it has always been.

The problem is that no one can seem to agree on what the device will actually bring to the table. We know people will wear it on their head, but that’s about the only detail that seems to be actually nailed down. And for a mixed-reality headset, it doesn’t exactly require Sherlock Holmes to work that one out.

Read more