Leap Motion’s prototype augmented reality headset includes hand tracking

leap motion augmented reality hmd prototype revealed ar headset

Leap Motion just revealed a new prototype headset that mixes hand tracking with augmented reality. The device, dubbed as North Star, relies on ellipsoidal reflectors, which are typically sections cut from a larger, curved ellipsoid mirror. In this case, the reflectors are based on optical-grade acrylic coated with a thin layer of silver.

For the first version of Leap Motion’s prototype, the company mounted these reflectors inside a huge head-mounted device seemingly ripped out of a 1980s mad scientist movie. On each side of the helmet’s inner wall was a 5.5-inch LCD panel along with bulky ribbon cables connecting to display drivers mounted on the top of the HMD. Needless to say, it wasn’t sleek and compact like Microsoft’s HoloLens. 

“While it might seem a bit funny, it was perhaps the widest field of view, and the highest-resolution AR system ever made,” the company says. “Each eye saw digital content approximately 105 degrees high by 75 degrees wide with a 60 percent stereo overlap, for a combined field of view of 105 degrees by 105 degrees with 1440 × 2560 resolution per eye.” 

Sound confusing? Imagine putting on a helmet, and inside you see two reflective surfaces curving outward, with one end connecting close to the bridge of your nose, and the other end extending forward and out. Meanwhile, there is an LCD screen mounted to the left and right of your eyes, reflected on the curved mirrored surface. This provides a huge field of view both horizontally and vertically. 

Eventually, the team whittled the headset down from a mad scientist contraption to something that looks more like a current VR headset. The prototype now relies on two fast-switching 3.5-inch LCD screens manufactured by BOE Displays that are powered by an Analogix display driver. While it has fewer parts than the previous gargantuan prototype, Leap Motion managed to preserve “most” of our natural field of view. 

In its current state, Leap Motion’s prototype provides a 1,600 x 1,440 resolution for each eye — lower than the hulking first-gen model — running at 120 frames per second. It also sports a field of view “covering over a hundred degrees” with the two screens combined. Meanwhile, the hand-tracking runs at 150 frames per second over a 180- x 180-degree field of view.  

According to the post, the team pulled the reflectors away from the user’s face just slightly to make room for a disassembled wide field-of-view camera manufactured by Logitech to record the augmented reality headset in action. But they’re still not done — other refinement tasks include better cable management, better curves, additional room for enclosed electronics and sensors, and more. 

Once Leap Motion makes those refinements, there are other details that could improve the headset’s AR experience, such as inward-facing cameras for precise augmented image alignment, face tracking, and eye tracking. Head-mounted ambient light sensors would support 360-degree lighting estimation while directional speakers would provide “discrete” localized audio feedback. Micro-actuators could be used to adjust the displays. 

Leap Motion plans to release this design to the open source community next week.  

Product Review

Rylo is the 360 camera that finally makes 360 video useful

The Rylo puts a new spin on 360 video by focusing on flat, fixed-frame output. It can’t quite replace your action camera or camcorder, but it shows a glimmer of what the future of consumer video could be.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.

Get your Sagan on with 60 awe-inspiring photos of the final frontier

Few things instill a sense of wonder quite like the final frontier. The best space photos show off the beauty of Earth, our solar system, and the far corners of the universe. Here are our current favorites.
Product Review

With the Z7, Nikon gives DSLR holdouts the mirrorless wonder they've waited for

Nikon’s long awaited full-frame mirrorless cameras are here, and the Z7 is the new flagship model. But does it stand up to the company's DSLR pedigree, and, more importantly, does it have what it takes to compete with the likes of Sony?

An IP address vulnerability took down some Google services for 1 hour

It might have been for just a brief hour, but some of Google's services went down on November 12. Caused by an improper rerouting of IP addresses and traffic away from usual western sources, Spotify and Google Cloud were impacted.

How to Install an SSD in a PlayStation 4 or PS4 Pro

SSDs are much faster than mechanical hard drives, which is what the PlayStation 4 and PlayStation 4 Pro come with. Here, we show you how to replace it with an SSD, which will allow you to boot to the OS faster and load games quicker.

Google’s Squoosh will get an image web-ready with in-browser compression

Google's latest web app development is an image editing and compression tool, Squoosh. In just a few clicks, it can take a huge image and make it much lighter and web-friendly, all in your browser.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Should you buy the affordable MacBook Air, or is the MacBook Pro worth the price?

Though they both share Retina Displays and similar keyboards, there are still some specs differences and other changes which distinguish the new 2018 MacBook Air and MacBook Pro. In this guide, we stack the two up against each other.

Want to save a webpage as a PDF? Just follow these steps

Need to quickly save and share a webpage? The best way is to learn how to save a webpage as a PDF file, as they're fully featured and can handle images and text with ease. Here's how.

Installing fonts in Windows 10 is quick and easy -- just follow these steps

Want to know how to install fonts in Windows 10? Here's our guide on two easy ways to get the job done, no matter how many you want to add to your existing catalog, plus instructions for deleting fonts in the process.

After a month of bugs, the Windows 10 October 2018 Update is finally here

After more thoroughly investigating and resolving all bugs and related issues, Microsoft is announcing the Windows 10 October 2018 is again rolling out to consumers starting today, November 13. 

Changing file associations in Windows 10 is quick and easy with these steps

Learning how to change file associations can make editing certain file types much quicker than manually selecting your preferred application every time you open them. Just follow these short steps and you'll be on your way in no time.
Emerging Tech

New simulation shows how Elon Musk’s internet satellite network might work

Elon Musk has the dream of building a network for conveying internet traffic via thousands of satellites. A new simulation created by a computer scientist looks at how feasible the idea is.