Skip to main content
  1. Home
  2. Computing
  3. Virtual Reality
  4. News

Leap Motion is pioneering how users interface with menus in mixed reality

Add as a preferred source on Google
Image used with permission by copyright holder

Along with advancing the idea of augmented reality “goggles” that have their own AR headset, Leap Motion may also pioneer a new way to interface with menus in its mixed reality environments. In a new demonstration of a prototype in the works, Leap showed off how its translucent user interface can be moved around, minimized, tapped, touched, and dragged wherever the user wants.

There are a number of aspects of augmented reality that still need a lot of work and experimentation. Although some standards of quality and interaction are coming together, menus are one item that nobody has quite figured out how to do just right yet. Leap Motion, best known for its VR hand trackers, is taking steps to figure this out though and its newest demo could point to a future where the headset wearer controls the interface just as much as the interface controls the augmented environment.

Recommended Videos

Another day at the augmented office. Our latest foray into #AR design with #ProjectNorthStar makes your entire world interactive. pic.twitter.com/SB8SNidbCG

— Ultraleap Developers (@ultraleap_devs) April 24, 2018

The system shown off in the tweet leverages Leap Motion’s prototype “Project Northstar” headset to enable virtual menus that float around the user in augmented space. We’re shown how they are translucent, to allow for a better view of the world around the user while still enjoying the information and digital functionality they provide. They won’t necessarily be in the user’s face all of the time though, as we’re shown how they can be moved to where is most appropriate in the 3D space, as well as minimized entirely in easy-to-grab locations such as on the edge of a desk.

Certain interactions with the menus were also showcased, including menus that react to motion that occurs near them, and buttons and sliders that are easily manipulated. As RoadToVR highlights, too, the fact that each menu appears to have some sort of visual weight to it should engender a more natural feel to the system in an augmented space.

Unlike some demos of augmented reality that we’ve seen in the past, Leap Motion makes it clear that there is “zero trickery” going on in this short video; everything is shot through the headset, giving us the best look we can get of what Leap Motion’s AR UI might look like in the future.

It’s all still very early stages though. Project North Star was only announced earlier this month, though it does offer an impressive feature set of low-latency, high-resolution displays and a 100-degree field of view. Leap Motion suggested production costs could be under $100 per headset when produced in high volumes.

Jon Martindale
Jon Martindale covers how to guides, best-of lists, and explainers to help everyone understand the hottest new hardware and…
Claude’s Sonnet 5 is built to do more on its own and cost you less
Better than its predecessor, nearly as good as the flagship, and meaningfully cheaper than both.
Art, Floral Design, Graphics

Every major AI lab is racing to prove its models can work autonomously with minimal hand-holding; we’re now seeing pricing emerge as the next battleground. 

Anthropic just fired its latest shot, Claude Sonnet 5, a model the company says performs nearly as well as its flagship Opus 4.8 at a fraction of the cost.

Read more
Apple Creator Studio adds AI tools across Final Cut Pro, Logic Pro and Pixelmator Pro
Final Cut Pro gets AI captions, Auto Mask and better Pixelmator Pro workflows in Creator Studio update
Computer Hardware, Electronics, Hardware

Apple has introduced a major update to Apple Creator Studio, adding new AI features, deeper Pixelmator Pro integration, and workflow upgrades across Final Cut Pro, Logic Pro, Keynote, Pages, Numbers, Motion, Compressor, Freeform, and Final Cut Camera.

The update makes Creator Studio more useful across Mac, iPad, and iPhone, especially for people who move between video editing, image editing, presentations, documents, spreadsheets, and music production.

Read more
AI browsers like Perplexity Comet can be tricked into spilling your password through BioShocking exploit
Six AI browsers were found leaking saved passwords and many of them haven't fixed it yet.
MacBook Air in hand, Comet browser loaded—let’s see what Perplexity’s AI can really do

Security researchers just found a strange way to trick AI browsers into handing over your passwords. They managed to trick AI browser agents into exposing sensitive data like saved passwords, session cookies, and private tokens by disguising the theft as part of a harmless "game."

The technique is called BioShocking, named after the popular video game BioShock, where a brainwashed character is manipulated into believing a false reality. Once an AI browser falls for the same trick, it stops following its own safety rules entirely.

Read more