eyeSight wants to bring gesture control to smartphone-based VR

eyesight gesture control virtual reality
Virtual reality and augmented reality are both on the rise, but companies are still figuring out the best way to input commands for altered reality devices. Devices like the Oculus Rift rely on more traditional controllers, but as time goes on there are sure to be better ways to input information. Like with our hands.

eyeSight Technologies’ new tech allows you to input commands into augmented or virtual reality devices without the need for extra hardware. In other words, with this tech, you can control even smartphone-based augmented and virtual reality.

“As the era of virtual reality emerged the need for natural touch-free control over virtual content became ever so clear, as no buttons or controllers can provide a truly immersive virtual experience like control using the hands,” Gideom Shmuel, CEO of eyeSight Technologies, told Digital Trends. “Allowing users to interact with virtual content by simply pointing a finger elevates the entire experience with VR, and this is something we seek to do on a mass market scale.”

The tech uses the rear-facing camera of both Android and iOS phones, through which it can detect motion. By using this motion, your hands can control different aspects of the interface in virtual and augmented reality. In the example given we can see a game being controlled in augmented reality, however it could also be used in virtual reality — while you wouldn’t see the image being captured through the camera, that doesn’t mean that image data can’t be analyzed.

Of course, all this is still in its early stages, and it sounds like a pretty processor-hungry technology, especially considering the fact that smartphone-based augmented and virtual reality apps are already a big strain on a smartphone. Add in camera use, plus the fact that images have to be analyzed in real-time, and that smartphone has a lot to take care of. Still, that doesn’t mean the technology isn’t cool. As smartphones get better, virtual reality and augmented reality on smartphones will also get better, and eyeSight’s new tech could open the door to a range of cool new apps.

“Most VR and AR applications require user interaction, and our aim is to truly transform the experience into an immersive one with touch-free control,” continued Shmuel. “We seek to bring our computer vision technology to applications requiring human interaction such virtual conferencing for example where participants in a virtual meeting can point at screens and documents, educational purposes like navigating through virtual medical procedures, or even pointing at a painting in a virtual museum to learn about its features.”

To date there haven’t really been many gesture-controlled smartphone VR apps, although a quick search does turn up a gesture-controlled VR video player. It will be interesting to see how gesture control can change smartphone-based virtual reality.

Updated on 05-17-2016 by Christian de Looper: Added comments from eyeSight CEO Gideom Shmuel.


Peloton’s tech lets truckers play follow the leader to boost fuel economy

Peloton Technology can help semi trucks save fuel by running close together on the highway. Using short-range wireless communications, the trucks get a kind of super cruise control.
Smart Home

With focus on interoperability, is Nevo Butler a smarter home hub?

Universal Electronics is the latest company getting into the smart home market, announcing at CES 2019 that it intends to market the Nevo Butler, a new smart home hub with onboard A.I. and voice control technology.

Take a trip to a new virtual world with one of these awesome HTC Vive games

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.

What is fixed wireless 5G? Here’s everything you need to know

Here's fixed wireless 5G explained! Learn what you need to know about this effective new wireless technology, when it's available, how much it costs, and more. If you're thinking about 5G, this guide can help!

Razer’s Wireless Charger will turn your desk into gamer heaven

The Razer Wireless Charger adds colorful flair to your desk or bedside table. It works with any phone that supports Qi wireless charging -- with some quirks -- but is it worth the high price tag? We take a look.
Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Xbox app lets you access your console while away from home. Here's how

Microsoft's Xbox allows you to access your profile information and launch media content directly from your mobile device. Check out our quick guide on how to connect your smartphone to an Xbox One.

The best Apple Watch bands and straps to stylize your timepiece

If you have an Apple Watch, you know how easy it is to take off the strap it came with, so why not buy yourself another one? Here, we've gathered the best Apple Watch bands we've seen so far. There's something for everyone.

How to choose an iPad in 2019: A practical guide to Apple’s tablets

Selecting an iPad from Apple's lineup can be intimidating, but it doesn't have to be. Our comprehensive guide should put the numbers and specs in practical, easy-to-understand terms. Find your ideal iPad with the help of our guide.

Apple resurrects the iPhone SE with brand-new units starting at $249

Apple quietly started selling the iPhone SE again, at even lower prices than when it was discontinued four months ago. Brand new units of the 32GB version are on sale for $249, while the 128GB version is going for $299.

Popular Android navigation apps are just Google Maps with ads, researcher says

A malware researcher found that 19 free Android navigation apps on the Google Play Store were nothing more than Google Maps, but with ads. One of the apps asked for a payment to remove the ads, while some of them presented security risks.

Google Maps will now help drivers stay within speed limits, avoid speed traps

Google Maps will now start showing speed limits and speed camera locations, so that drivers will not be flagged for speeding tickets. The new features arrive to the app years after they were introduced in Waze.

Text up a storm with the best messaging apps for iOS and Android

These days, most people tend to favor digital messages over phone calls. We have the best messaging apps that allow you to share photos and documents, send text messages, and more with end-to-end encryption.