Eye-tracking tech lets you control a drone by looking where you want it to move

There are all manner of weird and wonderful control systems being invented to help drone pilots guide their unmanned aerial vehicles through the skies. One that sounds pretty intuitive, though, is laid out in a new piece of research from engineers at New York University, the University of Pennsylvania, and the U.S. Army Research Laboratory. They have invented a method to allow drone pilots to fly using a pair of eye-tracking glasses. What could be simpler?

“This solution provides the opportunity to create new, non-invasive forms of interactions between a human and robots allowing the human to send new 3D-navigation waypoints to the robot in an uninstrumented environment,” Dr. Giuseppe Loianno, assistant professor at New York University and Director of the Agile Robotics and Perception Lab, told Digital Trends. “The user can control the drone just pointing at a spatial location using his gaze, which is distinct from the head orientation in our case.”

The method is both easy to use and self-contained. In terms of hardware, it requires the drone (obviously!), a small computational unit and a pair of Tobii Pro Glasses 2. These gaze-tracking glasses boast an inertial measurement unit (IMU) and a built-in HD camera. Using some smart deep neural network technology and head orientation data from the IMU, the glasses are able to detect where the user is looking and how far away the drone is.

fly drone eye tracking glasses mzeznzexna
New York University

The researchers’ hope is that such technology could be used to aid people with little drone-flying experience to safely fly them without the need for an expert pilot.

“The proposed solution opens up new ways to interpret human attention and create new anticipative human-robot interfaces,” Loianno continued. “We aim to create new ways of interaction between agents. Specifically, we are interested to develop a multi-modal interaction setup — [featuring] visual, vocal [and gesture-based interactions] — and add multiple agents in the framework. We would also [like to] investigate the benefits that the proposed solution can provide to people affected by body or ocular diseases.”

A paper describing the work, titled “Human Gaze-Driven Spatial Tasking of an Autonomous MAV,” was recently submitted to the 2019 International Conference on Robotics and Automation, which will take place in May 2019. Make sure you keep your eyes trained in that direction!

Emerging Tech

Awesome Tech You Can’t Buy Yet: Grow veggies indoors and shower more efficiently

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Gaming

These Xbox One exclusives are the definition of quality over quantity

Xbox One has a prestigious collection of handpicked titles that you can't play on other consoles. Here are the latest and greatest Xbox One exclusives, including some that are also available on PC
Gaming

These are the must-have games that every Xbox One owner needs

More than four years into its life span, Microsoft's latest console is finally coming into its own. From Cuphead to Halo 5, the best Xbox One games offer something for players of every type.
Gaming

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.
Health & Fitness

Immune cell discovery takes us one step closer to a universal flu vaccine

A group of international researchers have made a discovery which could take us one step closer to the universal, one-shot flu vaccine that people around the world have been dreaming of.
Photography

NASA celebrates Earth’s incredible natural beauty with free photo book

NASA has published a fabulous new book featuring stunning imagery captured by its satellites over the years. A hardback version is available for $53, though it can also be downloaded to ebook readers for free, and enjoyed online.
Deals

This new all-in-one flashlight is a power bank, lighter, and screwdriver

The Pyyros modular flashlight can perform numerous field tasks, from hammering to starting fires. If you back it on Kickstarter now, you can score some savings on this innovative flashlight and multi-tool, but act fast: This early-bird…
Movies & TV

Hilarious new Kickstarter aims to fix Scorcese’s last scene in The Departed

A fan of The Departed and apparent hater of rat-as-symbolism imagery has launched a Kickstarter campaign to digitally erase the rodent from the end of Martin Scorsese’s 2006 movie.
Emerging Tech

Baristas beware, Bbox cafe uses robots to brew your morning coffee

Want your morning coffee and pastry prepared by robot? Bbox, a new coffee shop in downtown Berkeley, California, lets customers place their order by app and then uses automation to take care of the rest.
Emerging Tech

This ridiculous new flamethrower makes Elon Musk’s look like a cigarette lighter

The XL18 Flamethrower is a flame-shooting beast on steroids, capable of firing off bursts of flame more than 110 feet in length. The best part? You can order it over the internet today.
Emerging Tech

SpaceX just nailed its most challenging Falcon 9 rocket landing to date

If you've been following the SpaceX launch calendar, you know this week marks the first launch from Cape Canaveral in two months. We have the details on where you can watch the launch live.
Emerging Tech

Touchdown! Japan successfully lands its Hayabusa2 spacecraft on asteroid Ryugu

Japan's space agency has just completed the latest stage of its extraordinarily complex mission, successfully landing its Hayabusa2 spacecraft on an asteroid millions of miles from Earth.
Emerging Tech

Delivery drones: NASA to test advanced traffic control system for cities

Delivery drone services are edging closer as NASA prepares to demonstrate its advanced drone traffic management system, which it claims offers safe and effective control of autonomous aircraft in urban areas.
Emerging Tech

Kickstarter campaign aims to help make 3D-printed space habitats for Mars

Mars X-House is an ambitious project that's intended to create a prototype future Mars habitat using 3D printing. And, thanks to a new Kickstarter campaign, you can be a part of it.