Eye-tracking tech lets you control a drone by looking where you want it to move

There are all manner of weird and wonderful control systems being invented to help drone pilots guide their unmanned aerial vehicles through the skies. One that sounds pretty intuitive, though, is laid out in a new piece of research from engineers at New York University, the University of Pennsylvania, and the U.S. Army Research Laboratory. They have invented a method to allow drone pilots to fly using a pair of eye-tracking glasses. What could be simpler?

“This solution provides the opportunity to create new, non-invasive forms of interactions between a human and robots allowing the human to send new 3D-navigation waypoints to the robot in an uninstrumented environment,” Dr. Giuseppe Loianno, assistant professor at New York University and Director of the Agile Robotics and Perception Lab, told Digital Trends. “The user can control the drone just pointing at a spatial location using his gaze, which is distinct from the head orientation in our case.”

The method is both easy to use and self-contained. In terms of hardware, it requires the drone (obviously!), a small computational unit and a pair of Tobii Pro Glasses 2. These gaze-tracking glasses boast an inertial measurement unit (IMU) and a built-in HD camera. Using some smart deep neural network technology and head orientation data from the IMU, the glasses are able to detect where the user is looking and how far away the drone is.

fly drone eye tracking glasses mzeznzexna
New York University

The researchers’ hope is that such technology could be used to aid people with little drone-flying experience to safely fly them without the need for an expert pilot.

“The proposed solution opens up new ways to interpret human attention and create new anticipative human-robot interfaces,” Loianno continued. “We aim to create new ways of interaction between agents. Specifically, we are interested to develop a multi-modal interaction setup — [featuring] visual, vocal [and gesture-based interactions] — and add multiple agents in the framework. We would also [like to] investigate the benefits that the proposed solution can provide to people affected by body or ocular diseases.”

A paper describing the work, titled “Human Gaze-Driven Spatial Tasking of an Autonomous MAV,” was recently submitted to the 2019 International Conference on Robotics and Automation, which will take place in May 2019. Make sure you keep your eyes trained in that direction!

Emerging Tech

Death from above? How we’re preparing for a future filled with weaponized drones

Drones are beginning to enable everything from search & rescue, to the delivery of medicines to hard-to-reach places. But they are also being used as cheap, and deadly flying bombs. How can we defend ourselves?
Emerging Tech

This gadget lets you sleep on airplanes without snuggling a stranger

Odd gadget, or a hug for your face? The Napup Fly+ is a travel pillow, sleep mask, and personal speaker system all rolled into one, attached to the back of the headrest to hold your head up.
Emerging Tech

This intelligent parachute system can bail out clumsy drone pilots

Parachutes can save drones when they unexpectedly fall from the sky. Among a number of such systems, Austrian firm Drone Rescue is this week showing off its latest design that automatically deploys when it senses trouble.
Emerging Tech

Awesome Tech You Can’t Buy Yet: DIY smartphones and zip-on bike tires

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Wearables

Skydio’s self-flying drone now has an Apple Watch app for flight prep

Skydio's clever R1 autonomous drone now has its own Apple Watch app, making flight preparations simpler than ever. The $2,000 flying machine is now also selling at its first retail outlet — Apple Stores in North America.
Emerging Tech

Light-swallowing room promises Call of Duty fans the blackest of ops

What's it like to be in a room fully painted with the world's darkest material, Vantablack? The makers of one of the year's top video games teamed up with Vantablack scientists to find out.
Emerging Tech

Scientists created a condom that self-lubricates during sex. You’re welcome

Researchers from Boston University have invented a special coating for condoms which make them respond to bodily fluids by becoming more slippery. Here's how their new breakthrough works.
Emerging Tech

Are e-cigarettes safe? Here’s what the most recent science says

Ecigarettes are widely regarded and advertised as a healthier alternative to cigarettes for people who are trying to kick the smoking habit. How safe are these cigarette alternatives? We went deep into the recent scientific literature to…
Emerging Tech

You’re so vein: Palm-based biometric system could help confirm your identity

Move over, Face ID! The next biometric security systems could rely on analyzing the unique vein patterns in your palm print. Here are some of the ways the technology could prove useful.
Emerging Tech

For only $4,950, you can get jetpack lessons from the world’s only instructor

Have you ever dreamed of flying using a jetpack? JetPack Aviation founder -- and the world's only qualified jetpack teacher -- David Mayman is now offering a day of flight instruction.
Emerging Tech

Biologists have found a hormone that could make space farming possible

Researchers have shown how space farming may be possible. By encouraging plants to excrete a certain hormone, they’ve demonstrated that crops can thrive despite challenging conditions, such as low-nutrient soil and microgravity.
Emerging Tech

Keep your holiday gift list high tech and under budget with these gadgets

Modern technology doesn't always come cheap, but there plenty of premium devices that don't carry a premium price. Whether you're looking for a streaming device or a means of capturing photos from above, our list of the best tech under $50…
Emerging Tech

When tech goes wrong: Banksy’s shredder was meant to totally destroy his artwork

Banksy's recent auction stunt was meant to totally destroy one of his most famous pieces of work, but a fault with the shredder has left the buyer with something almost certainly worth far more than the $1 million she bid for it.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.