Eye-tracking tech lets you control a drone by looking where you want it to move

There are all manner of weird and wonderful control systems being invented to help drone pilots guide their unmanned aerial vehicles through the skies. One that sounds pretty intuitive, though, is laid out in a new piece of research from engineers at New York University, the University of Pennsylvania, and the U.S. Army Research Laboratory. They have invented a method to allow drone pilots to fly using a pair of eye-tracking glasses. What could be simpler?

“This solution provides the opportunity to create new, non-invasive forms of interactions between a human and robots allowing the human to send new 3D-navigation waypoints to the robot in an uninstrumented environment,” Dr. Giuseppe Loianno, assistant professor at New York University and Director of the Agile Robotics and Perception Lab, told Digital Trends. “The user can control the drone just pointing at a spatial location using his gaze, which is distinct from the head orientation in our case.”

The method is both easy to use and self-contained. In terms of hardware, it requires the drone (obviously!), a small computational unit and a pair of Tobii Pro Glasses 2. These gaze-tracking glasses boast an inertial measurement unit (IMU) and a built-in HD camera. Using some smart deep neural network technology and head orientation data from the IMU, the glasses are able to detect where the user is looking and how far away the drone is.

fly drone eye tracking glasses mzeznzexna
New York University

The researchers’ hope is that such technology could be used to aid people with little drone-flying experience to safely fly them without the need for an expert pilot.

“The proposed solution opens up new ways to interpret human attention and create new anticipative human-robot interfaces,” Loianno continued. “We aim to create new ways of interaction between agents. Specifically, we are interested to develop a multi-modal interaction setup — [featuring] visual, vocal [and gesture-based interactions] — and add multiple agents in the framework. We would also [like to] investigate the benefits that the proposed solution can provide to people affected by body or ocular diseases.”

A paper describing the work, titled “Human Gaze-Driven Spatial Tasking of an Autonomous MAV,” was recently submitted to the 2019 International Conference on Robotics and Automation, which will take place in May 2019. Make sure you keep your eyes trained in that direction!

Emerging Tech

Awesome Tech You Can’t Buy Yet: Plant-based shoes and a ukulele learning aid

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Home Theater

What is Dolby Atmos Music, and how can you experience it?

Dolby Atmos is a surround sound format that creates immersive, 3D soundtracks to make movies come alive. But the same technology is also being adopted for music creation, and it's a game-changer. Here's everything you need to know.
Emerging Tech

Sloshed drone pilots in Japan can now be punished with jail time

If you're flying a drone in Japan, better not be sloshed when you send your bird skyward. A new law passed this week could see drunk drone pilots sent to jail for up to a year or hit with a hefty fine.
Emerging Tech

Uber Eats’ drone delivery service could see Big Macs hit speeds of 70 mph

Uber Eats is testing meal delivery using drones. The company wants to start a commercial delivery service using the drone this summer, but it still needs permission from regulators.
Emerging Tech

This drone with hands looks like a nightmare straight out of Black Mirror

This unlikely drone-with-hands creation is the work of Federico Ciccarese, the brains behind YouBionic, a bionic hand project that has evolved far beyond its original brief. Check it out.
Emerging Tech

This crazy-looking robot uses microspines on its legs to climb up walls

Researchers at Carnegie Mellon have built a bioinspired robot, which uses microspines on its feet to grip onto rough surfaces. This allows it to climb up very steep gradients. Check it out.
Emerging Tech

Got $400 million to burn? The world’s largest airplane is up for sale

Stratolaunch, the world's largest airplane, is up for sale. All it'll cost you is $400 million dollars. The brainchild of late Microsoft co-founder Paul Allen, the plane was supposed to make space travel more accessible and affordable.
Digital Trends Live

Digital Trends Live: Florida’s autonomous vehicle law, E3 updates, and more

On this episode of DT Live, we take a look at the biggest trending stories in tech, including Florida allowing fully autonomous vehicles on the road, Atari’s new gaming system, E3 updates, high-speed rail, and more.
Emerging Tech

Ex astris, scientia: Star Trek logo spotted on the surface of Mars

The Mars Reconnaissance Orbiter has been boldly going to Mars and capturing images since 2005, and now it has spotted something where no man has gone before: a structure on the planet's surface which will look familiar to Trekkies.
Emerging Tech

Adobe develops tool to identify Photoshopped images of faces

With deepfake videos making headlines, and campaigns against the Photoshopping of models, people are more aware than ever of the digital manipulation of images. Now Adobe wants to give tools to users to let them spot faked images.
Emerging Tech

NASA’s Mars 2020 rover will pave the way for manned missions to Mars

Survival on Mars is a massive challenge for humanity. To cope with the highly variable temperatures, lack of oxygen and water, and high levels of radiation, the Mars 2020 rover will carry instruments to pave the way for human exploration.
Emerging Tech

Facebook builds virtual homes to train A.I. agents in realistic environments

Researchers at Facebook have created Habitat, which is a platform that enables rapid training for A.I. agents. They will receive thousands of hours of training in just a few minutes in the virtual homes.
Emerging Tech

Impossible Foods struggles to keep up with Impossible Burger demand

Red Robin and White Castle have reported Impossible Burger shortages, as it appears that Impossible Foods is struggling to keep up with demand. The company will be selling its meat-like patties in retail outlets within the year.
Emerging Tech

Pass the salt please: Table salt found on Jupiter’s moon Europa

Astronomers have spotted something unexpectedly familiar on the surface of Jupiter's moon Europa -- sodium chloride, better known as table salt. This suggests the under-ice oceans on Europa are salty and similar to our oceans on Earth.