Skip to main content

Controller? What controller? You fly this drone with your facial expressions

Ready—Aim—Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs
Whether it’s first-person controls that place you in the virtual cockpit of your drone or experiments using brain control interfaces, engineers are exploring all kinds of ways of controlling unmanned aerial vehicles. Roboticists at British Columbia’s Simon Fraser University have stumbled upon an alternative control system, however — and it involves getting users to “throw” drones off on a set trajectory by pulling a series of funny faces.

The project’s official title is Ready-Aim-Fly. This describes the three separate phases required to achieve successful flight. In the “Ready” stage, the modified Parrot Bebop drone learns the user’s face by asking them to hold a neutral expression. You then have to program in a trigger face which is distinct from your neutral expression. The “Aim” phase involves the drone beginning to fly, while making sure that it keeps the user centered in its camera view. The user can then line up their desired trajectory and move away from the drone in order to increase how far it will fly — a bit like pulling the string back on a catapult. Finally, the “Fly” stage sees the drone perform its programmed trajectory.


It’s possible to use your expressions to make the drone travel in a straight line, or return to the user like a boomerang. In tests, the Ready-Aim-Fly system was used to dispatch the drone on flights of close to 150 feet outdoors. In all, the idea is pretty darn wacky, but we kind of love the concept of being able to harness recent breakthroughs in image recognition (and particularly facial recognition) in order to issue non-verbal commands to a robot.

“The demo is cute and small scale, but we are serious about this interface,” Richard Vaughan, one of the researchers on the project, told Digital Trends. “The important part is that the robot flies in a parabola, as if it was an object being thrown. People are really good at throwing things, so the interaction is easy to learn in one demonstration. The ability to place a drone in 3D from a quick interaction is new and powerful. With a little practice, one can send the robot over a building, or onto its roof, in a couple of seconds of aiming. The user carries no special equipment and doesn’t need their hands free. Since we did this work, we are now able to read facial expressions very accurately — using the same techniques as the iPhone X animated emojis — so we can send off the robot with a big smile.”

A paper describing the project, titled “Ready-Aim-Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs,” was presented at the Institute of Electrical and Electronics Engineers Canadian Conference on Computer and Robot Vision.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Facial recognition tech for bears aims to keep humans safe
A brown bear in Hokkaido, Japan.

If bears could talk, they might voice privacy concerns. But their current inability to articulate thoughts means there isn’t much they can do about plans in Japan to use facial recognition to identify so-called "troublemakers" among its community.

With bears increasingly venturing into urban areas across Japan, and the number of bear attacks on the rise, the town of Shibetsu in the country’s northern prefecture of Hokkaido is hoping that artificial intelligence will help it to better manage the situation and keep people safe, the Mainichi Shimbun reported.

Read more
Watch this incredible drone fly-through of Man City’s Etihad Stadium
watch this incredible fpv drone video of man citys stadium city

Soccer giant Manchester City this week secured the English Premier League title, beating archrival Manchester United into second place.

As part of the celebrations, the club has offered its fans -- as well as anyone with an interest in drone photography -- a stunning fly-through of its modern, 55,000-seat Etihad Stadium.

Read more
DJI drone contest invites your best impossible shot
dji air 2s drone one camera sensor news specs price lifestyle 1 of 4

Drone giant DJI has launched a new contest to put your flying skills and creativity to the test, with the winner offered its recently released first-person-view (FPV) drone.

Called the “Impossible Shot Challenge,” the name of the contest gives you a good idea about the kind of entries the company is hoping to receive, though whether your air-based artistry is up to it remains to be seen.

Read more