Skip to main content

Controller? What controller? You fly this drone with your facial expressions

Ready—Aim—Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs
Whether it’s first-person controls that place you in the virtual cockpit of your drone or
Recommended Videos
experiments using brain control interfaces, engineers are exploring all kinds of ways of controlling unmanned aerial vehicles. Roboticists at British Columbia’s Simon Fraser University have stumbled upon an alternative control system, however — and it involves getting users to “throw” drones off on a set trajectory by pulling a series of funny faces.

The project’s official title is Ready-Aim-Fly. This describes the three separate phases required to achieve successful flight. In the “Ready” stage, the modified Parrot Bebop drone learns the user’s face by asking them to hold a neutral expression. You then have to program in a trigger face which is distinct from your neutral expression. The “Aim” phase involves the drone beginning to fly, while making sure that it keeps the user centered in its camera view. The user can then line up their desired trajectory and move away from the drone in order to increase how far it will fly — a bit like pulling the string back on a catapult. Finally, the “Fly” stage sees the drone perform its programmed trajectory.

Ready-aim-fly!

It’s possible to use your expressions to make the drone travel in a straight line, or return to the user like a boomerang. In tests, the Ready-Aim-Fly system was used to dispatch the drone on flights of close to 150 feet outdoors. In all, the idea is pretty darn wacky, but we kind of love the concept of being able to harness recent breakthroughs in image recognition (and particularly facial recognition) in order to issue non-verbal commands to a robot.

“The demo is cute and small scale, but we are serious about this interface,” Richard Vaughan, one of the researchers on the project, told Digital Trends. “The important part is that the robot flies in a parabola, as if it was an object being thrown. People are really good at throwing things, so the interaction is easy to learn in one demonstration. The ability to place a drone in 3D from a quick interaction is new and powerful. With a little practice, one can send the robot over a building, or onto its roof, in a couple of seconds of aiming. The user carries no special equipment and doesn’t need their hands free. Since we did this work, we are now able to read facial expressions very accurately — using the same techniques as the iPhone X animated emojis — so we can send off the robot with a big smile.”

A paper describing the project, titled “Ready-Aim-Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs,” was presented at the Institute of Electrical and Electronics Engineers Canadian Conference on Computer and Robot Vision.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Watch this pest controller use a drone to vacuum up a wasp nest
A drone modified to remove wasp nests.

A company in Japan has unveiled a new contraption that can be loosely described as a drone with a vacuum cleaner attached.

But rather than using it for cleaning hard-to-reach surfaces, the machine is designed to remove troublesome wasp nests.

Read more
New drone owner? Check out this video before you fly
dji mavic 2 pro zoom drone deals best buy summer sale 2020 2018 768x479 c

With drones once again expected to be a hot-ticket item over the holiday season, the Federal Aviation Administration (FAA) has launched a safety campaign urging new pilots to follow the rules and take care.

The effort includes a video (below) highlighting the basics and a “12 days of drones” social media campaign with posts featuring various drone-related safety rules.

Read more
This drone-like ‘flying car’ has just taken a step toward commercialization
SkyDrive SD-03 eVTOL aircraft.

A drone-like electric aircraft developed by a startup in Japan has taken an important step toward commercialization after receiving a safety certificate from the government.

Tokyo-based SkyDrive unveiled an early version of its electric vertical-takeoff-and-landing (eVTOL) vehicle in 2018, before achieving its first piloted test flight last year.

Read more