Skip to main content

Disney Research’s robotic eyeballs have a freakishly humanlike stare

Disney Research, the R&D wing of everyone’s favorite Hollywood House of Mouse, has built a robot with uncanny valley-defying gaze interaction that’s so realistic you’ll be convinced that you’re looking at a real person. (Excepting the servo-assisted metallic musculature peeking out from under its robot shell, that is!)

The purpose of the research is to create more realistic “Audio-Animatronics” that could potentially be used at Disney theme parks and elsewhere. Audio-Animatronics are Disney’s name for animatronic robots, created by Walt Disney Imagineering, that both move and make sounds in synchronized fashion. This latest update means that Disney’s robots could potentially lock eyes with visitors and follow them around with their gaze. Depending on the animatronic model this was incorporated into, that could either create an emotional connection with the guest or, potentially, intimidate the bejesus out of them.

“Eye gaze is a significant part of the interactions between people, quite a bit of information is conveyed through movements of the eyes,” Matthew Pan, a postdoctoral associate at Disney Research, told Digital Trends. “We wanted to try to emulate this communication on a robot by designing eye gazing behaviors using principles of animation. We have layered these behaviors using a subsumption architecture proposed over 30 years ago by Rodney Brooks to create complexity and realism.”

A Turing Test for gaze

This new work is described in a research paper recently presented at the IROS (International Conference on Intelligence Robots and Systems) 2020 conference. Along with the Disney Research investigators, the project involved collaborators from the California Institute of Technology, University of Illinois at Urbana-Champaign, and Walt Disney Imagineering

As an article in IEEE Spectrum notes, the investigation is a bit like the gaze version of a Turing Test: An attempt to create a realistic eye-based interaction with humans that aims to be, frankly, indistinguishable from looking into the eyes of another person. While we’ve covered some impressively lifelike robots here at Digital Trends (check out this recent feature on a swimming dolphin robot that could be used to substitute for the real thing in future marine parks), this could be one of the biggest challenges for roboticists. That’s because our brains are so adept at spotting abnormalities in humanlike faces.

So how effective is it? From an outsider’s perspective, it certainly seems an impressive demonstration. Matthew Pan said that he was happy with it — and, from the sound of it, so are his fellow researchers. Even if it’s a bit harder to test that at a time when large-scale tests are harder to do (and some of Disney’s theme parks remain shuttered.)

“Typically, in human-robot interaction research, you conduct user studies with people where they interact with a robot and rate the interaction and give qualitative feedback,” Pan said. He pointed to several tools and metrics that have been established to help quantify these effects. “For this work, the pandemic prevented any human interaction studies from happening. However, as this project progressed, we witnessed that we were creating something quite remarkable. Many of us and our colleagues stepped in front of this animatronic and said ‘Wow! That looks realistic!’ With that, we decided [it was time to share this work.]”

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Say hi to Proteus, Amazon’s most advanced warehouse robot yet
Amazon's Proteus warehouse robot.

Amazon has unveiled its first fully autonomous mobile robot designed to help out at its distribution centers, though it’s not clear if it’ll be ready in time for the company’s fast-approaching and super-busy Prime Day shopping event.

The new robot, called Proteus, is a low-slung, wheel-based machine that trundles about on wheels. At first glance, and even second, it looks very much like a robot vacuum, but this device performs transportation tasks rather than cleaning duties. And just like a robot vacuum, Proteus uses sensors to help it navigate and avoid obstacles, including mobile ones such as humans.

Read more
Spot’s latest robot dance highlights new features
Spot robot dancing.

Boston Dynamics’ Spot robot has hit the dance floor again in a new video that seeks to highlight recent improvements made to the quadruped contraption.

No Time to Dance | Boston Dynamics

Read more
Space station’s new robotic arm springs to life
The European Robotic Arm attached to the space station.

Two spacewalkers at the International Space Station (ISS) activated the facility's new robotic arm for the first time on Thursday, April 28.

Russian cosmonauts Oleg Artemyev and Denis Matveev concluded their spacewalk at  6:40 p.m. ET after 7 hours and 42 minutes outside the ISS, with much of that time spent working on the European Robotic Arm (ERA).

Read more