Skip to main content

Disney Research’s robotic eyeballs have a freakishly humanlike stare

Disney Research, the R&D wing of everyone’s favorite Hollywood House of Mouse, has built a robot with uncanny valley-defying gaze interaction that’s so realistic you’ll be convinced that you’re looking at a real person. (Excepting the servo-assisted metallic musculature peeking out from under its robot shell, that is!)

Recommended Videos

The purpose of the research is to create more realistic “Audio-Animatronics” that could potentially be used at Disney theme parks and elsewhere. Audio-Animatronics are Disney’s name for animatronic robots, created by Walt Disney Imagineering, that both move and make sounds in synchronized fashion. This latest update means that Disney’s robots could potentially lock eyes with visitors and follow them around with their gaze. Depending on the animatronic model this was incorporated into, that could either create an emotional connection with the guest or, potentially, intimidate the bejesus out of them.

Please enable Javascript to view this content

“Eye gaze is a significant part of the interactions between people, quite a bit of information is conveyed through movements of the eyes,” Matthew Pan, a postdoctoral associate at Disney Research, told Digital Trends. “We wanted to try to emulate this communication on a robot by designing eye gazing behaviors using principles of animation. We have layered these behaviors using a subsumption architecture proposed over 30 years ago by Rodney Brooks to create complexity and realism.”

A Turing Test for gaze

This new work is described in a research paper recently presented at the IROS (International Conference on Intelligence Robots and Systems) 2020 conference. Along with the Disney Research investigators, the project involved collaborators from the California Institute of Technology, University of Illinois at Urbana-Champaign, and Walt Disney Imagineering

As an article in IEEE Spectrum notes, the investigation is a bit like the gaze version of a Turing Test: An attempt to create a realistic eye-based interaction with humans that aims to be, frankly, indistinguishable from looking into the eyes of another person. While we’ve covered some impressively lifelike robots here at Digital Trends (check out this recent feature on a swimming dolphin robot that could be used to substitute for the real thing in future marine parks), this could be one of the biggest challenges for roboticists. That’s because our brains are so adept at spotting abnormalities in humanlike faces.

So how effective is it? From an outsider’s perspective, it certainly seems an impressive demonstration. Matthew Pan said that he was happy with it — and, from the sound of it, so are his fellow researchers. Even if it’s a bit harder to test that at a time when large-scale tests are harder to do (and some of Disney’s theme parks remain shuttered.)

“Typically, in human-robot interaction research, you conduct user studies with people where they interact with a robot and rate the interaction and give qualitative feedback,” Pan said. He pointed to several tools and metrics that have been established to help quantify these effects. “For this work, the pandemic prevented any human interaction studies from happening. However, as this project progressed, we witnessed that we were creating something quite remarkable. Many of us and our colleagues stepped in front of this animatronic and said ‘Wow! That looks realistic!’ With that, we decided [it was time to share this work.]”

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Guinness video celebrates robotic record-breakers
A troupe of dancing robots.

Robots Are Taking Over Record-Breaking - Guinness World Records

Guinness World Records has put together a video featuring robots performing amazing feats.

Read more
Tesla’s Optimus humanoid robot can now dance like Elon Musk
Tesla's Optimus robot dancing.

Elon Musk has just shared a video (below) featuring the latest version of Tesla’s humanoid robot, called Optimus.

https://twitter.com/elonmusk/status/1734763060244386074

Read more
Robot crushes man to death after mistaking him for a box
A smart factory concept.

A robot crushed a man to death after apparently mistaking him for a box, South Korean media reported.

The tragedy occurred on Wednesday evening local time at a vegetable sorting facility in South Gyeongsang province about 150 miles south of Seoul, according to the BBC.

Read more