Skip to main content

Disney Research develops method to capture 3D facial performances with a single camera

disney research single camera facial performance capture
Disney Research
Capturing an actor’s facial performance in a three-dimensional environment is key to believable animations in movies and video games. The process of accurately modeling a performer’s face — and their full range of expressions — is no easy task, however. But with a new method developed by Disney Research, it’s about to become much simpler.

Unlike traditional facial-performance-capture techniques, which rely on multiple cameras to read depth information, this new method uses only a single camera. And no, it doesn’t require a light-field camera or any other non-traditional imaging device. In fact, the researchers even demonstrated it using both a GoPro and an iPhone, according to a press release first seen on

Single-camera facial-performance capture isn’t completely new, but existing methods require a complex computer model of an actor’s face to be developed ahead of time. That model has to be built with many different expressions programmed into it, otherwise the capture process will generate too many anomalies.

With Disney Research’s new method, information about bone structure and skin thickness is taken into account, which provides an “anatomically constrained” model, thereby keeping the range of available animations limited to what’s physically possible, without the need for as many pre-recorded expressions. The effectiveness of the method was tested by capturing an actor’s face being deformed by a jet of compressed air, something that simply wouldn’t be possible with other single-camera solutions.

Smaller, less complex hardware should make facial performance capture more accessible and easier to do. A single-camera system also allows actors increased freedom of movement during their performances. While typically there exists an inverse relationship between simplicity and capture quality, Disney researchers say their new method bucks the trend.

“No hardware setup could be simpler than our new one-camera method, yet we’ve shown that it can obtain results that rival, if not exceed, more traditional methods,” Markus Gross, vice president of Disney Research, said in the press release.

The project will be presented on July 24 at the ACM International Conference on Computer Graphics & Interactive Techniques (SIGGRAPH) in California.

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
The best 3D printers under $500
3D printers are finally affordable. Here are the best models under $500
anycubic photon review 3d printer xxl 2

The 3D printing market has seen quite a few changes over the last few years. In just the span of a decade, the barrier to entry has dropped from well over several thousand dollars to under $200 in some cases. However, all entry and mid-level printers are not made equal. We have a few suggestions for prospective buyers and other information regarding alternatives not found on this list.

To some veterans of the 3D printing scene, this list may seem like it lacks a few of the most commonly recommended printers for newcomers. This is by design. Our list only considers printers with tested components from proven, reliable vendors. That's why we chose the Monoprice MP Mini v2 as our top pick--it's reliable and easy to use. We have avoided any printer with a frame primarily made from interlocking acrylic pieces and anything historically unreliable.
Most bang for your buck: Monoprice MP Mini v2

Read more
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
The future of making stuff: Inside the evolution of 3D printing with Formlabs
future of 3d printing formlabs ces 2021 castablewax40

When 3D printing went mainstream in the mid-2010s and exploded in popularity, it was about as hyped up as it possibly could be. Evangelists told us it would fundamentally transform the way goods were made, and usher in a bold new era of creative freedom. Soon, they said, we’d be able to fabricate anything we wanted on-demand, Star Trek replicator style, right from the comfort of our own homes.

But of course, 3D printing didn't really live up to that high-flying dream. Instead, it made a momentary splash and then largely returned to the fringes, gaining adoption in hobbyist workshops and cutting-edge product design labs, but not really changing the face of manufacturing in the way many hoped it might.

Read more