Skip to main content

Performers get real-time appearance changes with Disney’s Makeup Lamps

Makeup Lamps: Live Augmentation of Human Faces via Projection
Developers at Disney Research have designed a new system that illuminates an actor’s face with dynamic effects in real time. Dubbed Makeup Lamps, the system works by adjusting to facial expressions without the need for specific markers, enabling it to project colors or textures, such as facial hair, wrinkles, simulated lighting, and makeup during live performances.

The new system uses a high-speed camera and a high-speed projector aligned on the same optical axis, along with a set of algorithms to track subtle facial movements for dynamic projections. The camera captures images in the infrared spectrum, while the projector illuminates the face with visible light. These combined features enable the system to process images in two (rather than three) dimensions.

In order to increase realism, a primary goal for the research team was to decrease latency — the lag between changing projections.

“The key challenge of live augmentation is latency — the time between generating an image that matches the actor’s pose and when the image is displayed,” Anselm Grundhöfer, principal research engineer at Disney Research, said in a press release. “The larger the latency, the more the actor’s pose will have changed and the greater the potential misalignment between the augmentation and the face.”

Some latency is inevitable, according to the researchers. However, by using Kalman filtering, a method that makes small measurements to predict changes, they were able to cut back on perceived latency by predicting the performer’s next expression. The system still needs to be trained on each performer in order to determine facial boundaries and expression nuances, but the work demonstrates progress, and is the first such system without the need for specific tracking markers.

“We’ve seen astounding advances in recent years in capturing facial performances of actors and transferring those expressions to virtual characters,” said Markus Gross, vice president at Disney Research. “Leveraging these technologies to augment the appearance of live actors is the next step and could result in amazing transformations before our eyes of stage actors in theaters or other venues.”

The team will present their work this week at the European Association for Computer Graphics conference, Eurographics 2017, in France.

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more