Performers get real-time appearance changes with Disney’s Makeup Lamps

Developers at Disney Research have designed a new system that illuminates an actor’s face with dynamic effects in real time. Dubbed Makeup Lamps, the system works by adjusting to facial expressions without the need for specific markers, enabling it to project colors or textures, such as facial hair, wrinkles, simulated lighting, and makeup during live performances.

The new system uses a high-speed camera and a high-speed projector aligned on the same optical axis, along with a set of algorithms to track subtle facial movements for dynamic projections. The camera captures images in the infrared spectrum, while the projector illuminates the face with visible light. These combined features enable the system to process images in two (rather than three) dimensions.

In order to increase realism, a primary goal for the research team was to decrease latency — the lag between changing projections.

“The key challenge of live augmentation is latency — the time between generating an image that matches the actor’s pose and when the image is displayed,” Anselm Grundhöfer, principal research engineer at Disney Research, said in a press release. “The larger the latency, the more the actor’s pose will have changed and the greater the potential misalignment between the augmentation and the face.”

Some latency is inevitable, according to the researchers. However, by using Kalman filtering, a method that makes small measurements to predict changes, they were able to cut back on perceived latency by predicting the performer’s next expression. The system still needs to be trained on each performer in order to determine facial boundaries and expression nuances, but the work demonstrates progress, and is the first such system without the need for specific tracking markers.

“We’ve seen astounding advances in recent years in capturing facial performances of actors and transferring those expressions to virtual characters,” said Markus Gross, vice president at Disney Research. “Leveraging these technologies to augment the appearance of live actors is the next step and could result in amazing transformations before our eyes of stage actors in theaters or other venues.”

The team will present their work this week at the European Association for Computer Graphics conference, Eurographics 2017, in France.

Product Review

The 2019 Porsche Macan S is a luxurious and quick SUV, but it's no road tripper

The roster of models challenging the Porsche Macan grows annually. The German firm updated its smallest, most affordable SUV with a new engine, more tech features, and subtle design tweaks to keep it looking fresh.
Mobile

5G’s arrival is transforming tech. Here’s everything you need to know to keep up

It has been years in the making, but 5G is finally becoming a reality. While 5G coverage is still extremely limited, expect to see it expand in 2019. Not sure what 5G even is? Here's everything you need to know.
Photography

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…
Social Media

Snapchat facial recognition could soon power a new portrait mode, code suggests

Digging into Snapchat's code suggests a handful of upcoming camera features, including a portrait mode. The feature appears to use facial recognition A.I. to blur the background. The code also suggests an updated camera interface.
Deals

Take to the skies with these 5 drones on sale for under $50

On the hunt for some cool tech for under $50? We've rounded up 5 drones under $50 that you can still get before Christmas. These models are great for kids, adults, and anyone just getting started with drones.
Emerging Tech

With this robotic garage, retrieving your car is like using a vending machine

Remembering where we parked our cars can be a real pain. But what if our cars came to find us, rather than the other way around? A new automated robot parking valet system aims to help.
Emerging Tech

A lidar-equipped truck knows exactly how much de-icer to apply on roads

Lidar is best known as the laser-based technology that helps self-driving cars sense their surroundings. But the city of Knoxville has another, more seasonal use for it: De-icing roads.
Cars

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…
Emerging Tech

This unusual nature-inspired robot is equally at home on land or in the water

This intriguing, nature-inspired robot may look unusual, but it's impressively capable of moving on both land and water without problem. Heck, it can even travel on ice if necessary.
Emerging Tech

This cryptocurrency wallet for kids isn’t nearly as stupid as it sounds

So you’ve taught your 6-year-old child to read, write, and play nice with others. What’s next? Give them a base understanding of cryptocurrency, of course. This Kickstarter aims to help.
Emerging Tech

Light, speed: Lighting kit for DJI Mavic 2 lets you fly and film in the dark

Lume Cube, maker of small battery-powered LED lights for mobile photography, has announced a new lighting kit built specifically for the DJI Mavic 2 -- the first of its kind. Already our favorite drone, this makes the Mavic 2 even better.
Emerging Tech

Prepare for liftoff: Here are all the important upcoming SpaceX rocket launches

From ISS resupply missions to a host of communication and scientific satellite launches, SpaceX has a busy year ahead. Here's a rundown of some of the company's most important missions slated for the next year.
Emerging Tech

Virgin Galactic’s latest test flight takes it to the edge of space

Sir Richard Branson's Virgin Galactic has successfully carried out its fourth powered flight in Mojave, California. It was the company's most ambitious test flight yet -- and bodes well for the future.
Emerging Tech

We’re going to the Red Planet! All the past, present, and future missions to Mars

SpaceX isn't the only organization pining to visit the Red Planet. Here's a detailed list of all operational and planned missions to Mars, along with explanations of their objectives, spacecraft details, and mission proposals.