Skip to main content

How digital face mapping helped time (and Falcon) fly in The Winter Soldier

Five films are nominated for an Academy Award in the “Visual Effects” category this year, and they each offer a nice look at the amazing tricks filmmakers and their effects teams can pull off on the big screen. In recognition of these five films and one of our favorite Oscar categories, we’re putting the spotlight on one “Visual Effects” nominee each day leading up to Sunday’s broadcast, and taking a closer look at what made them stand out.

First up is one of the two Marvel Studios movies nominated this year, Captain America: The Winter Soldier, which made innovative use of digital face-mapping techniques to send one character flying through the air, and make another look her age.

In the past few years, superhero movies have become a popular outlet for visual-effects studios to show off their own superpowers. But amid all the explosions and larger-than-life sequences that offer no shortage of eye candy, it’s often the more subtle tricks of the trade that provide the biggest challenge – and generate the most pride when they’re pulled off successfully.

Marvel Studios’ Captain America: The Winter Soldier was packed to the brim with intense action sequences that culminated in a sequence featuring several flying aircraft carriers engaging in a massive firefight high above Washington, D.C. However, one of the most important VFX techniques used in the film had nothing to do with creating fiery havoc in the skies, and everything to do with getting up-close and personal with various cast members’ faces.

Early in the film, Captain America (Chris Evans) is shown visiting his former girlfriend, Peggy Carter, who has aged more than 70 years since he last saw her during the events of Captain America: The First Avenger. The pair share a tender moment as the still-young superhero and the woman he lost to time ponder what might have been, had he not been lost in the frozen sea for so many decades.

“Let’s try something that we’ve never done before.”

Actress Hayley Atwell admitted that when she intially read the script for the film, she knew that her character’s advanced age would likely mean she would be “up to the eyeballs in prosthetics.”

For Lola VFX, the visual-effects studio tasked with aging the 33-year-old actress more than 60 years, that was indeed the initial plan. But after several makeup and prosthetic trials, plans changed. The team originally planned to digitally merge Atwell’s makeup-free performance with sequences of her performing the same scene in various stages of makeup and prosthetics, but the process never quite blended the way the artists hoped.

“With each iteration of the test, the make-up artist would make the appliances thinner and thinner, and by the end was some of the best prosthetics I’d seen,” recalled Lola visual-effects supervisor Edson Williams in an interview with FX Guide. “But it still wasn’t quite what we were looking for.”

After hiring an older actress to perform the same scene in order to get a better idea of where the makeup went wrong, the team decided to try a new approach to making Peggy Carter look her age.

“I said, ‘Let’s try something that we’ve never done before,’” said Williams. “I wanted to take the performance of the elderly woman that we had shot in a rig with eight cameras and project the skin onto the original Hayley footage that had been shot on set.”

Oscar-Effects-Captain-America-Winter-Soldier-001
Digital effects artists used features from an older actress superimposed upon the 33-year-old actress playing Peggy Carter to convincingly age her decades. Marvel/Lola VFX

The end result was an emotional scene in which many of Atwell’s subtle gestures – the movement of her eyes and mouth, for example – are retained and visible beneath the digital overlay of the older actress’ skin and facial features, wrinkles and all. Perfecting the technique required them to record multiple versions of the older actress performing the scene, mimicking Atwell’s delivery of the lines, then having the sequences time-adjusted to fall perfectly in sync with each other before the digital mapping could even begin.

Once the scenes were in sync, portions of the older actress’ face could be mapped to Atwell’s face using digital editing techniques that matched tiny portions of animated points on each face and blended them together.

“We matched the lighting, the timing and performance and literally stole the creases and cracks and put them onto Hayley,” said Williams of the process.

For the film’s visual-effects supervisor, Dan DeLeeuw, that quiet scene is one of the elements he’s most proud of in The Winter Soldier.

“There’s only so much you can do to an actor before they just can’t take it anymore.”

“What we end up with, I think, is probably a game-changer in approaching old-age makeup,” he told HitFix during a recent interview.

That scene wasn’t the only part of the film to benefit from facial-mapping effects, either. One of the film’s most action-heavy sequences also required some extensive use of digital editing of an actor’s face.

During the climactic mid-air battle involving the massive S.H.I.E.L.D. helicarriers, Anthony Mackie’s character stages a death-defying assault on one of the hovering battleships using high-tech wings that allow him evade a heavily armed aircraft with fantastic acrobatic maneuvers. The fast-moving, action-heavy set piece could easily have been relegated to a full-on digitally rendered sequence, but instead, Mackie can be seen setting his jaw in mid-dive, grimacing at close calls, and otherwise clearly involved in the action.

“There’s only so much you can do to an actor before they just can’t take it anymore,” said Deleeuw of the sequence. “Initially most of the shots with Mackie were close-ups. We’ll shoot the close-up with him on the wire. Some of those shots where we couldn’t get him to hang right, we would just kind of remove his body and just keep his face – so even the close-up shots are digi doubles.”

In order to get the facial models just right, Mackie was required to stand in a “dome” of cameras that could record every angle of his expressions in order to properly replicate them as his character spins, flips, and careens through the sky. These facial models were then blended with the digitally created portions of the sequence, and later merged with the practical effects and wire-work sequences.

Actor Anthony Mackie performed some stunts “on the wire” in real life, and appears in other flying scenes by having his face digitally mapped to a virtual stand-in.
Actor Anthony Mackie performed some stunts “on the wire” in real life, and appears in other flying scenes by having his face digitally mapped to a virtual stand-in. Marvel

“We spent a lot of time in previs [a type of mockup] making sure we could imagine, for example, how we would shoot him if we were just going to photograph him,” recalled Deleeuw during an interview with Animation World Network. “If you truly had a guy with a rocket pack, and you had a rocket pack to follow him around, how would you photograph him? We tried to maintain that sense of realism and then seamlessly get those visual effects into the film.”

All of these techniques came together to form a wild, airborne chase sequence that helped make Mackie’s character one of the film’s standout stars – and the latest and greatest new superhero to emerge from the Marvel movie-verse.

Of course, if Captain America: The Winter Soldier and its visual-effects team takes home an Academy Award this year, Mackie’s high-flying Falcon won’t be Marvel Studios’ only new hero.

Come back tomorrow for another installment of our Oscar Effects series that looks at each of this year’s Academy Award visual-effects nominees.

Rick Marshall
Former Contributing Editor, Entertainment
A veteran journalist with more than two decades of experience covering local and national news, arts and entertainment, and…
Erin Brockovich is the movie you need to stream on Peacock this month
A woman and man walk down the street while holding coffee.

The year 2000 was an excellent one for director Steven Soderbergh. He directed not one, but two Best Picture nominees. Plus, Soderbergh took home the Oscar for Best Director for Traffic.

The other movie he made that year is even better than Traffic. Erin Brockovich, starring Julia Roberts at the peak of her powers, follows a single mother of three children who discovers a massive coverup being perpetuated by a major energy company. Here are three reasons you should check it out while it's on Peacock:

Read more
Amazon announces Prime Day 2025 will be July 8-11
Best Prime Day Amazon Deals

Amazon officially announced two major things about Amazon Prime Day 2025 today: the exact dates of the sale and a surprise about its length. Prime Day 2025 will run from July 8 through 11, confirming our suspicions of a mid-July date and surprising us by doubling the usual runtime for the event.

Historically, Prime Day has been two days long. The dates jump around every year, but the length has stayed consistent. Amazon announced the dates with a press release and a commercial featuring Lebron James imagining his post-NBA career.

Read more
Deliver Me from Nowhere trailer: Jeremy Allen White as Bruce Springsteen could lead to Oscars
Jeremy Allen White puts his arm in the air and sings into a mic.

Jeremy Allen White grabs his guitar and rocks out as Bruce Springsteen in the official trailer forĀ Springsteen: Deliver Me from Nowhere.

Springsteen and the E Street Band were red-hot entering the '80s following a string of successful albums, including Born to Run, Darkness on the Edge of Town, and The River. On the cusp of superstardom, the Boss grappled with his past and the pressures of being a rock star. Deliver Me from Nowhere picks up in the early '80s and chronicles the making of Nebraska, Springsteen's 1982 album that many consider his true masterpiece.

Read more