Stallone in Terminator 2? How one deepfake prankster is changing cinema history

In some parallel universe, there’s a version of Casino Royale with Hugh Jackman playing everyone’s favorite suave British agent, James Bond. And one in which Matthew McConaughey took the Leo role in Titanic. And DiCaprio and Brad Pitt co-starred in Brokeback Mountain. And Saved by the Bell’s Tiffani Thiessen played Rachel in Friends.

The entertainment industry isn’t exactly short on “what if?” scenarios in which actors came close to, but were ultimately passed over, playing iconic roles. For more than 99% of movie history, fans have been able to do little more than squirrel away this trivia for use in pop quizzes. That is until the arrival of deepfakes.

Springing to life in the past couple of years, deepfakes use artificial intelligence technology to combine and superimpose new images and videos onto existing source footage using machine learning. That could mean anything from face swaps to mapping one person’s body onto someone else’s movements. The results can be jaw-droppingly realistic, which is why many people rightfully worry about its potential to be used for malicious hoaxes.

One tech enthusiast and movie buff thinks different, though. Operating under the YouTube username “Ctrl Shift Face,” this high-tech Hollywood fan has used deepfake technology to create some astonishing remixes of iconic movie scenes — complete with all new actors. Ever wanted to see The Shining starring Jim Carrey instead of Jack Nicholson? Sly Stallone in Terminator 2: Judgement Day? Heck, he’s even broken with the movie theme by dropping David Bowie into Rick Astley’s infamous song-turned-meme Never Gonna Give You Up.

“The Bowie one is my favorite,” its creator told Digital Trends. “I wanted to Rickroll people and blow them away at the same time. Bowie fitted the role of Rick Astley, and had interesting facial features for a deepfake.”

“The more the network learns, the more detailed the result will be.”

So who exactly is this prankster mogul who can put some of the world’s biggest actors into movies they never actually appeared in with a few clicks of the mouse? He’s not telling. “I don’t want to share my real name really,” Ctrl Shift Face’s creator explained. “It’s not important, I think. I let my work speak for itself.” He did mention a few personal details, such as his age (31), his place of birth (Slovakia, although he no longer lives there), and the fact that his job involves computer graphics on some level.

Ultimately, however, the fact that we don’t know who is behind Ctrl Shift Face raises an important point about the world of deepfakes. No longer confined to a few top Hollywood special effects houses, this kind of smart CGI wizardry is now available to all comers. It’s code that’s freely available online, capable of placing any actor alive or dead into any movie you can think of. No multi-million dollar salary negotiation or air-conditioned trailer conversation necessary!

“I’m not a coder, just a user,” said Ctrl Shift Face’s creator. “I don’t know the details about exactly how the software works. The workflow works like this: You add source and destination videos, then one neural network will detect and extract faces. Some data cleanup and manual extraction is needed. Next, the software analyzes and learns these faces. This step can sometimes take a few days. The more the network learns, the more detailed the result will be. In the final step, you combine these two and the result is your deepfake. There’s sometimes a bit of post-process needed as well.”

The future of fakes

While his favorite video is, as noted, the Bowie one, the one he feels is objectively the best is the Jim Carrey version of The Shining. Placing the face of the actor behind Ace Ventura: Pet Detective on the body of Jack Nicholson shouldn’t work, but it really, really does. “I had the idea to put a comedic actor into a serious dark scene,” he said. “Jim on Jack seemed like a good match.”

In the near future, it’ll be feasible to realistically recreate an actor’s speech using similar training data.

As for his least favorite? Terminator 2’s face swap with Stallone taking the role made famous by Arnold Schwarzenegger. “I guess my videos mirror my sense of humor,” he said. “For T2, there’s this joke from Last Action Hero, where it’s a sort of alternate universe where Sly played the Terminator.” But he doesn’t feel the results entirely worked, due to his choice to edit the audio to incorporate an impressionist doing a Stallone impersonation.

“I wasn’t able to edit it in seamlessly so the background music and ambient sounds have this noticeable jump,” he noted. “My version of the movie had had only 2.1 audio. Later, I realized if I had used 5.1 audio I could separate the audio channels and easily edit the new voice in. Another big regret was that the Bad to the Bone closing song really should have been Eye of the Tiger. It would have been a far better video than it is now.”

He said that he has heard from studios but “I can’t talk details.” That means we don’t know whether the remixes have been held in high regard or the total opposite. Given Hollywood’s enthusiasm about digitally de-aging actors, or even reincarnating deceased ones by putting their heads onto other actors’ bodies, it seems this technology will increasingly find its way into big-budget blockbusters. But it’s less clear if Tinseltown is happy that such tools are available for everyone.

Things could be about to get even more convincing, too. While the attempt to replace Arnie’s audio on Terminator 2 didn’t work as planned, there are efforts afoot in research labs to pioneer the audio equivalent of deepfakes. That means that, in the near future, it’ll be feasible to realistically recreate an actor’s speech using similar training data.

“That’s out of my expertise,” Ctrl Shift Face’s creator said. “But I may collaborate with people that can do these types of AI voices in the future.”

Emerging Tech

The best deepfakes on the web: Baby Elon, Ryan Reynolds Wonka, and beyond

Deepfakes, the A.I.-aided face-swapping technology that threatens the future of truth as we know it, are everywhere. Here are some of the scariest, funniest, and most convincing we've seen.
Cars

General Motors and Volkswagen are ignoring hybrids to go full electric

GM and VW are done spending money on hybrids, according to a new report. The two massive automakers will direct funds to electric cars instead. Both companies are confident that all-electric power is the future.
Deals

Grab this latest Apple iPad Wi-Fi 32GB with an $81 discount at Walmart

If you're in the market for the newest Apple iPads, Walmart has offered a 25% discount on the latest Apple iPad Wi-Fi 32GB variant. Order yours now for only $249 instead of $330, and save as much as $81.
Deals

Walmart drops a huge $152 discount on the Samsung 55-inch 4K curved smart TV

Today is a great time to order a curved TV as Walmart currently has $152 discount on the Samsung UN55RU7300 55-inch 4K UHD Smart TV. You can get it now for only $548 instead of $700.
Emerging Tech

Astro the dog-inspired quadruped robot can sit, lie down, and… learn?

Move over Spot! Researchers from Florida Atlantic University have built a new dog robot called Astro. Thanks to deep learning technology, it promises to be able to learn just like a real dog.
Health & Fitness

We spit in a ton of test tubes to find the best and most unique DNA tests

DNA tests aren’t just limited to ancestry. You can test for your risks for certain diseases, the best workouts and diets for your health and fitness, and more.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Racing drones and robotic ping pong trainers

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Artificial tree promises to suck up as much air pollution as a small forest

Startup Biomitech has developed an artificial tree that it claims is capable of sucking up as much air pollution as 368 real trees. It could be a game-changer for cities with limited free space.
Emerging Tech

Mars 2020 rover now has a rotating array of drill bits for sampling Martian rock

Most the key components in the Mars 2020 rover are installed and ready to go. The next phase of construction was to install the bit carousel, an important mechanism for the gathering and sorting of samples from the Martian surface.
Emerging Tech

NASA selects landing site candidates for OSIRIS-Rex to sample asteroid Bennu

Last year, the OSIRIS-REx craft arrived at asteroid Bennu, from which it will collect a sample from the asteroid to be brought back to Earth. Now, the NASA team has selected four potential sites to choose from for the sampling mission.
Emerging Tech

NASA wants to send two more missions to Mars to collect rock samples

With its Mars 2020 mission, NASA hopes to collect samples from the surface of the planet. The challenge is how to get those samples back to Earth. Now, NASA has revealed its plans for two followup missions to Mars.
Emerging Tech

Eric Geusz: Apple engineer by day, spaceship designer by night

An Apple software engineer by day, artist Eric Geusz spends his nights drawing everyday household objects as amazing, science fiction-style spaceships. Check out the impressive results.
Emerging Tech

The black hole at the center of our galaxy is flaring and no one knows why

At the heart of our galaxy lies a supermassive black hole, Sagittarius A*. Normally this giant monster is relatively docile, but recently it's been a hotbed of unexpected activity, rapidly glowing 75 times brighter than normal.
Emerging Tech

SpaceIL’s crashed lander may have sent thousands of tardigrades to the moon

When the SpaceIL craft Beresheet crashed into the moon earlier this year, it left more than just an impact mark. Thousands of micro-animals called tardigrades were along for the ride and may have survived the crash.