Skip to main content

Are deepfakes a dangerous technology? Creators and regulators disagree

Over the past few years, deepfakes have emerged as the internet’s latest go-to for memes and parody content.

It’s easy to see why: They enable creators to bend the rules of reality like no other technology before. Through the magic of deepfakes, you can watch Jennifer Lawrence deliver a speech through the face of Steve Buscemi, see what Ryan Reynolds would’ve looked like as Willy Wonka, and even catch Hitler and Stalin singing Video Killed The Radio Star in a duet.

Recommended Videos

For the uninitiated, deepfake tech is a form of synthetic media that allows users to superimpose a different face on someone else’s in a way that’s nearly indistinguishable from the original. It does so by reading heaps of data to understand the face’s contours and other characteristics to naturally blend and animate it into the scene.

Ryan Reynolds as Willy Wonka Deepfake from NextFace
NextFace/Youtube

At this point, you’ve probably come across such clips on platforms like TikTok (where the hashtag “#deepfake” has about 200 million views), YouTube, and elsewhere. Whether it’s to fulfill fan fiction and redo scenes with stars they wish the movie originally had cast or put a dead person in a modern, viral meme, deepfakes have been adopted as a creative outlet for purposes that were previously next to impossible.

The shift has spawned a league of new creators like Ctrl Shift Face, whose deepfake videos regularly draw millions of views and often are the main topic of discussion on late-night talk shows.

“It’s a whole new way of making funny internet videos, or telling stories like we’ve never seen before,” says the Netherlands-based creator behind the hit “The Avengers of Oz” deepfake clip who asked that his real name not be used. “It’s a beautiful combination of fascination for A.I. technology and humor.”

But there’s a looming risk that threatens the future of deepfake technology altogether: Its tainted reputation.

With great power comes great repostability

Unfortunately, in addition to their potential as a creative tool for well-intentioned video artists, deepfakes also carry a tremendous potential to do harm.

A recent study by the Dawes Centre for Future Crime at the UCL Jill Dando Institute of Security and Crime Science labeled deepfakes the most serious A.I.-enabled threat. Sen. Ben Sasse, a Nebraskan Republican who has introduced a bill to criminalize the malicious creation of deepfakes, warned last year that the technology could “destroy human lives,” “roil financial markets,” and even “spur military conflicts around the world.”

To an extent, these concerns are fair. After all, the proliferation of deepfake technology has already enabled things like the production of fake adult content featuring celebrities, and lifelike impersonations of politicians for satire. Earlier this year, Dan Scavino, White House social media director, tweeted a poorly manipulated clip, which was also retweeted by President Donald Trump, of Trump’s rival Joe Biden asking people to re-elect Trump.

Trump retweeted edited video of Biden. Here's what Biden actually said.

However, these less-than-convincing hoaxes have quickly been debunked before reaching the masses. More importantly, experts suggest deepfake videos have thus far had little to no societal impact, and that they currently don’t pose any imminent threats. For example, research conducted by Sensity, a cybersecurity firm focused on visual threats, claims that the vast majority of deepfake videos are pornographic (96%) and that the technology has yet to make its way into any significant disinformation campaigns.

Similarly, a Georgetown University report concluded that while deepfakes are an “impressive technical feat,” policymakers should not rush into the hype as the technology is not perfect at the moment and can’t influence real-world events just yet.

The creator behind the most popular deepfake channel Ctrl Shift Face, whose videos are viewed by millions, believes the “hysteria” circling around the deepfake topic is diverting lawmakers’ attention away from the real issues, such as the poorly regulated ad networks on Facebook that are actually responsible for misleading people.

“If there ever will be a harmful deepfake, Facebook is the place where it will spread,” Ctrl Shift Face said in an interview with Digital Trends. “In that case, what’s the bigger issue? The medium or the platform?”

The owner of BabyZone, a YouTube gaming channel with over half a million subscribers that often deepfakes celebrities into video games, echoes a similar concern: “I think that deepfakes are a technology like all the other existing technologies. They can be used for good and for bad purposes.”

The movement to save deepfakes

Over the last year or two, as governments and tech companies investigate the potential risks of this technology, deepfake advocates have scrambled to allay these concerns and fix the technology’s public image. Reddit communities that seek to “adjust this stigma” have popped up, and some independent researchers are actively building systems that can spot deepfakes before they go viral.

Roman Mogylnyi, CEO and co-founder of Reface, a hit app that lets you quickly swap your face into any GIF, says his startup is now developing a detection tool that can tell whether a video was made with Reface’s technology. “We believe that wide access to synthesized media tools like ours will increase humanity’s empathy and creativit, and will help to change the perception of the technology for better,” Mogylnyi told Digital Trends.

Eran Dagan, founder and CEO of Botika, the startup behind the popular face-swapping app Jiggy, has a similar outlook toward deepfakes and believes as they become more mainstream, “people will be much more aware of their positive use cases.”

Given the potential dangers of deepfakes, however, it’s likely that Congress will eventually step in. Major tech platforms including Facebook, Twitter, and YouTube already have updated their policies to flag or remove manipulated media that’s designed to mislead. Multiple states like California and New York have passed bills that will punish makers of intentionally deceptive deepfakes, as well as ones released without consent of the person whose face is used.

Should deepfakes be regulated?

While these policies exclude parody content, experts, fearing ill-defined laws or a complete ban of the technology, still believe Congress should stay out of it and let deepfakes run the natural course that any new form of media goes through.

David Greene, civil liberties director at the Electronic Frontier Foundation, says “any attempt by Congress to regulate deep fakes or really any kind of visual communication will be a regulation of speech and implicate the First Amendment.

“Society needs to build new mechanisms for certifying what can be trusted, and how to prevent the negative impacts of synthetic content on individuals and organizations.”

These laws, Greene adds, need to be precise and must — in well-defined and easily understood terms — address the harm they’re trying to curtail. “What we have seen so far … regulatory attempts at the state level are vague and overbroad laws that do not have the precision the First Amendment requires. They don’t have required exceptions for parody and political commentary.”

Giorgio Patrini, CEO of Sensity, finds a ban on algorithms and software “meaningless in the internet era.” Patrini compares this conundrum with malware protection and how it’s next to impossible to put an end to all computer viruses or their authors, so it’s better to simply invest in anti-malware mechanisms instead. “Society needs to build new mechanisms for certifying what can be trusted, and how to prevent the negative impacts of synthetic content on individuals and organizations,” he said.

Tim Whang wrote in the Georgetown University report that with the commodification of deepfake tools, the technology to detect and filter it out automatically will consequently evolve and become more accurate — thereby neutralizing their ability to present any serious threats.

Microsoft’s recently launched deepfake detection tool, for instance, analyzes the videos to offer you a confidence score that indicates how likely it is that the video was modified.

“Deepfakes are a new form of media manipulation, but not the first time we’ve faced this type of challenge. We are exploring and investing in ways to address synthetic media,” said a YouTube spokesperson.

The researchers behind CtrlShiftLab, an advanced deepfake creation software that many YouTubers including Ctrl Shift Face employ, are now also working toward open-source projects to raise awareness and build more comprehensive detection services.

“The only way to prevent this [deepfake abuse] is to establish an open source deepfake-related project and attract the public’s attention. So public netizens can realize that deepfakes exist,” Kunlin Liu, one of the CtrlShiftLab’s researchers, told Digital Trends.

Several deepfake creators Digital Trends talked to remain optimistic and find countries’ pushback against deepfakes premature. They agree that deepfake’s growing role in memes and parody culture will be instrumental in mending this emerging tech’s crummy reputation. And as long as videos have disclaimers and platforms invest in more effective detection layers, they added, deepfakes are here to stay.

“I think that the reputation of deepfakes is improving significantly. Two years ago, the word deepfake automatically meant porn,” said the creator of Ctrl Shift Face. “Now, most people know deepfakes because of these entertaining videos circulating around the internet.”

Shubham Agarwal
Former Digital Trends Contributor
Shubham Agarwal is a freelance technology journalist from Ahmedabad, India. His work has previously appeared in Firstpost…
Is a Jeep Cherokee replacement slated for 2025?
Jeep Cherokee

Jeep is remaining somewhat mysterious about the name of a new hybrid SUV slated to be part of the brand’s lineup in 2025.
Speaking at the Los Angeles Auto Show recently, Jeep CEO Antonio Filosa would only say that a new compact SUV with a hybrid powertrain was indeed on the way, according to Automotive News.
Filosa had already confirmed last spring that a new “mainstream” large SUV would soon be launched by Jeep, adding that we "could probably guess what it will be called." His comments had sparked speculation that the Cherokee brand name would be back.
While the brand name has existed since 1974, the Cherokee Nation in the U.S. had officially asked Jeep to stop using its name in 2021.
Early last year, Jeep quietly discontinued the model, which was one of its most iconic SUVs of the past 50 years.
The reason? Besides slumping sales, Jeep at the time cited the confluence of market dynamics, consumer preferences, and strategic brand realignment.
The Cherokee was viewed as a classic four-door SUV, known both for its reliability and its ability to suit both off-road and urban environments.
But with time, “consumer preferences have significantly shifted towards larger SUVs equipped with the latest technology and enhanced safety features,” Jeep said at the time. “This trend is accompanied by an increasing demand for environmentally friendly vehicles, steering the market towards hybrid and electric models.”
While no one knows for sure what the new SUV hybrid will be called, Jeep's parent company, Stellantis, is certainly doing everything it can to steer all its brands in the hybrid and electric direction.

Stellantis recently launched a new platform called STLA Frame that’s made for full-size trucks and SUVs. The platform is designed to deliver a driving range of up to 690 miles for extended-range electric vehicles (EREVs) and 500 miles for battery electric vehicles (BEVs).

Read more
Teslas likely won’t get California’s new EV tax rebate
teslas likely wont get californias new ev tax rebate ap newsom 092320 01 1

California seems eager to reassert itself, not only as one of the largest economies in the world, but one where EVs will continue to thrive.

Governor Gavin Newsom has announced California will seek to revive state-tax rebates for electric vehicles should the incoming Trump administration carry out its plans to end the existing $7,500 federal incentive on EVs.

Read more
Kia PHEVs’ electric range will double to 60 miles
kia phevs electric range will double to 60 miles cq5dam thumbnail 1024 680

Besides making headlines about the wisdom, or lack thereof, of ending federal rebates on EVs in the U.S., Kia is setting its sights on doubling the range its plug-in hybrid vehicles (PHEVs) can run on while in electric mode.

With affordability and finding chargers remaining among the main hurdles to full EV adoption, drivers this year have increasingly turned to PHEVs, which can function in regular hybrid gas/electric mode, or in full electric mode. The issue for the latter, however, is that range has so far remained limited.

Read more