Skip to main content

Scarily realistic ‘deep video portraits’ could take fake news to the next level

Deep Video Portraits - SIGGRAPH 2018

If you think it’s been a problem up to this point, the fight against fake news is about to get a whole lot harder. That is thanks to artificial intelligence technology which is making the creation of so-called “deep fake” videos more convincing at a frankly terrifying rate. The latest development comes from an international team of researchers, lead by Germany’s Max Planck Institute for Informatics.

They have created a deep-learning A.I. system which is able to edit the facial expression of actors to accurately match dubbed voices. In addition, it can tweak gaze and head poses in videos, and even animate a person’s eyes and eyebrows to match up with their mouths — representing a step forward from previous work in this area.

“It works by using model-based 3-D face performance capture to record the detailed movements of the eyebrows, mouth, nose, and head position of the dubbing actor in a video,” Hyeongwoo Kim, one of the researchers from the Max Planck Institute for Informatics, said in a statement. “It then transposes these movements onto the ‘target’ actor in the film to accurately sync the lips and facial movements with the new audio.”

The researchers suggest that one possible real-world application for this technology could be in the movie industry, where it could carry out tasks like making it easy and affordable to manipulate footage to match a dubbed foreign vocal track. This would have the effect of making movies play more seamlessly around the world, compared with today where dubbing frequently results in a (sometimes comedic) mismatch between an actor’s lips and the dubbed voice.

Still, it’s difficult to look at this research and not see the potential for the technology being misused. Along with other A.I. technologies that make it possible to synthesize words spoken in, say, the voice of Barack Obama, the opportunity for this to make the current fake news epidemic look like paltry in comparison is unfortunately present. Let’s hope that proper precautions are somehow put in place for regulating the use of these tools.

The “Deep Video Portraits” research was recently presented at the SIGGRAPH 2018 conference in Vancouver, Canada.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Deep learning A.I. can imitate the distortion effects of iconic guitar gods
guitar_amp_in_anechoic_chamber_26-1-2020_photo_mikko_raskinen_006 1

Music making is increasingly digitized here in 2020, but some analog audio effects are still very difficult to reproduce in this way. One of those effects is the kind of screeching guitar distortion favored by rock gods everywhere. Up to now, these effects, which involve guitar amplifiers, have been next to impossible to re-create digitally.

That’s now changed thanks to the work of researchers in the department of signal processing and acoustics at Finland’s Aalto University. Using deep learning artificial intelligence (A.I.), they have created a neural network for guitar distortion modeling that, for the first time, can fool blind-test listeners into thinking it’s the genuine article. Think of it like a Turing Test, cranked all the way up to a Spınal Tap-style 11.

Read more
Straight flush: How next-gen smart toilets could revolutionize health tracking
smart health tracking toilet of the future feat

Since the first internet-connected smart devices burst onto the scene, a few (smartphones, smartwatches, smart TVs, smart speakers) have become ubiquitous. Several (smart locks, smart thermostats, smart doorbells, smart fridges) have thrilled the early adopter crowd, but not quite yet broken into the mainstream. And a large number of others (smart toasters, smart bins, smart umbrellas) have barely made a dent at all, remaining niche novelty items for techies with too much money. Is it time that smart toilets ascended from this third category to the first?

That’s certainly what a team of metabolism scientists at the University of Wisconsin-Madison and the Morgridge Institute for Research think. They believe that smart toilets could prove transformative when it comes to the ability to monitor our health. Currently a few smart toilets exist on the market. For instance, at this January’s Consumer Electronics Show (CES) 146-year-old plumbing company Kohler showed off its Numi 2.0 Intelligent Toilet. This “fully-immersive experience” (because who doesn’t want an experiential immersion when they’re on the john?) offers Siri-style voice commands for custom music and lighting, plus special heated seats for keeping your butt intelligently warmed. This is not what the researchers are advocating, though.

Read more
5 ways that future A.I. assistants will take voice tech to the next level
amazon alexa laugh echo night creepy feature

Since Siri debuted on the iPhone 4s back in 2011, voice assistants have gone from unworkable gimmick to the basis for smart speaker technology found in one in six American homes.

“Before Siri, when I talked about [what I do] there were blank stares,” Tom Hebner, head of innovation at Nuance Communications, which develops cutting edge A.I. voice technology, told Digital Trends. “People would say, ‘Do you build those horrible phone systems? I hate you.’ That was one group of people’s only interaction with voice technology.”

Read more