Modulate wants to bring voice skins to your favorite online games

New technology called 'voice skins' could let you change how you sound in games

Over the last decade, online multiplayer games have turned into more personal experiences. Call of Duty: Black Ops 4, FortniteAnthem and more are offering new ways for players to enhance their characters. From outfits to weapon skins and even emotes, players can adorn their avatars in a way that reflects their taste and personal style.

Missing from these games, however, is the ability to change your voice. Modulate, a computer software company co-founded by Mike Pappas and Carter Huffman, aims to address this with a technology called “voice skins” which allows you to change your voice on the fly.

Using deep neural networks and machine learning, Modulate allows you to customize your voice. You can choose to sound like the opposite gender, a celebrity or even create your own custom voice. Your emotion and cadence will remain the same, with Modulate giving you full control over how your vocal cords will be used.

modulate wants to bring voice skins your favorite online games founders small
Modulate founders Carter Huffman and Michael Pappas

According to CTO Carter Huffman, he became interested in the potential for voice skin technology around 2015 after trying photo editing apps such as Prisma. These have the potential to drastically edit existing photos and make them look like other famous works of art.

Huffman realized that there was potential for this kind of technology to find a home in audio. It took him about a year to get results during his experimentation phase, eventually finding that adversarial technology made the process easier.

“This is something that people have wanted for 100 years,” CEO Pappas said. “It has shown up in sci-fi, in games, and in stories all over the place – as something that, obviously, we should be developing.”

“This is something that people have wanted for 100 years.”

Modulate works by having one neural network listen to a user’s voice and then try to produce something, which is then examined by a second adversarial neural network. That network then determines whether or not the voice produced is doing what it aimed to do. For example, in order to make the voice skin for Barack Obama sound like him, the adversarial network was given clips of his speeches so it could better understand his voice.

The process is iterative, with the adversarial network identifying specific parts of the voice skin’s audio that don’t sound correct. If a voice is the wrong pitch, for instance, this will be corrected, and the voice skin network will not make this mistake on its next try.

“Eventually, it outputs speech that the adversary cannot tell the difference between the voice skin’s output and real Barack Obama. And if the adversary is really good, then we also cannot tell the difference,” Huffman added.

Fortnite Marshmello Concert

The goal, however, is not for you to impersonate another person. Modulate uses a digital watermark that computer programs can detect that will alert them of someone making use of a voice skin. The plan is for the technology to be directly implemented into other programs rather than used on its own. This should make voice fraud during phone calls impossible, and you will not be able to impersonate well-known voice actors in order to make a reel for your own work.

If Modulate was used in a large game like Fortnite, it would likely be built natively into the application. Pappas also clarified that certain companies develop the voice chat systems for multiple games, and Modulate could work with them to implement it across several supported games as well. The technology would allow for the games to point out which users are using Modulate but the company will ultimately leave it up to the game’s developers to determine whether or not they’ll make use of it.

Pappas and Huffman want Modulate to be used for players to better express themselves in their favorite games.

Pappas and Huffman want Modulate to be used for players to better express themselves in their favorite games. If the skin you happen to be wearing is of something menacing or makes your avatar look intimidating, Modulate could more easily portray this. Likewise, for those self-conscious about their own voices, the technology would allow them to communicate with others more comfortably.

In the immediate future, Modulate plans on continuing its pilot program which is integrating and testing the technology into existing chat platforms and games. As the company continues to grow, it aims to add additional features such as changes to your accent. Pappas believes it could have applications outside of just video game chat. Since the technology is affecting tonality rather than the words themselves, it would be easily applicable across multiple languages, as well.

gaming headset

“We’re starting in the gaming space, but we really see this as a fundamentally required technology in order for you to use voice chat, and everyone’s going to use voice chat,” he said.

Huffman noted that with virtual reality technology becoming more lifelike, voice skins could make the experience even more immersive. As of now, your options are limited.

The possibilities are nearly endless, and we’ll likely see the first fruits of the team’s labor later this year.

“It’s the Ready Player One dream, right?” Huffman said. “You’re inhabiting this character, and then you speak, and it’s just your voice, or maybe a Darth Vader voice. But you can’t convincingly be the rest of that character that you want to be.”

Modulate would certainly give game developers more options for in-game goodies. Alongside the latest costume, games could offer voice skins as rewards for high-level play. The possibilities are nearly endless, and we’ll likely see the first fruits of the team’s labor later this year. The plan is for Modulate to be integrated into existing games by the end of 2019, and possibly within the next six months.

If you’d like to hear Modulate’s technology in real-time, you can try a demonstration on the company’s website. Multiple sliders let you make fine adjustments to your recording, and the results are both impressive and hilarious. As more users try out Modulate and it learns more about sounds (such as laughter) the neural networks will go on to create a more polished and believable product.

Product Review

Chris is the virtual co-pilot phone-obsessives need in their car

Driving while using your phone is dangerous, and often illegal. Meet Chris, the digital assistant for your car that wants to help keep your hands off your phone, and your eyes on the road.

From fatalities to new characters, here's what we know about Mortal Kombat 11

Mortal Kombat 11 releases April 23 for the PlayStation 4, Xbox One, Nintendo Switch, and PC. Here is everything we know about NetherRealm's latest fighting game, including its characters.
Home Theater

Cheer for your favorite NCAA team and Xfinity will respond with matching lights

Screaming at your favorite team just became a lot more rewarding thanks to Comcast's Xfinity voice remote and some special NCAA commands that set your smart lightbulbs to your favorite team's colors.

These voice-changing apps will have you punking friends and family like a pro

Have you ever wanted to call your friends as Darth Vader or Alvin from the Chipmunks? If you want to play a prank on your friends, we have the best voice-changer apps for iOS and Android, whether you want to record audio or make a call.

Get in the Dark Zone and blow away the competition with our The Division 2 guide

The Division 2 has three Dark Zones, specialized areas for PvE and PvP combat. Our Dark Zone guide teaches you the ropes, from the recon missions to the leveling system to the dangers and benefits of going Rogue.

Here are all the awesome award-winning indie games from IGF

Indie games are now offering experiences capable of matching -- and often surpassing -- that of big-budget blockbuster titles. The Independent Games Festival recognized the best of them on March 20.
Product Review

Acer Predator Triton 500 review

Nvidia’s new RTX 2080 Max-Q is the fastest GPU you’ll find in any laptop, but it usually comes at a steep price. Acer’s Predator Triton 500, starting at $2,500, makes it a little more affordable. But what must you sacrifice in the…

The Division 2

The latest news, guides, tips and tricks, updates, patch notes, and more so you can learn how to level up your game in The Division 2. Related Categories: The Division 2 News | Guides | Features

Get a new Nintendo Switch? You'll need to grab these accessories

The Switch is a capable console right out of the box, but it has its limitations. Thankfully, these Nintendo Switch accessories will allow you to make the most of Nintendo's latest console.

Get a head start mastering Apex Legend's newest character Octane with our guide

Apex Legends' newest legend Octane ran so fast in the Titanfall 2 gauntlet that he blew off his legs. Now dropping into Kings Canyon with prosthetics, Octane's ability set is still centered around speed. Here's how to play as Octane.

The Division 2 offers nothing but a funhouse mirror of America

Tom Clancy's The Division 2 improves on the design shortcomings of the original game in several different ways, but its version of Washington D.C. is completely removed from reality.

World of Warcraft's allied races will make you want to start a new character

The Hord and Alliance are seeking new allies in their struggle for control of Azeroth. Rather you pledge your allegiance to the Horde or Alliance, we've got a guide to help you unlock every allied race that's coming in Battle for Azeroth.

How the Google Stadia could lead to a new era of multi-GPU gaming

Google's Stadia could use more than one graphics card to deliver the high-performance visuals it's promised. If that leads to better developer support for multi-GPUs, could that mean gaming with two or more graphics cards could finally be…

How to share your best gaming moments on the Xbox One and its mobile app

The current generation of consoles make it easier than ever to share your gaming highlights with the world. Here's a quick guide on how you can record a gameplay video on Xbox One.