Skip to main content

Modulate wants to bring voice skins to your favorite online games

New technology called 'voice skins' could let you change how you sound in games

Modulate: Unlock Your Voice

Over the last decade, online multiplayer games have turned into more personal experiences. Call of Duty: Black Ops 4, FortniteAnthem and more are offering new ways for players to enhance their characters. From outfits to weapon skins and even emotes, players can adorn their avatars in a way that reflects their taste and personal style.

Missing from these games, however, is the ability to change your voice. Modulate, a computer software company co-founded by Mike Pappas and Carter Huffman, aims to address this with a technology called “voice skins” which allows you to change your voice on the fly.

Related Videos

Using deep neural networks and machine learning, Modulate allows you to customize your voice. You can choose to sound like the opposite gender, a celebrity or even create your own custom voice. Your emotion and cadence will remain the same, with Modulate giving you full control over how your vocal cords will be used.

Modulate founders Carter Huffman and Michael Pappas

According to CTO Carter Huffman, he became interested in the potential for voice skin technology around 2015 after trying photo editing apps such as Prisma. These have the potential to drastically edit existing photos and make them look like other famous works of art.

Huffman realized that there was potential for this kind of technology to find a home in audio. It took him about a year to get results during his experimentation phase, eventually finding that adversarial technology made the process easier.

“This is something that people have wanted for 100 years,” CEO Pappas said. “It has shown up in sci-fi, in games, and in stories all over the place – as something that, obviously, we should be developing.”

“This is something that people have wanted for 100 years.”

Modulate works by having one neural network listen to a user’s voice and then try to produce something, which is then examined by a second adversarial neural network. That network then determines whether or not the voice produced is doing what it aimed to do. For example, in order to make the voice skin for Barack Obama sound like him, the adversarial network was given clips of his speeches so it could better understand his voice.

The process is iterative, with the adversarial network identifying specific parts of the voice skin’s audio that don’t sound correct. If a voice is the wrong pitch, for instance, this will be corrected, and the voice skin network will not make this mistake on its next try.

“Eventually, it outputs speech that the adversary cannot tell the difference between the voice skin’s output and real Barack Obama. And if the adversary is really good, then we also cannot tell the difference,” Huffman added.

Fortnite Marshmello Concert

The goal, however, is not for you to impersonate another person. Modulate uses a digital watermark that computer programs can detect that will alert them of someone making use of a voice skin. The plan is for the technology to be directly implemented into other programs rather than used on its own. This should make voice fraud during phone calls impossible, and you will not be able to impersonate well-known voice actors in order to make a reel for your own work.

If Modulate was used in a large game like Fortnite, it would likely be built natively into the application. Pappas also clarified that certain companies develop the voice chat systems for multiple games, and Modulate could work with them to implement it across several supported games as well. The technology would allow for the games to point out which users are using Modulate but the company will ultimately leave it up to the game’s developers to determine whether or not they’ll make use of it.

Pappas and Huffman want Modulate to be used for players to better express themselves in their favorite games.

Pappas and Huffman want Modulate to be used for players to better express themselves in their favorite games. If the skin you happen to be wearing is of something menacing or makes your avatar look intimidating, Modulate could more easily portray this. Likewise, for those self-conscious about their own voices, the technology would allow them to communicate with others more comfortably.

In the immediate future, Modulate plans on continuing its pilot program which is integrating and testing the technology into existing chat platforms and games. As the company continues to grow, it aims to add additional features such as changes to your accent. Pappas believes it could have applications outside of just video game chat. Since the technology is affecting tonality rather than the words themselves, it would be easily applicable across multiple languages, as well.

gaming headset

“We’re starting in the gaming space, but we really see this as a fundamentally required technology in order for you to use voice chat, and everyone’s going to use voice chat,” he said.

Huffman noted that with virtual reality technology becoming more lifelike, voice skins could make the experience even more immersive. As of now, your options are limited.

The possibilities are nearly endless, and we’ll likely see the first fruits of the team’s labor later this year.

“It’s the Ready Player One dream, right?” Huffman said. “You’re inhabiting this character, and then you speak, and it’s just your voice, or maybe a Darth Vader voice. But you can’t convincingly be the rest of that character that you want to be.”

Modulate would certainly give game developers more options for in-game goodies. Alongside the latest costume, games could offer voice skins as rewards for high-level play. The possibilities are nearly endless, and we’ll likely see the first fruits of the team’s labor later this year. The plan is for Modulate to be integrated into existing games by the end of 2019, and possibly within the next six months.

If you’d like to hear Modulate’s technology in real-time, you can try a demonstration on the company’s website. Multiple sliders let you make fine adjustments to your recording, and the results are both impressive and hilarious. As more users try out Modulate and it learns more about sounds (such as laughter) the neural networks will go on to create a more polished and believable product.

Editors' Recommendations

20 classic SNES games we want added to Nintendo Switch Online
snes games we want added to nintendo switch online super metroid

Nintendo finally answered the cries of Switch Online subscribers and introduced Super Nintendo games to its vault. With added online features, the ability to rewind and fix your mistakes, and save states that let you return to the exact spot you last saved, we didn't just get some long-awaited 16-bit classics but some new ways to experience them.

While games such as Super Mario World and The Legend of Zelda: A Link to the Past is included, we found that many of our favorite games are still not included in the introductory lineup. With that in mind, here are 20 SNES games we want to see added to Nintendo Switch Online.
SNES games the Nintendo Switch needs
Super Castlevania IV

Read more
The Keystone keyboard powers your typing or gaming with built-in A.I.
input club keystone keyboard adapts hardware ai

Earlier this week, peripheral manufacturer Input Club launched a Kickstarter project for a mechanical keyboard that features a built-in artificial intelligence that adapts its response to typists' behavior. The new offering, known as the Keystone, is compatible with Windows, MacOS, and Linux devices, and uses the A.I. in its firmware to learn from consumers' unique typing habits and adjust the responsiveness of each key to improve the accuracy of the keyboard overall.

The Keystone keyboard relies on the magnetic actuation register mechanisms under the keys to measure the per-key actuation point patterns that typists generate by using it. Because keypresses are actuated magnetically, the peripheral is able to measure the force, or even simply the distance, of a key depression by measuring the change in the relative strength of the magnetic field. Once the keyboard has been used for "a few hundred presses," it is able to analyze the collected data and start making actuation point adjustments to accommodate typist-specific quirks like using more force with certain fingers.

Read more
‘Call of Duty: Black Ops 4’ patch brings back fan-favorite Gun Game mode
call of duty black ops 4 muscles

Official Call of Duty®: Black Ops 4 – Launch Gameplay Trailer

Call of Duty: Black Ops 4 is a great first-person shooter across all three of its modes, but there was one glaring omission compared to past titles: Gun Game. The weapon-swapping multiplayer mode was missing in action at launch, but developer Treyarch has since fixed that.

Read more