Skip to main content

Final Fantasy XVI’s most impressive innovations are the ones you can hear

Final Fantasy XVI is a leap forward for the long-running RPG series in some very obvious ways, The most immediately apparent way it accomplishes that is through its fantastic real-time combat, which makes the adventure into Final Fantasy’s best pure action game to date. Then there are its cinematic Eikon fights, which offer spectacle on a level we’ve long dreamed of seeing in a video game. However, some of its most impressive innovations are ones you can’t actually see. Rather, you’ll need to listen closely.

Ahead of Final Fantasy XVI’s launch, I spoke to series composer Masayoshi Soken about his work on the project. While we talked a bit about his excellent score, Soken was most eager to share details on the new sound tech that was built for the action RPG. You may not notice it while playing, but Final Fantasy XVI raises the bar for video game audio in ways that might soon carry over into other Square Enix titles.

Audio innovation

In a music panel prior to Final Fantasy XVI’s release, Soken shared a bit about the new sound tech powering the game. The first major innovation he highlighted was the action RPG’s new approach to interactive music, a system meant to make the soundtrack more reactive and dynamic in battles. Rather than looping music during fights, Soken uses audio magic to seamlessly transition between different sections of the score no matter how long it takes a player to move through the fight. Everything down to Clive’s end pose will naturally sync up with the music in every fight.

“No matter what the player’s playstyle is — no matter if they’re very good at action games or if they’re not and it takes them longer to do certain kinds of battles — both of those players are going to get the same kind of sound and music experience,” Soken tells Digital Trends.

Ifrit fights Garuda in Final Fantasy XVI.
Square Enix

While that’s an accomplishment, some of the more subtle audio technology Soken and his team built are even more impressive. The first comes in the game’s approach to reverb. Rather than just creating sound effects and applying some reverb filters to them accordingly, the team actually built an underlying system that applies reverb to a sound in real time based on the environment players are in.

“In real time, we’ll have a sound bouncing off an object. It looks at the material of that object and the distance of that object,” Soken says. “All in real-time, it calculates the reverb and changes the reverb based on that distance and material.”

That isn’t the only automatic sound creation system present in Final Fantasy XVI. Soken would get even deeper into what’s happening under the hood when mentioning a new system where the game actually generates sound effects on the fly that are built around a character’s motion. Soken says that the system was a necessity due to how “realistic and exquisite” the game’s cinematics are. Doing manual audio creation for all those sequences would be “equivalent to producing the Foley sounds for dozens of movies all at once,” according to Soken

It automatically composes and creates the Foley sounds …

I couldn’t wrap my head around the idea when Soken first described it to me in person, but he gave me a far more detailed explanation in an email after our conversation.

“In order to avoid having to spend this tremendous amount of time in production, we have implemented a system where it monitors the characters’ motions (especially the bone/skeletal motions) in real time, and based on the motion analysis results, it automatically composes and creates the Foley sounds appropriate for the motion, as well as automatically outputs the sounds in real time,” Soken says. “This system isn’t applied to all Foley sounds, but other than the controllable character, it is also applied to NPCs and party members and even in battle actions, not just cutscenes, hugely contributing to cutting down the labor costs of the sound production.”

While all three of these systems were built for Final Fantasy XVI, Soken says the hope is that they’ll be implemented into Square Enix’s other games going forward. These are meant to be shared audio innovations that push the entire video game landscape forward, finding new ways to achieve greater realism and maintain immersion through audio. That may very well be Final Fantasy XVI’s true lasting legacy 10 years from now.

Final Fantasy XVI is out now on PS5.

Editors' Recommendations

Giovanni Colantonio
Giovanni is a writer and video producer focusing on happenings in the video game industry. He has contributed stories to…
Ahead of Rebirth, it’s time to give Final Fantasy VII Remake some overdue respect
Main characters from Final Fantasy VII Remake Intergrade.

When Final Fantasy VII Remake launched in 2020, tensions were high.

Fans of the original Final Fantasy VII, both a genre- and childhood-defining RPG, were already skeptical about the project due to the fact that it would only adapt a very short slice of the 1997 release. Those frustrations would get compounded by some much more serious ones: Remake would launch weeks into the social isolation era of COVID-19. Despite getting a warm critical reception, the unusual remake would quickly become a polarizing game among fans. Even Digital Trends was critical of it at the time: "Although the complete Final Fantasy VII storyline is a fascinating, emotional globe-trotting adventure, this first 40-hour romp is anything but."

Read more
Foamstars is coming to PS Plus next month as a freebie
A map with a DJ duck in Foamstars.

Square Enix announced today that its “foam-party shooter” Foamstars will launch on February 6 as one of the month’s free PlayStation Plus Essential games. At a hands-off preview event held prior to this announcement, Digital Trends learned a lot more about what players can expect from Foamstars at and after launch.

Foamstars will be available to download for PS Plus subscribers of any tier between February 6 and March 4. After that, you’ll have to purchase it for $30.

Read more
Our most anticipated video games of 2024: Final Fantasy, Hellblade 2, and more
Cloud rides a Chocobo in Final Fantasy VII Rebirth.

After a ruthlessly crowded year for video games, you’d think I’d be ready to slow down and take a breather. Unfortunately for me, the video game industry rests for no one. 2024 is right around the corner, and it’s already filling up with new game releases -- some of which threaten to be 100-hour affairs that could keep players occupied for an entire year.

While 2023’s big releases were set in stone before the year even began, 2024’s release calendar is more of a mystery. We know what’s coming in the first few months and have a vague idea of some games that’ll drop through the year, but it’s not quite clear what the big breakout releases or holiday system sellers will be yet. Instead, we’re sitting on a pile of high-profile RPGs, niche projects, and eye-catching indies. Any of those games could be topping year-end lists 12 months from now.

Read more