Skip to main content

Apple will use the iPhone’s camera to personalize spatial audio

Promotional logo for WWDC 2023.
This story is part of our complete Apple WWDC coverage

If you had blinked, you might have missed it: During the WWDC 2022 keynote address, Craig Federighi, Apple’s senior vice president of software engineering, focused on the new features we can expect in iOS 16. In his presentation, he briefly mentioned that you’ll be able to use an iPhone’s true depth camera to personalize spatial audio.

What does that mean? Well one of the keys to providing an immersive, 3D-like effect from spatial audio content using headphones is something called Head-Related Transfer Function (HRTF). It’s the science of understanding how everyone’s head shape and ear position can affect how you hear and process sounds in three dimensions.

Recommended Videos

It’s possible to deliver effective spatial audio experiences using a generic HRTF profile that works for most people, but the more your specific HRTF can be used, the better — in theory — spatial audio can be. Apple isn’t the first company to leverage a phone’s cameras in this way: Sony’s Headphones app, which it uses with products like the WH-1000XM4, XM5, and WF-1000XM4, will encourage you to take photos of both ears so that it can optimize the sound of its own spatial audio format, Sony 360 Reality Audio (360RA).

Apple currently supports two types of spatial audio. Standard spatial audio lets you enjoy things like Dolby Atmos Music on any set of stereo headphones from Apple Music and other streaming services that support Atmos Music. Head-tracking spatial audio takes this concept to the next level by adding an extra level of immersion. When listening to spatial audio music formats, it can anchor certain elements of a song in 3D space, like the vocals. Moving your head makes it seems as though the source of vocals is coming from one direction instead of from all around you.

For movies, head-tracking spatial audio can make it seem as though you’re sitting in a full 5.1 home theater, including the sensation that your screen (like an iPhone, iPad, etc.) is the source of dialog and other key soundtrack elements.

We don’t yet know how Apple’s use of the iPhone’s true depth cameras will be used to create a more personalized spatial audio experience, but we’ll let you know as soon as we find out.

Simon Cohen
Contributing Editor, A/V
Simon Cohen is a contributing editor to Digital Trends' Audio/Video section, where he obsesses over the latest wireless…
Hands-on with the Belkin iPhone Mount with MagSafe for Apple TV 4K
The Belkin iPhone Mount with MagSafe for Apple TV 4K.

The Belkin iPhone Mount with MagSafe for Apple TV 4K perched atop an extremely thin OLED television. Phil Nickinson / Digital Trends

The Belkin iPhone Mount with MagSafe for Apple TV 4K is one mouthful of an official name. What it does is much more simple. It is a mount for your iPhone to be used with an Apple TV 4K. And it has MagSafe to keep the phone in place. That's it.

Read more
Belkin drops a $50 mount for iPhone video calls on Apple TV 4K
The Belkin iPhone Mount with MagSafe for Apple TV 4K.

We've previously written that the addition of FaceTime and Continuity Camera to Apple TV 4K is a perfect excuse to have some sort of tripod for your iPhone in the living room. Belkin just took that idea and made it a little easier (and less expensive than our idea).

Enter the appropriately named iPhone Mount with MagSafe for Apple TV 4K. Retailing for just under $50, it's ... well, it's a MagSafe iPhone mount to use in conjunction with video calls on your Apple TV 4K. No cables required. No power needed. Just a simple way to position your iPhone to use when on FaceTime, Zoom, Webex, or the "Sing" feature on Apple Music.

Read more
Apple’s Dolby Atmos Music bounty could be a disaster for the format
dolby atmos music streaming debut on amazon hd launch

Apple is offering to pay artists more money if they provide Apple Music with versions of their songs recorded in the immersive Dolby Atmos Music format, according to a report from Bloomberg. On the surface, that makes a lot of sense, especially as Apple lays the groundwork for its soon-to-launch Apple Vision Pro headset, a device that will benefit greatly from immersive audio. But the move also could create exactly the wrong set of incentives at a time when the jury is still split over whether spatial audio for music actually is a good thing.

Apple has spent the past several years ramping up its support for spatial audio in general and Dolby Atmos specifically, through its AirPods family of wireless headphones, its Apple TV 4K streaming device, and virtually all of its computing products, too. Apple Music has a growing catalog of tracks in Dolby Atmos Music, and the Apple TV+ video streaming service offers Dolby Atmos soundtracks on nearly all of its movies and shows.

Read more