Apple details how Apple Watch’s new Audio Intelligence features work in privacy paper

Apple is launching an all-new set of features called Audio Intelligence, starting with today’s new Apple Watch Series 12 and Apple Watch Ultra 4. The company details how the new feature works, especially around privacy, in a new paper.

Audio Intelligence on Apple Watch covers four features, including Live Rewind and Siri Recap

“Audio Intelligence is a brand-new class of Apple Intelligence features that use the microphones of Apple Watch, the power of Apple silicon, and on-device and cloud-based AI models to help you detect sounds, identify music, and stay present and engaged — all while protecting your privacy at every step,” Apple explains.

Audio Intelligence includes four specific features to start: Sound Recognition, automatic Music Recognition with Shazam, Live Rewind, and Siri Recap. The company says that both Live Rewind and Siri Recap will arrive in beta with English support later this year, adding that “more details will be available at launch.”

Each Audio Intelligence feature is opt-in, Apple says. Live Rewind and Siri Recap also let you easily enable or disable the feature as needed.

Here’s more on Live Rewind from Apple:

And here’s more on Siri Recap from Apple:

Audio Intelligence doesn’t attribute speech to speakers, and Siri Recap is designed to omit potentially harmful content and sensitive information. Live Rewind alerts nearby people with an audible chime and visual indicators, Apple says.

You can learn much more about the new features here.

How Audio Intelligence is designed to work with privacy in mind

If you want to really take a deep dive on privacy and the new features, Apple has published an 11-page privacy paper that goes even further.

Interestingly, Apple explains in the paper how Live Rewind works with privacy in mind:

And for the Siri Recap feature, here’s part of Apple’s explanation on how it works:

Again, you can read the full 11-page paper for yourself here.