Skip to content
Products

Apple Begins Testing Always-Listening Siri Recap and Live Rewind on Apple Watch

The first developer betas of iOS 27.3 and watchOS 27.3 bring four Audio Intelligence features to the Apple Watch Series 12, two of which transcribe or summarise conversations around the wearer.

By Nakoda News Desk

·3 min read

Prefer Nakoda News on Google

Apple's Siri Recap and Live Rewind features are now in developer testing on the Apple Watch Series 12 and Ultra 4.
Apple's Siri Recap and Live Rewind features are now in developer testing on the Apple Watch Series 12 and Ultra 4.Photo: TechCrunch

Apple has started testing a set of AI features that use the Apple Watch's microphones to capture and summarise the conversations around its owner. The features arrived on Tuesday in the first developer betas of iOS 27.3 and watchOS 27.3, TechCrunch reported.

Apple groups four features under the name Audio Intelligence. Its support documentation calls them "a brand-new class of Apple Intelligence features that use the microphones of Apple Watch." Sound Recognition alerts the wearer to sounds such as alarms or doorbells, and Music Recognition identifies songs using Shazam. Neither has drawn much privacy concern. The two that have are Live Rewind and Siri Recap.

Live Rewind shows a text version of roughly the previous 15 seconds of speech, so the wearer can check something they missed. Siri Recap runs in the background and produces summaries of what was said over the day, saving the points it judges important.

How Apple Handles Privacy

Apple says every Audio Intelligence feature is opt-in. Live Rewind starts only when the user double-presses the Digital Crown. Siri Recap runs only once it is switched on, and users can schedule it by time or location or toggle it from Control Center. According to Apple's support page, it pauses during phone calls, when audio is playing through paired headphones, and when active noise cancellation is on for AirPods or Beats.

Apple says audio is not recorded or stored. Raw audio is processed inside the watch's Secure Exclave and deleted afterwards. Users can set recaps to delete automatically after up to seven days unless they save them, and saved items sync through iCloud with end-to-end encryption. Unsaved Live Rewind snippets disappear about 30 seconds after the watch display dims. TechCrunch noted that the features do not identify speakers and that they redact sensitive details such as government ID and account numbers.

The two conversation features need an Apple Watch Series 12 or Ultra 4 paired with an iPhone 16 or later model, with Apple Intelligence and Siri AI enabled. They launch in English, and Apple says more languages will follow. Apple says they will not be available in the EU at first, will not be available in China, and cannot be used by anyone under 18. Because they rely on server-side processing, they also have daily usage limits.

Early Impressions

Sarah Perez of TechCrunch tested Siri Recap for a day. She found it pulled useful details out of spoken exchanges, such as the deductible, repair timeline and fuel level discussed while she dropped off a car for repairs and collected a rental. She also found it mixed unrelated topics into one note and kept trivial household chatter. She wrote that the feature was a "stark reminder" that the watch was listening to everyday conversations, and that she would consider turning it off at home in the evenings.

Why It Matters

Ambient recording is becoming a contested area for consumer AI, and these are among Apple's most direct moves into it. Dedicated AI note-taking devices and apps already compete here. Apple's approach is to run the capture on hardware people already wear and to wrap it in on-device processing and default deletion. For companies and regulators, the features raise practical questions about consent and workplace recording policies, because the people near the wearer are the ones being captured. That may help explain why the features will not launch in the EU initially.

The same beta cycle also opened Siri AI to third-party apps. Apple has not said when Audio Intelligence will reach the public, beyond saying that the conversation features arrive in beta with watchOS 27.3.

Sources

  • TechCrunch · I tried Apple’s Siri Recaps. They’re surprisingly useful — and a little unsettling
  • Apple Support · About Audio Intelligence features on Apple Watch Series 12 and Apple Watch Ultra 4

Produced with AI assistance from the sources above. How we work

By

Nakoda News Desk

Nakoda News covers AI and business. Every story links the sources it draws on; how we work is set out in our editorial standards.

How we work

Related coverage