Apple Watch AI Features for Rewinding and Recapping Conversations Enter Beta

Sound recognition alerts deaf and hard-of-hearing users to sounds such as sirens, alarms and doorbells, and song recognition uses Apple's Shazam service. The two features that listen to people talking, Live Rewind and Siri Recaps, are the ones most likely to draw scrutiny.

How the Features Work

Live Rewind lets a user double-press the Watch's digital crown to see the last 15 seconds of a conversation as text on the screen, for example directions or a restaurant's list of specials. The snippet disappears for good unless the user saves it to the standalone Siri app that shipped with iOS 27, and unsaved snippets are deleted automatically after 30 seconds. An "Ask Siri" option lets the user ask about something that was said. To show others that something has been captured, the gesture triggers an audible chime and an on-screen animation.

Siri Recaps goes further and produces short summaries of conversations: one sentence plus key points such as dates, deadlines or pricing details. Apple says the feature does not identify speakers, keep raw audio or produce word-for-word transcripts. It suggested uses such as work meetings, parent-teacher conferences and training sessions. Users can turn recaps on by hand or set a schedule, for example only during working hours. Each day the Watch prompts them to review saved recaps, and unsaved ones delete themselves within seven days. Apple says the feature is designed to leave out sensitive information, including government identifiers, financial and authentication data, and language that would promote self-harm.

Privacy Architecture

The features use the Watch's S11 chip and microphone, Apple Intelligence models running on the paired iPhone, and Apple's Private Cloud Compute. According to the report, small models on the Watch detect whether the wearer is in a conversation. Raw audio is processed in a dedicated buffer inside a hardware-isolated secure enclave that Apple says no one, including Apple, can access. The iPhone turns the audio into condensed text without filler words, encrypts it and sends it to Private Cloud Compute to produce the recap, which is then deleted from Apple's servers.

Why It Matters

Wearables that record people nearby have drawn strong criticism, including over Meta's AI glasses. Apple is betting that limited retention, visible signals and processing on the device and in its private cloud can make ambient listening acceptable to users and the people around them. For companies, the rollout means always-available meeting summaries could soon be on employees' wrists, which raises questions about workplace recording policies and consent rules that differ between countries.