Apple Watch Gets a New Post-Event Recap Feature: Siri Can Summarize Conversations and Play Back 15 Seconds of Audio

Apple has added the Audio Intelligence feature to Apple Watch in the watchOS 27.3 developer beta, which allows Siri to directly access the microphone on the device. Two new capabilities are rolled out: Siri Recap generates conversation summaries through "ambient listening"; Live Rewind converts the audio captured by the microphone over the past 15 seconds into text. The feature is currently in the developer beta phase and has not been officially released to the public.

This is no trivial patch for the voice assistant. The watch sits much closer to your mouth and the real-world scenarios around you. If you don't have time to jot down notes during a meeting, you can ask Siri to recap the discussion afterward; if you miss the last sentence someone said, use Live Rewind to retrieve that 15-second clip. It sounds like the watch is getting a hindsight feature, but it hits very precise use cases: users want to pull up the recent information immediately, and don't necessarily want to take out their phones.

In the same iOS 27.3 developer beta build, Apple is also testing a redesigned Health app, with expanded language support covering Global English, Simplified Chinese, Traditional Chinese, French, Japanese, Korean, Norwegian, Portuguese, Spanish and Turkish. The fact that the Health app and Audio Intelligence follow the same beta testing schedule shows that Apple is pushing Siri to become a system-level entry point, with the Apple Watch serving as a far more intimate, on-body access point.

Privacy is an unavoidable part of this category of features. The accuracy of the summaries is one issue, while when the microphone activates, and how raw audio and transcriptions are processed is another. The source report does not cover these details, so it is more reasonable to wait for official explanations when the stable version launches. For developers, it is worth tracking whether Audio Intelligence will expose more open APIs; for regular users, you can treat it as a beta "instant replay" tool for now, and don't rush to hand over important conversations to it for summarization.

Source: The Verge's report on Apple Watch Audio Intelligence and the watchOS 27.3 developer beta.