I run my coding agents side by side in Orca, a desktop app for running agents such as Claude Code in parallel, and I talk to them with the dictation app Wispr Flow. Talking to an agent is solved. I wanted it to talk back: tell me what it did and what it needs from me, out loud, like voice mode in the Claude apps.
So I built orca-talkback. When an agent in the workspace I am looking at finishes, I hear one to three conversational sentences about its reply, spoken locally on my Mac, starting about 0.8 seconds after it finishes. If I start talking, it stops.
It is two small open-source pieces: a Python daemon and an Orca plugin.
The agent writes for your ears
Agent replies are written to be read: tables, file paths and commit hashes that sound like a recited changelog. So when Talkback is on for a session, a Claude Code UserPromptSubmit hook adds one hidden instruction to each prompt: end the reply with a spoken version, written as a markdown comment.
[//]: # (spoken: I fixed the barge-in bug and pushed it. Want me to tag a release?)
Orca’s chat view hides link reference definitions like this, so the reply looks unchanged, and the daemon speaks the line. The agent that did the work writes it, so no second model has to summarise anything.
Claude Code’s terminal would print the line, so terminal agents are not asked for one. For them, or when an agent forgets, orca-talkback speaks a cleaned-up reply instead, with code, tables and links removed, cut at a sentence boundary.
The Talkback button in Orca’s status bar toggles it per session: muted, the hook adds nothing and nothing is spoken. Each Orca chat is its own workspace, so muting one chat mutes only that chat.
Talking over it
Barge-in is the hard part: the microphone hears the speakers, so a naive voice detector would stop the agent with its own voice.
orca-talkback feeds everything it plays to WebRTC’s AEC3 echo canceller as the reference, so the agent’s voice is removed from the microphone signal before Silero VAD looks for speech. The rule that makes this work: the reference must be exactly the audio sent to the speaker, silences included, on one continuous timeline, because AEC3 tracks a steady delay, not one that jumps. So the pause while the next chunk is synthesised is real silence written to both. Padding the reference later from microphone timing would mistake audio still in the output buffer for silence, putting every later sentence ahead of its reference. One canceller lasts the whole reply, so what it learns about the room carries over.
Your voice is not in the reference, so it survives cancellation, and about 160 ms of it stops playback with a short fade. In six test replies through MacBook speakers, five never came close to interrupting themselves; the sixth had one quarter-second burst louder than anything the speakers played, most likely room noise. A second voice talking over the reply stopped it in both tests I ran.
Only when you are looking
A voice that talks while you read something else is worse than none, so orca-talkback only speaks when:
- Orca is the app in front. It checks twice a second, so switching to your browser cuts it off.
- The agent is on screen. That is the workspace picked in Orca’s sidebar, or the chat you just prompted. Orca does not tell plugins which chat is visible, so prompting a chat is the most reliable sign you are looking at it.
Other replies are never spoken, or replayed later.
Choosing a voice
To pick a voice, I compared the open models on Hugging Face’s Open TTS Leaderboard:
| Model | Naturalness (UTMOS) | Word error rate | Size | License |
|---|---|---|---|---|
| Kokoro-82M | 4.50 | 0.76% | 82M | Apache-2.0 |
| Inflect-Mini-v3 | 4.48 | 0.76% | 34M | Apache-2.0 |
| Reverb-TTS | 4.45 | 0.65% | 297M | CC-BY-NC-4.0 |
| Chatterbox | 4.40 | 1.00% | 800M | MIT |
In November 2026, Kokoro had the highest UTMOS of the 56 models on the English Seed-TTS set and a word error rate 0.11 percentage points behind the best. UTMOS is a predicted naturalness score, not a human rating, so its 0.02 lead over Inflect-Mini-v3 is a tie; what decided it was being near the top on both while small and Apache-2.0. It also had the lowest word error rate (0.96%) of the 33 models on VoiceHub’s Seed-TTS-Eval.
Try it
You need macOS on Apple Silicon, Orca 1.4.248 or newer, and uv.
uv tool install --python 3.14 orca-talkback
orca-talkback setup # adds the Claude Code hook, downloads the voice (about 340 MB), checks your mic
orca plugin install CallumJMac/orca-talkback-plugin
# Orca prints a "Fingerprint: ap1-..." line; re-run the command with --approve and that fingerprint
orca-talkback
You can also install the plugin from Orca’s Settings, Plugins. Then ask an agent something in an Orca chat. No Homebrew, no API keys: after the one-off voice download everything runs on your Mac, the microphone is only open while it speaks, and nothing is recorded.
It is early, tested with Claude Code agents on an M4 Max, and I would love to hear how it works for you. Issues and pull requests are welcome on GitHub.
Comments