Requirement 013 and its implementation: page-mic.js puts a microphone on every textarea and text input, records with MediaRecorder and inserts the transcript at the cursor; Escape cancels. /api/stt transcribes with the local whisper.cpp model ggml-small-q8_0 (pinned to commit 5359861c and its sha256) in a per-request temp dir, capped at 60 s and 5 MiB, and returns German or English only, retranscribing a clip detected as another language in both and keeping the surer one. Without a model the button is disabled and names the install row. Tests run once on unify/skills-20261114 after the merge (operator order 2026-11-14). 🎯 Fix: 72 % 💥 Break: 12 % 💸 Tokens: – ⏱️ Velocity: – 🛡️ Security: 100 % 🏆 Score: 63 🚦 Gate: ⛔ fix 72 % < 90, break 12 % > 5 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
4.0 KiB
4.0 KiB
013 - Voice Input
User Story
As the operator, I want a microphone on every text field of the hub that turns my speech into text on this machine, so that I can work without a keyboard on a desktop and on a small screen.
Decisions (operator-confirmed 2026-11-14; do not re-litigate)
- Everywhere: one shared microphone component sits on every
textareaand text input of the hub (composer, radio, feedback popup, marks, filters, settings), present by default. Rejected: an opt-in per field. - Local Whisper: the browser records with MediaRecorder and sends the audio to the hub on this machine, which transcribes it with a local Whisper model; the audio never leaves the machine and is deleted right after the transcription. Rejected: the browser's speech recognition (Chrome sends audio to Google, Firefox has none); a browser fallback.
- Insert: the text lands at the cursor; German and English are detected automatically; a second tap stops the recording, Escape cancels it, and a visible indicator shows while it records.
- Model: the one-time model download is an operator row; without a model the button is disabled and its tooltip names that row.
- Limits: a recording is capped at 60 s and 5 MB; the transcription endpoint accepts requests only from the hub page, with the same origin and CSRF checks as every other POST of the hub.
- Responsive: touch targets of at least 44 px at 390 px; the component works with mouse, touch and keyboard.
- Order: built in parallel with 012 in its own sidetree; 012's feedback popup and marks get the microphone through the shared component.
Approach
flowchart TD
subgraph P["🧭 0 · Preparation"]
P1["📋 Write requirement"] --> P2{"✅ Operator approves?"}
P2 -- "✏️ corrections" --> P1
end
P2 -- "🤖 yes" --> S1
subgraph S["🗣️ A · Local transcription"]
S1["📥 Operator row: model download"] --> S2["🧩 /api/stt: caps, origin, CSRF, temp cleanup"]
S2 --> S3["🧠 Local Whisper, German and English"]
S3 --> ST{"🧪 Unit and fixture audio green?"}
ST -- "🔴 no: fix" --> S2
end
ST -- "🟢 yes" --> M1
subgraph M["🎙️ B · Microphone everywhere"]
M1["🧩 Shared component on every text field"] --> M2["⏺️ Record, stop, cancel, indicator"]
M2 --> M3["✍️ Insert at the cursor"]
M3 --> MT{"🧪 E2E with a fake microphone green?"}
MT -- "🔴 no: fix" --> M1
MT -- "🟢 yes" --> MF{"💬 Operator feedback on screenshots?"}
MF -- "✏️ changes" --> M1
end
MF -- "👍 fits" --> E1["🏁 Review, commit with operator OK, hand-over"]
Acceptance Criteria
Transcription
- A POST of the German fixture WAV to
/api/sttreturns "hallo welt", the English fixture returns "hello world". - The transcription's temp directory is empty after each request, including a failed one.
- A request from another origin, without the CSRF token, over 60 s or over 5 MB is refused with 4xx and is not transcribed.
- Without an installed model,
/api/sttanswers with the operator row that installs it, and the button is disabled with that row in its tooltip.
Microphone
- A DOM scan of every hub view finds no
textareaor text input without the microphone button. - Pressing the button records, a second press stops and the transcript appears at the cursor; Escape cancels without inserting text; an indicator shows while it records.
- At 390 px the button's touch target is at least 44 by 44 px.
Tests
- Unit: the endpoint caps, the origin and CSRF checks, the temp cleanup and the language selection.
- Integration: the real model transcribes both fixture files, run
through
queue.py hold. - E2E: Chromium and Firefox with a fake microphone stream fed from a WAV file, at 1920 and 390 px; the transcript appears in the composer; negative control: with the model missing the button is disabled.