cs.LGMay 15, 2026

Symphony for Speech-to-Text: Supporting Real-Time Medical Voice Interfaces

Authors: Arne NixRobert JamesLasse BorgholtAnna B. EknerLana KrummJulius SeverinDan EngelLars Maaløe+1 more

Organizations: Corti

Abstract

After decades of use in dictation and, more recently, ambient documentation, speech is emerging as a primary modality for interacting with technology and AI in healthcare. Yet medical speech recognition remains difficult: systems must capture specialized terminology, resolve contextual ambiguity, and render measurements, abbreviations, and clinical shorthand precisely. Existing solutions are typically optimized either for general-purpose transcription or narrow dictation workflows, limiting their reliability in safety-critical settings and their usefulness for broader clinical workflows. We introduce Symphony for Speech-to-Text, a medical-grade speech recognition system for real-time streaming and batch file-based clinical use. Symphony decomposes the transcription process into specialized components for recognition, formatting, and contextual correction to optimize medical term recall while producing clinically structured text in real time and adapting across use cases. Evaluations on public benchmark and medical speech datasets show that Symphony substantially outperforms state-of-the-art systems in clinical settings while matching or exceeding them in general-domain settings, suggesting robust generalization rather than overfitting. We release a clinical benchmark dataset to support reliable validation and further progress in medical speech recognition. Symphony is available through a production-grade API for live dictation, conversational transcription, and batch audio file processing.

Explore similar work

CardsList
  1. SpeechDx: A Multi-Task Benchmark for Clinical Speech AI

    Jun 15, 2026Sejal Bhalla, Larry Kieu, Aina Merchant +2Librispeech

  2. Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026

    Aug 25, 2026Enes Yavuz Ugan, Fabian Retkowski, Yuka Ko +4