Synthetic Data Augmentation for Speech Recognition

Overview

This field studies how to create extra training examples for speech recognizers when labeled recordings are limited or fail to represent real-world speakers and conditions. Common approaches include text-to-speech synthesis, voice conversion and cloning, language-model-generated transcripts or phonetic variants, and acoustic transformations such as speed or pitch changes. Researchers apply these methods to settings including low-resource languages, accents, code-switching, conversation, and disordered speech, and evaluate them with word error rates and task-specific error measures. A key open tension is that more natural-sounding synthetic data does not always improve recognition: its value depends on how well it matches the target speech, what variation it adds, and how it is mixed with real recordings.

Latest papers

CardsList

31 papers4 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Wav2Aug: A Drop-In Speech Augmentation Policy

    Oct 28, 2026Gianfranco Dumoulin Bertucci, Mirco RavanelliData AugmentationSynthetic Data Augmentation for Speech Recognition

  2. One Mean Log-Mel Vector per Phoneme: Simple and Fast Text Injection for Speech Recognition

    Oct 25, 2026Albert Zeyer, Davyd Naveriani, Dorian Koch +2Automatic Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  3. PhonoBridge: Error-Aware Phoneme-Mediated EMG-to-Text Reconstruction

    Oct 20, 2026Wen Qiu, Jiacheng Zhang, Xuanda Chen +2Automatic Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  4. Error Rate is Not Enough: Costs of Augmentation in Low-Resource ASR

    Oct 9, 2026Katsumi Ibaraki, David ChiangLow-Resource Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  5. Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation

    Sep 25, 2026Pol Buitrago, Pol Gàlvez, Javier HernandoAudio-Visual Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  6. Foreground Voice Activity Detection: Learning Speaker Selectivity from Supervision

    Sep 17, 2026Guangzhao Yang, Muhammad Huzaifah, Yu Pan +2Data AugmentationSpeech Processing

  7. Phoneme-guided TTS augmentation for ASR: A unified pipeline and multilingual evaluation

    Aug 27, 2026Zhen Wang, TianRui Wu, RongQi Han +3Synthetic Data AugmentationTTS Synthesis

  8. On the Role of Conversational Timing in Synthetic Training Data for ASR

    Jul 9, 2026Máté Gedeon, Péter MihajlikMulti-Speaker ASRAutomatic Speech Recognition

  9. LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering

    Jul 2, 2026Nina Hosseini-Kivanani, Marco Matassoni, Alessio BruttiSpoken Language UnderstandingSynthetic Data Augmentation

  10. How to Leverage Synthetic Speech for LLM-Based ASR Systems?

    Jun 27, 2026Yanis Labrak, Dairazalia Sanchez-Cortes, Sergio Burdisso +9Synthetic-to-Real Domain AdaptationSynthetic Data Augmentation

  11. Learning from Real Stuttering: Synthetic Mandarin Stuttering Speech for Data Augmentation in Speech Recognition

    Jun 19, 2026Yao Lu, Jiaming Zhou, Zhongyuan Fu +1Synthetic Data AugmentationTTS Synthesis

  12. Synthetic Audio Generation Framework for Air Traffic Control Speech Recognition

    Jun 19, 2026Raphaël Bagat, Zhe Zhang, Junichi Yamagishi +2Synthetic Data GenerationSpeech Processing

  13. Low-Burden Data Augmentation for Dysarthric ASR via Zero-Shot Voice Cloning

    Jun 18, 2026Satwinder Singh, Qianli Wang, Zihan Zhong +4Synthetic Data AugmentationAutomatic Speech Recognition

  14. Improving End-to-End Speech Recognition for Dysarthric Speech through In-Domain Data Augmentation

    Jun 18, 2026Paban Sapkota, Hemant Kumar Kathania, Sudarsana Reddy Kadiri +1Data AugmentationAutomatic Speech Recognition

  15. Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speech

    Jun 14, 2026Yue Heng Yeo, Haoyang Li, Yizhou Peng +6Code-Switching Speech RecognitionSynthetic Data Augmentation

  16. Multilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026

    Jun 3, 2026Enes Yavuz Ugan, Maike Züfle, Yuka Ko +5MBR DecodingInstruction Following

  17. Efficient ASR Training with Conversations that Never Happened

    Jun 2, 2026Máté Gedeon, Péter MihajlikSynthetic Data AugmentationConversational Speech Recognition

  18. Few-Shot Synthetic Accented Speech for ASR Fine-Tuning: What Helps and When?

    Apr 30, 2026Yurii Halychanskyi, Nimet Beyza Bozdag, Mark Hasegawa-Johnson +2Synthetic-to-Real Domain AdaptationSynthetic Data Augmentation

  19. Elderly-Contextual Data Augmentation via Speech Synthesis for Elderly ASR

    Apr 15, 2026Minsik Lee, Seoi Hong, Chongmin Lee +4Automatic Speech RecognitionSynthetic Data Augmentation for Speech Recognition

  20. Enhancing ASR Performance in the Medical Domain for Dravidian Languages

    Apr 10, 2026Sri Charan Devarakonda, Ravi Sastry Kolluru, Manjula Sri Rayudu +3Medical Speech RecognitionAutomatic Speech Recognition

  21. TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs

    Apr 9, 2026Jing Peng, Chenghao Wang, Yi Yang +5Connectionist Temporal ClassificationSpeech Language Models