cs.SDNov 2, 2026

Clean-anchored excess-emission control for CTC adaptation under competing speech

Authors: Yuanbo Zhou, Junjie Xiong

Organizations: Missouri University of Science and Technology

Abstract

Competing speech can cause excess emissions in a connectionist temporal classification (CTC) recognizer. We penalize the amount by which the noisy student's expected collapsed token count exceeds a frozen teacher's count on the paired clean utterance. The one-sided objective caches one scalar per utterance and adds no inference module. With 147,456 trainable parameters in wav2vec 2.0, it improves competing-speech word error rate (WER) over matched CTC-only adaptation across three development seeds. On a locked LibriSpeech test, speech-interference WER falls from 45.198% to 44.323%, while clean WER changes by 0.004 percentage points. Unseen VCTK interferers yield a 0.307-point improvement. Ablations favor collapsed-count control over frame-mass regularization. Longer training increases the speech gain but worsens noise and music performance, identifying an insertion-deletion tradeoff rather than uniform robustness.

Figures & tables

Explore similar work

CardsList
  1. The Anatomy of the CTC Oracle Gap: Acoustic Exhaustion and Linguistic Recovery

    Jun 22, 2026Ivan NovosadASR EvaluationLanguage Model Decoding

  2. Test-time adaptation for speech enhancement with an autoregressive speech prior

    Sep 3, 2026Sofiene Kammoun, Simon Leglaive, Xavier Alameda-Pineda +1Test-Time AdaptationSpeech Enhancement

  3. TASU2: Controllable CTC Simulation for Alignment and Low-Resource Adaptation of Speech LLMs

    Apr 9, 2026Jing Peng, Chenghao Wang, Yi Yang +5Connectionist Temporal ClassificationSpeech Language Models