cs.AISep 24, 2026

Pretrained ASR Pseudo-labeling for Noisy Police Audio

Authors: Kaavya Chaparala, Su Huang, Stephen L. Morgan, Rhiannon N. Miller, Anjalie Field

Organizations: Johns Hopkins University, Baltimore, USA · Providence College, Providence, USA

Abstract

Pretrained ASR systems perform poorly on noisy Broadcast Police Communication (BPC), hindering efforts to understand police decision-making. Pseudo-labeling offers an unsupervised path to improve ASR without expensive human labels, but the efficacy of this approach on very noisy domains is not known. In this work, we systematically assess the opportunities and limits of pseudo-labeling to adapt foundation ASR models (Whisper and Qwen3-ASR) to noisy BPC domain corpora from Baltimore and Chicago. We demonstrate that existing internal confidence metrics (log-probabilities and STAR scores) fail to distinguish between high and low quality BPC pseudo-labels, and we introduce an external LLM-as-a-judge filtering paradigm that leverages parametric knowledge to discard contextually implausible transcripts. Our LLM-judging filters more aggressively than internal metrics and significantly reduces WER of the pseudo-labeled training sets across the Baltimore and Chicago BPC corpora, though a substantial gap remains relative to an oracle filter. We also introduce a new cross-model pseudo-labeling paradigm where one model is finetuned with pseudo-labels from the other, and we identify this method as a promising direction for future pseudo-labeling work.

Explore similar work

CardsList
  1. Enhancing BEST-RQ Pseudo-Label Quality through Online Refinement for Automatic Speech Recognition

    Jun 24, 2026Jingjing Xu, Zijian Yang, Mohammad Zeineldeen +3Automatic Speech RecognitionHigh Confidence Pseudo-Labels

  2. From Text Metrics to Model Internals: A Study of Whisper ASR Hallucination Detection

    Jun 22, 2026Jan Jasiński, Mateusz Barański, Julitta Bartolewska +2Automatic Speech RecognitionHallucination Detection

  3. Enhancing Law-Enforcement Audio Transcription: A LoRA-Based Adaptation of Whisper for BWC Footage

    Jul 27, 2026Vivek Senthil, Ernest FokouéWhisper-Large-V3Policing