cs.CLOct 6, 2026

Quality-Aware Self-Correcting Speech Translation on an Edge Device

Authors: Zubair Ajmal Farooq, Diptesh Kanojia

Organizations: School of CS and EE University of Surrey United Kingdom · Institute for People-Centred AI University of Surrey United Kingdom

Abstract

We present a fully offline speech-to-speech translation pipeline that runs on a Jetson Nano (4 GB) and corrects its own weak translations without retraining. A Whisper-tiny ASR feeds an Opus-MT translator; multilingual BERT cosine similarity acts as a Quality Estimation (QE) gate, triggering a secondary-pass correction when confidence falls below a pre-defined threshold ττ. We compare three correction methods: QE reranking (M1), Minimum Bayes-Risk decoding (M2), and constrained beam search (M3). On 1,012 FLORES-200 sentences (English-Spanish), M2 at τ=0.90τ=0.90 produces statistically significant improvements over greedy decoding on BLEU (+0.67, p<0.001), ChrF (+0.51, p<0.001), and COMET (+0.0020 at N=3, p=0.002); M1 yields no significant gains, and M3 is significantly worse than baseline (p>0.99). Our central finding is that QE functions effectively as a gate but poorly as a ranker: removing the QE model from candidate selection (M1→\toM2) does not hurt quality and frees 680 MB from the critical path. Using a gain-to-edit ratio adapted from the post-editing-effort literature, we further show that smaller candidate pools (N=3) yield more surgical corrections with better semantic adequacy, while larger pools (N=10) maximise lexical reward. We release the system and demonstrate live translation across six language pairs.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. HydraQE: OSU's Submission for the IWSLT 2026 Speech Translation Metrics Shared Task

    Jun 7, 2026Kevin Krahn, Eric Fosler-LussierSpeech TranslationImage Quality Assessment

  2. CompactQE: Interpretable Translation Quality Estimation via Small Open-Weight LLMs

    May 15, 2026Kamil Guttmann, Zofia Fraś, Artur Nowakowski +1Machine Translation QualityMachine Translation

  3. AskQE: Question Answering as Automatic Evaluation for Machine Translation

    Apr 15, 2025Dayeon Ki, Kevin Duh, Marine CarpuatMachine Translation QualityMachine Translation