Spoken QA

QA: Question Answering

Overview

Spoken question answering studies how systems answer questions delivered as speech while preserving the meaning, language, and evidence in the input. Approaches range from automatic speech recognition followed by language models and retrieval to end-to-end speech-language models, using speech-text alignment, audio representations, attention-based grounding, and synthetic speech for training. Current work also uses task-specific and on-policy distillation to balance recognition, text reasoning, and speech output, and evaluates systems on factoid, multi-hop, multilingual, noisy-audio, and domain-specific benchmarks. A central tension is whether direct audio processing can avoid transcription errors without sacrificing text-native reasoning, while benchmark coverage and automated judging remain unreliable across languages and answer formulations.

Latest papers

CardsList

12 papers1 paper in the last four weeks, down 67% on the four weeks before. 0.0% of all new papers.

  1. Repairing Speech Access After Text Updates with Frozen Affine Fields

    Oct 14, 2026Ming-Hao Hsu, Yuxiang Wang, Yingda Shen +1Multimodal Knowledge EditingSpeech Language Models

  2. TS-OPD: Reconciling ASR and QA in Speech Language Models via Task-Specific On-Policy Distillation

    Sep 24, 2026Yujie Guo, Hongjie Chen, Jian Kang +3Automatic Speech RecognitionOn-Policy Distillation

  3. VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering

    Sep 17, 2026Bhavana Akkiraju, Ravi Sastry Kolluru, Sri Charan D +3Audio QALLM-as-a-Judge

  4. Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation

    Sep 14, 2026Daxin Tan, Dehua Tao, Chengxi Deng +2On-Policy DistillationSpeech Language Models

  5. LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering

    Jul 2, 2026Nina Hosseini-Kivanani, Marco Matassoni, Alessio BruttiSpoken Language UnderstandingSynthetic Data Augmentation

  6. NAVER LABS Europe Submission to the Instruction-following 2026 Short Track

    Jul 2, 2026Marcely Zanon Boito, Hemant Yadav, Jean-Luc Meunier +1Speech TranslationQuestion Answering

  7. Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation

    Jun 10, 2026Zhen Ye, Xu Tan, Yiming Li +10Spoken Language UnderstandingFinite Scalar Quantization

  8. Analyzing Error Propagation in Korean Spoken QA with ASR-LLM Cascades

    May 17, 2026Donghyuk Jung, Youngwon ChoiAudio-Language Model EvaluationQuestion Answering

  9. How Should LLMs Listen While Speaking? A Study of User-Stream Routing in Full-Duplex Spoken Dialogue

    May 11, 2026Hui Lu, Xueyuan Chen, Huimeng Wang +4Language Model RobustnessFull-Duplex Spoken Dialogue Systems

  10. Attention-guided Evidence Grounding for Spoken Question Answering

    Mar 17, 2026Ke Yang, Bolin Chen, Yuejie Li +5Spoken QAMultimodal QA