Spoken Language Understanding

Also known as SLU

Overview

Spoken Language Understanding studies how systems interpret what people say, from identifying intents and filling slots to tracking dialogue state, answering questions, and taking actions. Approaches include ASR pipelines paired with language models, end-to-end speech and audio language models, and structured methods that combine transcript, acoustic, and conversational evidence. Work also uses fine-tuning, synthetic data, and multilingual benchmarks to address low-resource languages, accents, noise, and varied speaking styles. A central challenge is making models reason reliably from speech itself: transcription errors and difficult acoustic conditions can undermine semantic decisions even when text-based performance is strong.

Latest papers

CardsList

41 papers4 papers in the last four weeks, down 64% on the four weeks before. 0.0% of all new papers.

  1. Heard Enough to Act: Early Tool Calling in Spoken Dialogue Systems

    Oct 26, 2026Yizhou Peng, Chen Chen, Donghang Wu +2Spoken Dialogue SystemsSpoken Language Understanding

  2. ASR-Style Transcript Normalization Removes Useful Pragmatic Signal for Dialogue Act Classification

    Oct 16, 2026Lucky Onyekwelu-Udoka, Md Shafiqul IslamSpoken Language UnderstandingSpoken Dialogue Systems

  3. Zero-Shot Spoken Language Understanding with SLAM-ASR: What Do Monolingual ASR-Trained Linear Projectors Enable?

    Oct 14, 2026Edwin Arkel Rios, Sneh Sourabh, Jocelyn Zaruma +3Spoken Language UnderstandingSpeech Language Models

  4. When Does an ASR Error Matter? Task-Role Diagnostics for Tool-Using Voice Agents

    Oct 13, 2026Xiaolong Wang, Shijie Su, Naqi XiongVoice Agent EvaluationASR Evaluation

  5. Turning Speech Language Models into Multilingual Listeners

    Sep 27, 2026Tolúlopé Ògúnrèmí, Dan Jurafsky, Chris Manning +2Speech Language ModelsSpoken Language Understanding

  6. The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding

    Sep 23, 2026Bingshen Mu, Mingchen Shao, Zhennan Lin +7Spoken Language UnderstandingMultilingual Language Model Evaluation

  7. NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task

    Sep 22, 2026Peter Sullivan, Bashar Talafha, Ahmed Ashraf +11ASR EvaluationSpoken Language Understanding

  8. SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia

    Sep 9, 2026Jingyi Liao, Wenyu Zhang, Zhuohan Liu +6Audio-Language Model EvaluationASR Evaluation

  9. Who Are They to Each Other? Multi-Agent Reasoning for Speaker Relationship Inference

    Sep 9, 2026Yaohan Guan, Yen-Ju Lu, Yuzhe Wang +5Spoken Language UnderstandingMulti-Agent Debate

  10. AVERT: Audio-Verified Adjudication for Spoken Dialogue State Tracking

    Sep 1, 2026Chunggi Lee, Hanspeter PfisterSpoken Language UnderstandingSpoken Dialogue Systems

  11. Aslema at NADI 2026: Data Augmentation for Intent Recognition and Slot Filling

    Aug 19, 2026Tajwaar Shafiq, Hunzalah Hassan Bhatti, Firoj Alam +1Spoken Language UnderstandingSynthetic Data Augmentation

  12. Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models

    Aug 5, 2026Yuezhang Peng, Yuxin Liu, Changfeng Gao +4Audio-Language Model EvaluationSpoken Language Understanding

  13. ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions

    Jul 20, 2026Fernando López, Ana Ayala, Guillermo Segovia +4Audio-Language Model EvaluationSpoken Language Understanding

  14. Efficiently Adapting Spoken Language Models for the Singaporean Context

    Jul 11, 2026Ng Jia Sheng JasonSpoken Language UnderstandingMulti-Task Learning

  15. LuxSQA: Ask Me in Luxembourgish with TTS-Augmented Spoken Question Answering

    Jul 2, 2026Nina Hosseini-Kivanani, Marco Matassoni, Alessio BruttiSpoken Language UnderstandingSynthetic Data Augmentation

  16. Selective Capability Unlearning in End-to-End Spoken Language Understanding

    Jun 23, 2026Akanksha Singh, Vinod Kumar KurmiSpoken Language UnderstandingMachine Unlearning

  17. Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation

    Jun 10, 2026Zhen Ye, Xu Tan, Yiming Li +10Spoken Language UnderstandingFinite Scalar Quantization

  18. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Spoken Language UnderstandingAudio Understanding