Overview

Audio understanding studies how machines can identify and interpret speech, music, environmental sounds, speakers, and the relationships among events in a recording. It matters for applications such as voice assistants, accessibility, health monitoring, and ecological research, where systems must respond to what was actually heard. Common approaches include self-supervised audio encoders trained with masked prediction, contrastive audio-text models, and audio-language models adapted through instruction tuning; retrieval and temporal-grounding methods help handle long recordings and locate relevant events. Models perform well on many standard tasks, but can rely on text or visual cues instead of sound, and remain unreliable on noisy, multilingual, long-form, and fine-grained temporal understanding.

Latest papers

CardsList

225 papers12 papers in the last four weeks, down 56% on the four weeks before. 0.1% of all new papers.

  1. Think2Listen: Evidence-Centric Learning For Agentic Audio Understanding With LALMS

    Nov 16, 2026Jin Wang, Liang Lin, Kaiwen Luo +7Audio UnderstandingAudio Reasoning

  2. Harmony: Bridging Audio Understanding and Editing through Agentic Collaboration

    Nov 10, 2026Zhongyi Tong, Yapeng TianAudio EditingAudio Understanding

  3. Dyship: Leveraging Acoustic Features For Speaker Relationship Classification From Dyadic Conversations

    Nov 10, 2026Kieran Sturges, Thomas Thebaud, Yaohan Guan +1Audio Understanding

  4. Machine Hearing: Can Audio LLMs Generalize Beyond Human Auditory Perception?

    Nov 7, 2026Liwei Liu, Jun Tao, Xingyuan Li +8Audio-Language ModelsAudio Understanding

  5. SonoDyno: A Sonic Dynamometer for Engine Speed and Load Estimation from Audio

    Nov 4, 2026Robin Doerfler, Beat RossmyAudio Understanding

  6. Leakage-aware acoustic drone detection: fusing hand-crafted and pretrained audio features in a stacking ensemble

    Nov 3, 2026Zahid IqbalUAV DetectionMulti-View Feature Fusion

  7. MixCards: Evaluating Structured Descriptions of Multi-Source Sound Scenes

    Oct 28, 2026Sripathi Sridhar, Yujin Kim, Giovana Morais +6Audio-Language Model EvaluationAudio Understanding

  8. Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence

    Oct 27, 2026Yunuo Wang, Maoyuan Chen, Yuanjin Huang +1Audio UnderstandingAudio-Language Model Evaluation

  9. Correspondence Is Not Transfer: A Pairing-Controlled Study of Clinical Audio-Metadata Alignment

    Oct 26, 2026Liu He, Xi Wang, Jiahong Yuan +1Cross-Modal AlignmentAudio Understanding

  10. Interpretable Singing Emotion Recognition Using Acoustic and Vocal Technique Features

    Oct 23, 2026Fotini Kiriakopoulou, Vassilis Lyberatos, Spyridon Kantarelis +2Emotion RecognitionAudio Understanding

  11. Qwen-Audio-3.1-ASR Technical Report

    Oct 20, 2026Chuanmeng Bian, Daren Chen, Peixin Chen +45Audio-Language ModelsAutomatic Speech Recognition

  12. VocalGrad: Evaluating Acoustic Perception in Audio Language Models

    Oct 16, 2026Koki Ryu, Hitomi YanakaAudio-Language Model EvaluationAudio Understanding

  13. MedSonor: Learning to Use Clinical Audio in Medical LLMs

    Oct 14, 2026Geyang Yu, Junying Chen, Benyou WangMedical LLMsAudio-Language Models

  14. AMemOps: Evaluating Memory Updates in Long Audio Streams

    Oct 13, 2026Peiwei Chang, Li Zhang, Mark D. Plumbley +2Audio UnderstandingAssociative Memory

  15. ATTEST: Evidence-Grounded Reinforcement Learning for Long-Audio Temporal Understanding

    Oct 12, 2026Ashutosh Chaubey, Jinxi Guo, Minh Tran +2Temporal Audio GroundingAudio Understanding

  16. PitchIn: Natural-Language Vocal Coaching from Unstructured Community Feedback

    Oct 12, 2026Hayeon Bang, Hounsu Kim, Joonyong Park +2Audio-Language ModelsAudio Understanding

  17. The NVVSpeech Challenge 2026: Overview and Lessons for Speech Understanding and Generation with Nonverbal Vocalizations

    Oct 12, 2026Liumeng Xue, Yuang Cao, Jingbin Hu +12Nonverbal Vocalization GenerationAudio Understanding

  18. QC-MI-OVSEL: Benchmarking Query-Conditioned Multi-Instance Open-Vocabulary Sound Event Localization

    Oct 9, 2026Yongqiang Chen, Peiwei Chang, Yuelan Cheng +2Audio UnderstandingSpatial Audio

  19. CARES: A Controlled Synthetic Benchmark of Speaker Reactions to Sound

    Oct 7, 2026Marcel Gibier, Thomas Thebaud, Olivier Boëffard +1Audio UnderstandingAudio Captioning

  20. ARIA: Audio-Driven Melody-Tone Relation Modeling for Cantonese Lyric Authoring

    Oct 6, 2026Shengyu Li, Jinting Wang, Li LiuAudio UnderstandingText Generation

  21. SkillFormer: Skill-Decomposed Adaptation for Audio Language Models

    Oct 6, 2026Lee Seung-woo, Bowen Qi, Kim Min-jun +1Multi-Task LearningAudio Understanding

  22. Logbook: Extremely Long-form Audio Event Understanding

    Oct 5, 2026Kwanghee Choi, Suwon Shon, Dmitriy Serdyuk +7Audio-Language Model EvaluationAudio Understanding

  23. Revisiting Frame-Wise Saliency for Audio Moment Retrieval

    Oct 5, 2026Tatsuya Komatsu, Hokuto MunakataDetection TransformerAudio Understanding

  24. Hallucination Reduction for LLM-Based Audio Understanding via Multimodal Direct Preference Optimization

    Oct 2, 2026Bebe Cosgrove, Aaron Isidore Grace, Weiran WangAudio UnderstandingAudio-Language Models