Audio Understanding

Ask about this topic

Momentum

17 papers in the last four weeks, up 325% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 169

All topics
CardsList

  1. CARES: A Controlled Synthetic Benchmark of Speaker Reactions to Sound

    Oct 7, 2026Marcel Gibier, Thomas Thebaud, Olivier Boëffard +1Audio UnderstandingAudio Captioning

    Inria, Paris, France · AMIAD, France

  2. ARIA: Audio-Driven Melody-Tone Relation Modeling for Cantonese Lyric Authoring

    Oct 6, 2026Shengyu Li, Jinting Wang, Li LiuAudio UnderstandingText Generation

    The Hong Kong University of Science and Technology (Guangzhou)

  3. SkillFormer: Skill-Decomposed Adaptation for Audio Language Models

    Oct 6, 2026Lee Seung-woo, Bowen Qi, Kim Min-jun +1Multi-Task LearningAudio Understanding

    Pusan National University · Shanghai Jiao Tong University · Hanyang University

  4. Logbook: Extremely Long-form Audio Event Understanding

    Oct 5, 2026Kwanghee Choi, Suwon Shon, Dmitriy Serdyuk +7Audio-Language Model EvaluationAudio Understanding

    UT Austin, USA · Meta Reality Labs, USA

  5. Revisiting Frame-Wise Saliency for Audio Moment Retrieval

    Oct 5, 2026Tatsuya Komatsu, Hokuto MunakataDetection TransformerAudio Understanding

    LY Corporation, Tokyo, Japan

  6. Revisiting Input Time-frequency Representations in Multi-pitch Estimation for Vocal Ensembles

    Oct 2, 2026Junyoung Koh, Hao-Wen DongMusic Information RetrievalAudio Understanding

    Yonsei University · University of Michigan

  7. LAST: Looped Audio Spectrogram Transformer

    Oct 1, 2026Haider Al-Tahan, Sean O'Brien, Anastasia Razdaibiedina +1Audio UnderstandingRecurrent Transformers

    Georgia Institute of Technology · University of California San Diego · Google DeepMind

  8. Multi-agent Auditory Scene Analysis: Improved Localization Speed and Robustness by Multi-beamformed Speech Quality Feedback

    Sep 30, 2026Caleb RasconMulti-Agent System OptimizationDirection-of-Arrival Estimation

    Instituto de Investigaciones en Matematicas Aplicadas y en Sistemas, Universidad Nacional Autonoma de Mexico, Circuito Escolar 3000, Coyoacan, 03740, Ciudad de Mexico, Mexico.

  9. UniAE-MoE: A Unified Audio Encoder via Mixture of Experts

    Sep 30, 2026Shengbo Cai, Zhisheng Zhang, Zichao Nie +3Audio Representation LearningMixture of Experts

    Tsinghua University, China

  10. Audio Token Attention Is Predictable Before the Language Model Runs

    Sep 30, 2026Kyoungjun Park, Yunzhe Li, Lili QiuAudio Token CompressionAudio Understanding

    The University of Texas at Austin

  11. Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions

    Sep 28, 2026Michel Olvera, Paraskevas Stamatiadis, Changhong Wang +1Audio-Language Model EvaluationAudio Reasoning

    S2A, LTCI, IDS · S2A, IDS

  12. NSV-Shift: A Contrastive Benchmark for Non-Speech Vocalization Understanding and Response Adaptation in Speech-to-Speech Models

    Sep 27, 2026Ziwei ChenSpeech Generation EvaluationAudio Understanding

    University of California San Diego

  13. When Does the Concept of "Dog" Emerge in an Audio LLM?

    Sep 27, 2026Zhe Wang, Shiqi Liu, Ruiyun Zhong +2Audio UnderstandingAudio-Language Models

    Huazhong University of Science and Technology, Wuhan, China

  14. EvoAudio: Recursive Self-Improvement for Audio Understanding

    Sep 23, 2026Yuxiang Wang, Shengbo Cai, Yingda Shen +6Synthetic Data GenerationAudio Understanding

    The Chinese University of Hong Kong, Shenzhen · Tencent Hunyuan · Tsinghua University +1

  15. When Entanglement Lower-Bounds Disparity: Auditing and Repairing Demographic Fairness in Audio Understanding Models

    Sep 23, 2026Kian Shamsaie, Iman ModarressiDisentangled Representation LearningAudio Representation Learning

    People Make Things

  16. MuLA-Bench: A Multilingual Long-Form Audio Understanding Benchmark via Multi-Tier Auditing

    Sep 20, 2026Zeyu Yang, Xinyu Zhang, Zibo Bi +5Audio-Language Model EvaluationAudio Understanding

    The Chinese University of Hong Kong, Shenzhen · Alibaba Token Hub, Alibaba Group · Xi’an Jiaotong University

  17. Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs

    Sep 19, 2026Jing Peng, Zichao Nie, Zhisheng Zhang +2Audio-Language Model EvaluationAudio Representation Learning

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China

  18. Augmenting Large Audio-Language Models with Frame-Level Grounding for Fine-Grained Temporal Perception

    Sep 14, 2026Yanfeng Shi, Yan Song, Junhui Li +4Audio UnderstandingAudio-Language Models

    National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei, China · ICT Cluster, Singapore Institute of Technology, Singapore

  19. Unifying Score and Performance for Fine-Grained Music Understanding in Audio-Language Models

    Sep 9, 2026Milan Liessens Dujardin, Song-Ze Yu, Kevin MiaoAudio UnderstandingAudio-Language Models

  20. NVV-Locator: From Transcript Tags to Acoustic Boundaries for Fine-Grained Nonverbal Vocalization Grounding

    Sep 9, 2026Yuang Cao, Bingshen Mu, Zhennan Lin +7Audio UnderstandingSound Event Detection

    School of Intelligence Science and Technology, Nanjing University, China · State Key Laboratory of Novel Software Technology, Nanjing University, China

  21. Source-Adaptive Data Curation for Bilingual NVV-Aware ASR

    Sep 9, 2026Yuang Cao, Qirui Zhan, Jingbin Hu +7Speech ProcessingAudio Understanding

    Shenzhen Pimei Technology, China · Yutuzhineng, China · Nanjing University, China

  22. Geometry-Informed Distributed Acoustic Scene Understanding

    Sep 7, 2026Yiyuan Yang, Shitong Xu, Niki Trigoni +1Scene Graph GenerationAudio Understanding

    Department of Computer Science, University of Oxford, United Kingdom

  23. Auditory Illusion Benchmark for Large Audio Language Models

    Sep 2, 2026Hayoon Kim, Eunice Hong, Kyogu LeeAudio Understanding

    Music and Audio Research Group, Seoul National University · Department of Intelligence and Information, Seoul National University · AIIS, Seoul National University +1

  24. TEMPO: Temporally-grounded Multi-task Post-training for Large Audio-Language Models

    Aug 30, 2026Apoorva Kulkarni, Kaousheik Jayakumar, Sreyan Ghosh +3Audio UnderstandingAudio-Language Models

    University of Maryland, College Park, USA · CNH Industrial India

  25. LongAudioSpan: Spanning the Duration and Depth of Audio Comprehension

    Aug 26, 2026Wen Huang, Yunfei Chu, Meng Gao +2Audio-Language Model EvaluationAudio Reasoning

    Qwen Team, Alibaba Group · Tsinghua University · The Chinese University of Hong Kong

  26. Robust Multi-Tier Infant-Centered Audio Understanding with Whisper via Structured Speaker Conditioning

    Aug 12, 2026Xulin Fan, Jialu Li, Mohammad Nur Hossain Khan +4Speech Foundation ModelsDomain Generalization

    University of Illinois Urbana-Champaign, USA · University of Arizona, USA · Worcester Polytechnic Institute, USA

  27. From Prompting to Describing: A Cross-Cultural Study of Language for AI-Generated Music

    Aug 6, 2026Sangheon Park, Claire ArthurText-to-Music GenerationAudio Understanding

    Georgia Institute of Technology School of Music

  28. The Learning Objective Governs Perceptual Narrowing: A Cross-Lingual, Layer-Wise, Ten-Seed Study of Self-Supervised Speech Encoders

    Aug 1, 2026Sejin YooAudio UnderstandingSelf-Supervised Speech Representation Learning

    Independent Researcher

  29. TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models

    Jul 30, 2026Aryan Vijay Bhosale, Harshit Rajgarhia, Abhishek Mukherji +1Audio-Language Model EvaluationAudio Editing

    Centific Global Solutions Inc. · University of Maryland

  30. Enhancing Law-Enforcement Audio Transcription: A LoRA-Based Adaptation of Whisper for BWC Footage

    Jul 27, 2026Vivek Senthil, Ernest FokouéSpeech Foundation ModelsAudio Understanding

    Rochester Institute of Technology, Rochester, NY, USA

  31. An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations

    Jul 23, 2026Liang-Yuan Wu, Sripathi Sridhar, Mark Cartwright +1Audio UnderstandingAutomated Evaluation

    New York University, New York, USA · New Jersey Institute of Technology, New Jersey, USA

  32. Encoder-Side Neuron Identification and Amplification for Acoustic Perception in Large Audio-Language Models

    Jul 13, 2026Yu-Han Huang, Chih-Kai Yang, Ke-Han Lu +2Audio UnderstandingAudio-Language Models

    National Taiwan University, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE), Taiwan

  33. GigaChat Audio: Time-aware Large Audio Language Model

    Jul 11, 2026Aleksandr Kutsakov, Mariia Sadovina, Georgii Gospodinov +4Audio QAAudio Understanding

    SaluteDevices, Russia

  34. TriA Pipeline: A Large-Scale Automatic Audio Annotation Pipeline For Audio Classification In Specific Scenarios

    Jul 7, 2026Hong Lyu, Mingru Yang, Qianhua He +3Training Data CurationAudio Understanding

    School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China

  35. Unified Audio Intelligence Without Regressing on Text Intelligence

    Jul 6, 2026Zhifeng Kong, Sang-gil Lee, Jaehyeon Kim +17TTS SynthesisUnified Multimodal Models

    NVIDIA

  36. Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Grounding

    Jul 5, 2026Zihan Zhang, Xize Cheng, Wenhao Yan +5Audio UnderstandingAudio-Language Models

    Zhejiang University · Tsinghua University

  37. Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings

    Jul 4, 2026Héctor Martel, Joe Hennessy-Priest, Taemin ChoRepresentation GeometryAudio Representation Learning

    BandLab Technologies, Singapore

  38. An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation

    Jul 2, 2026Haoran Wang, Jinchuan Tian, Siddhant Arora +1Audio UnderstandingSpeech Language Models

    Carnegie Mellon University

  39. Grammar-Guided Hierarchical Parsing for Long-form Audio Activity Recognition

    Jun 26, 2026Peng Zhang, Qingyu Luo, Philip J. B. Jackson +1Temporal Action SegmentationHuman Activity Recognition

    Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, U.K.

  40. From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models

    Jun 24, 2026Pengfei Zhang, Hoang H Nguyen, Kazi Shaharair Sharif +6Audio-Language Model EvaluationAudio Understanding

    University of California Irvine · University of Illinois Chicago · Kennesaw State University

  41. Beyond Classification: A Cough Regression Benchmark for Respiratory Acoustic Foundation Models

    Jun 13, 2026Mayur Sanap, Prasanna Desikan, Edgar LobatonAudio UnderstandingClinical Prediction

    Centific Global Solutions Inc. · Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA.

  42. Spatio-Temporal Audio Language Modeling for Dynamic Sound Sources

    Jun 12, 2026Oh Hyun-Bin, Kazuki Shimada, Yuhta Takida +6Audio-Language Model EvaluationAudio Representation Learning

    1POSTECH · 2Sony AI · 4Sungkyunkwan University +2

  43. Decoding Insect Song: A Multitask Semisupervised Orthoptera Bioacoustic Classifier

    Jun 11, 2026Olga Isupova, Danil Kuzin, Ella Browning +2Audio Representation LearningAudio Understanding

    Leverhulme Centre for Nature Recovery, School of Geography and the Environment, University of Oxford, Oxford, UK

  44. From Physics to Representation: Audio Learning with Synthetic Pre-training via Procedural Generation

    Jun 11, 2026Fengrui Liu, Ruiyang Huang, Qijian Zheng +2Synthetic Data PretrainingAudio Representation Learning

    East China Normal University · Southeast University · Fudan University +1

  45. Dolph2Vec: Self-Supervised Representations of Dolphin Vocalizations

    Jun 10, 2026Chiara Semenzin, Faadil Mustun, Roberto Dessi +5Audio Representation LearningAudio Understanding

    École Normale Supérieure, Paris, France · Not Diamond, San Francisco, USA · Institut du Cerveau, Paris, France +1

  46. Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation

    Jun 10, 2026Zhen Ye, Xu Tan, Yiming Li +10Spoken Language UnderstandingAudio Representation Learning

    Hong Kong University of Science and Technology, Hong Kong SAR · Tencent, China · Independent Researcher +4

  47. Lung-SRAD: Spectral-Aware Regularized Audio DASS with Dual-Axis Patch-Mix Contrastive Learning for Respiratory Sound Classification

    Jun 10, 2026Hemansh Shridhar, Miika Toikkanen, June-Woo KimContrastive LearningSpectral Regularization

    RSC LAB, MODULABS, Republic of Korea · Department of Electronic Engineering, Wonkwang University, Republic of Korea · AI Convergence Research Institute, Wonkwang University, Republic of Korea

  48. Context-Aware Multimodal Claim Verification in Spoken Dialogues

    Jun 9, 2026Chaewan Chun, Delvin Ce Zhang, Dongwon LeeClaim VerificationAudio Understanding

    The Pennsylvania State University, USA · University of Sheffield, UK

  49. Steering Where to Listen: Instruction-Based Activation Steering Redirects Temporal Attention in Large Audio-Language Models

    Jun 9, 2026Tsung-En Lin, Hung-Yi LeeLanguage Model SteeringAudio Understanding

    National Taiwan University, Taipei, Taiwan · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)

  50. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Spoken Language UnderstandingAudio Understanding

    Meituan · Jilin University

  51. Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding

    Jun 9, 2026Zhiyuan Zhu, Yixuan Chen, Yiwen Shao +13Multimodal Large Language ModelsAudio Understanding

    Zhejiang University · Tencent Hunyuan

  52. ViP-VL: Vietnamese Self-supervised Speech Pretraining Model with Vector-Quantization Learning

    Jun 9, 2026Khanh Le, Kiet Anh Hoang, Bao Nguyen +5Audio Representation LearningSpeech Processing

    VinUniversity, Vietnam · UNEY, Switzerland

  53. RAIL: Rethinking Auditory Intelligence in Large Audio-Language Models with a CHC-Grounded Benchmark

    Jun 9, 2026Hongyu Jin, Siyi Wang, Yang Xiao +10Audio-Language Model EvaluationAudio Understanding

    School of Computing and Information Systems, The University of Melbourne, Australia · School of Electronic Information, Wuhan University, China · Faculty of Psychology and Educational Sciences, Alexandru Ioan Cuza University of Ias,i, Romania +3

  54. LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

    Jun 8, 2026Ruchao Fan, Yiming Wang, Yuxuan Hu +6Spoken Language UnderstandingAudio Understanding

    Microsoft, USA

  55. Is Text All You Need? Text as a Universal Information Bottleneck for Speech LLMs

    Jun 8, 2026Ming-Hao Hsu, Yuxuan Hu, Shujie Liu +3Audio Representation LearningAudio Understanding

    School of Data Science, The Chinese University of Hong Kong, Shenzhen, China. · Microsoft Research, Redmond, WA, USA. · Microsoft Research Asia, Hong Kong, China.

  56. AudioProcessBench: Benchmark for Identifying Process Errors in Audio-Grounded Reasoning

    Jun 7, 2026Xiangyu Zhao, Junyu Yan, Yaling Shen +7Audio-Language Model EvaluationReasoning Evaluation

    Monash University · Xi’an Jiaotong-Liverpool University · Orygen +1

  57. Titans-as-a-Layer: Test-Time Memory for Conversational Speech Emotion Recognition

    Jun 7, 2026Daniel Chen, Qicong Hu, Yang Xiao +2Memory-Augmented Language ModelsAudio Understanding

    Department of Computer Science, University of Auckland, Auckland, New Zealand · School of Computer and Information Technology, Melbourne, Australia

  58. TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints

    Jun 7, 2026Vinh-Thuan LyAudio ReasoningAudio Understanding

    Zalo AI, Vietnam · University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam

  59. AeroSpectra Sentinel: An Auditable LLM Prompt-Chaining Decision-Support Workflow for Acute Asthma Risk Assessment from Respiratory Sounds and Clinical Signals

    Jun 6, 2026Aueaphum AueawatthanaphisutLLM AuditingClinical Decision Support

    School of Information, Computer, and Communication Technology Sirindhorn International Institute of Technology, Thammasat University Pathum Thani, Thailand

  60. GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models

    Jun 6, 2026Ryner Tan, Wenxuan ZhangAudio-Language Model EvaluationCross-Cultural Language Model Evaluation

    Singapore University of Technology and Design