Audio Understanding

Follow this topic Ask about this topic

Momentum

17 papers in the last four weeks, up 325% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 170

All topics

GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models
Jun 6, 2026Ryner Tan, Wenxuan ZhangAudio-Language Model Evaluation Cross-Cultural Language Model Evaluation
Singapore University of Technology and Design
Acoustic Cue Alignment in Audio Language Models for Speech Emotion Recognition
Jun 5, 2026Iosif Tsangko, Andreas Triantafyllopoulos, Björn W. SchullerAudio-Language Model Evaluation Audio Understanding
CHI – Chair of Health Informatics, TUM University Hospital, Munich, Germany · MCML – Munich Center for Machine Learning, Munich, Germany · MDSI – Munich Data Science Institute, Munich, Germany +1
Continuous Audio Thinking for Large Audio Language Models
Jun 5, 2026Gyojin Han, Dong-Jae Lee, Changho Choi +2Audio Reasoning Audio Understanding
KAIST, South Korea
Beyond Semantic Dominance: Cognitive Affective Reasoning and Empathetic Response Alignment in Audio Language Models
Jun 5, 2026Zhixian Zhao, Shuiyuan Wang, Wenjie Tian +3CoT Reasoning Audio Understanding
SpectCount: Spectrotemporal Counting via Synthetic Signals Improves Large Audio Language Models
Jun 5, 2026Seonuk Kim, Yonghyeon Jun, Ju Yeon Kang +3LLM Fine-Tuning Audio Understanding
Department of Electrical and Computer Engineering and INMC, Seoul National University, Seoul, South Korea
SEAM: Shortcut-Aware Real-Time Detection of Scripted vs. Spontaneous Speech for Interview Guardrails
Jun 5, 2026Vsevolod, Kovalev, Pranay ManochaAudio Understanding Shortcut Learning
V. · Symbal AI, USA · Princeton University
FIGMA: Towards FIne-Grained Music retrievAl
Jun 4, 2026Nishit Anand, Ashish Seth, Sreyan Ghosh +2Audio Understanding Audio-Text Retrieval
University of Maryland, College Park, USA
USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding
Jun 4, 2026Heng-Jui Chang, Alexander H. Liu, Saurabhchand Bhati +4Audio Representation Learning Audio Understanding
MIT CSAIL, USA · Amazon, USA
F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation
Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio Representation Learning Autoencoders
2WeNet Open Source Community · ∗Equal contribution · 1Nanjing University, China
ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruity
Jun 4, 2026Prathamjyot Singh, Ashima Sood, Sahil Sharma +1Audio Understanding Speech Prosody
Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, India · School of Computing, Engineering and Intelligent Systems, Ulster University, Londonderry, United Kingdom · School of Computing, Ulster University, Belfast, United Kingdom
Beyond Text Following: Repairable Arbitration Reversals in Audio-Language Models
Jun 3, 2026Yichen Gao, Yiqun Zhang, Zijing Wang +7Audio-Language Model Evaluation Audio Understanding
Northeastern University, China · Shanghai Artificial Intelligence Laboratory, China
Audio Interaction Model
Jun 3, 2026Zhifei Xie, Zihang Liu, Ze An +8Audio Understanding Audio-Language Models
1NTU · 2NUS · 3CUHK
Drift-Augmented Scoring: Text-Derived Noise Robustness for Zero-Shot Audio-Language Classification
Jun 3, 2026Tu Vo, Sheir Zaheer, Chan Y. ParkFew-Shot Audio Classification Audio Understanding
KC Machine Learning Lab
SpeakerCard-1M: An Evidence-Grounded Corpus for In-the-Wild Speaker Verification
Jun 2, 2026Junyi Peng, Oldřich Plchot, Xiao Song +9Audio-Language Model Evaluation Speaker Verification
Brno University of Technology, Czechia · Peking University, China · Xiaomi, China +3
AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs
Jun 1, 2026Yaoting Wang, Ziyi Zhang, Wenming Tu +10Audio-Visual Understanding Multimodal Robustness
Institute of Big Data, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · Huazhong University of Science and Technology · Shanghai Jiaotong University +5
EntangleCodec: A Unified Discrete Audio Tokenizer via Semantic-Acoustic Entanglement
Jun 1, 2026Hui Li, Yangfan Gao, Junlin Shang +4Audio Representation Learning Neural Audio Codecs
Fudan University
Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space
Jun 1, 2026Louis MouchonAudio Representation Learning Joint-Embedding Predictive Architecture
Independent Research
MOSS-Audio Technical Report
Jun 1, 2026Chen Yang, Chufan Yu, Hanfu Chen +27Audio Understanding Audio-Language Models
Context-aware child-directed speech detection from long-form recordings
May 31, 2026Théo Charlot, Tarek Kunze, Kaveri K. Sheth +2Speech Processing Audio Understanding
LSCP, DEC, ENS, EHESS, CNRS, PSL University, France · Laboratoire d’Informatique et Syst`emes, Universit´e Aix-Marseille, CNRS, France
PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects
May 31, 2026Sicheng Yang, Shulan Ruan, Shiwei Wu +4Audio-Language Model Evaluation Audio Understanding
Shenzhen International Graduate School, Tsinghua University Shenzhen, China · Department of Electronic Engineering, Tsinghua University Beijing, China · JD AI Research Beijing, China
UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception
May 29, 2026Yuhan Song, Linhao Zhang, Aiwei Liu +6Audio Representation Learning Audio Understanding
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Basic Model Technology Center, WeChat AI, Tencent Inc.
HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding
May 28, 2026Bohan Li, Shi Lian, Hankun Wang +6Audio Representation Learning Speech Foundation Models
X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China · hi lab, Xiaohongshu Inc, China
COMET: Concept Space Dissection of the Modality Gap in Audio-Text Multimodal Contrastive Embeddings
May 28, 2026Yonggang Zhu, Liting Gao, Aidong Men +1Audio Understanding Audio-Language Models
School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China · Centre for Vision, Speech, and Signal Processing (CVSSP), University of Surrey, GU2 7XH Guildford, U.K.
MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMs
May 28, 2026Daeyong Kwon, Qiyu Wu, Shinobu Kuriya +6Audio-Language Model Evaluation Audio Understanding
1Seoul National University · 2Sony Group Corporation · 3Sony AI
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
May 28, 2026Tiantian Feng, Anfeng Xu, Xuan Shi +10Audio-Language Model Evaluation Speech Quality Assessment
University of Southern California · The Ohio State University · University of California, Los Angeles +3
Audio-Mind: An Auditable Agentic Framework for Audio Understanding
May 27, 2026Yucheng Wang, Jing Peng, Hanqi Li +6Audio QA Audio Reasoning
School of Intelligence Science and Technology, Nanjing University, China · X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University, China · School of Automation Science and Engineering, Xi’an Jiaotong University, China +1
KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs
May 27, 2026Haechan Kim, Seungjun Chung, Inkyu Park +2Audio-Language Model Evaluation Question Answering
1KRAFTON · Department of Mathematical Sciences, Seoul National University
VoiceGiraffe: A Benchmark for Extreme Long-Context Audio-Language Understanding
May 27, 2026Jashin Ye, Dongxiao Wang, Yixuan Ye +10Audio-Language Model Evaluation Audio Understanding
Future Living Lab, Alibaba
LoSATok: Low-dimensional Semantic-Acoustic Tokenizer for Cross-Domain Audio Understanding and Generation
May 27, 2026Zhisheng Zhang, Xiang Li, Yixuan Zhou +3Audio Token Compression Audio Representation Learning
1Shenzhen International Graduate School, Tsinghua University, China · *Work conducted while interning at ModelBest. · 2ModelBest Inc., China
Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadox
May 26, 2026Jiacheng Pang, Ashutosh Chaubey, Mohammad SoleymaniAudio-Language Model Evaluation Speech Processing
Institute for Creative Technologies, University of Southern California, Los Angeles, USA

Jun 6, 2026, cs.CLJ/K move · Enter open · S save

GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models

Ryner Tan, Wenxuan Zhang

Singapore University of Technology and Design

Audio-Language Model Evaluation Cross-Cultural Language Model Evaluation Audio Understanding

Open paper AskPDF arXiv

Large Audio-Language Models (LALMs) integrate audio perception and language understanding within a unified framework, enabling a wide range of real-world applications. Despite recent advances, evaluation for LALMs remains heavily underspecified relative to real-world requirements: most lack true linguistic and cultural authenticity, while others fail to capture acoustic realism. To bridge this gap, we propose GlobeAudio, a multilingual and multicultural benchmark designed to evaluate naturalistic audio understanding. GlobeAudio consists of 5,637 multiple-choice questions across six typologically diverse languages, expertly crafted by native speakers grounded on naturally occurring audio. In order to do well, models must possess higher-level auditory reasoning skills and culturally grounded interpretation. We systematically evaluate representative closed-source and open-source LALMs, as well as cascaded ASR-LLM pipelines. Our experiments reveal substantial performance gaps under natural acoustic conditions, particularly for open-source models and low-resource languages. These findings highlight critical limitations of current LALMs and underscore the importance of naturalistic audio evaluation for future audio-language systems. GlobeAudio can be found at https://huggingface.co/datasets/iNLP-Lab/GlobeAudio .

Momentum

Related topics

Latest papers 170