Large Audio Language Models

Follow this topic Ask about this topic

Momentum

29 papers in the last four weeks, up 263% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 150

All topics

AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models
Sep 30, 2026Pooneh Mousavi, Amir Ivry, Mirco Ravanelli +1Large Audio Language Models Hallucination Mitigation
Concordia University · Mila – Quebec AI Institute · Technion – IIT +1
UniAE-MoE: A Unified Audio Encoder via Mixture of Experts
Sep 30, 2026Shengbo Cai, Zhisheng Zhang, Zichao Nie +3Large Audio Language Models Opencode
Tsinghua University, China
Audio Token Attention Is Predictable Before the Language Model Runs
Sep 30, 2026Kyoungjun Park, Yunzhe Li, Lili QiuLarge Audio Language Models Audio Understanding
The University of Texas at Austin
Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Models
Sep 29, 2026Yu Zhang, Pingrui Zhang, Xuefeng Bai +3Large Language Model Hallucination Multimodal Large Language Models
Harbin Institute of Technology, Shenzhen, China
When Capabilities Fail to Compose: Diagnosing the Compositionality Gap in Large Audio-Language Models
Sep 29, 2026Chien-Feng Liu, Chih-Kai Yang, Bo-Han Feng +3Large Audio Language Models Large Language Models Fail
National Taiwan University · ASUS Open Cloud Infrastructure Software Center · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)
Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Models
Sep 29, 2026Zhenhong Zhou, Xuanyue Zhao, Youji Liu +4Large Audio Language Models Speech Enhancement
Nanyang Technological University · Beijing University of Posts and Telecommunications
HEAR: Real Voices, Real Bias: A Large-Scale Human-Recorded, Demographically Diverse Benchmark for Audio Language Models
Sep 28, 2026Shen Yan, Duc Le, Irina-Elena VelicheLarge Audio Language Models Seed-Tts-Eval Benchmark
Meta Superintelligence Labs
Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions
Sep 28, 2026Michel Olvera, Paraskevas Stamatiadis, Changhong Wang +1Large Audio Language Models Fine-Grained Actions
S2A, LTCI, IDS · S2A, IDS
On Temporal Binding in Large Audio Language Models
Sep 28, 2026Paul Primus, Gerhard WidmerLarge Audio Language Models Mechanistic Interpretability
Institute of Computational Perception, Johannes Kepler University Linz, Austria · LIT Artificial Intelligence Lab, Johannes Kepler University Linz, Austria
SpeechCritic: Learning a Diagnostic Speech Judge from Limited Human Preferences
Sep 28, 2026Mingyue Huo, Shivam Mehta, Bhavin Jawade +2Large Audio Language Models Critic
University of Illinois Urbana-Champaign · Netflix
Uncovering Ordinal-Matching Bias in Audio-Visual LLMs
Sep 28, 2026Jihoo Jung, Youngjoon Jang, Hyebin Cho +2Audio-Visual Reasoning Large Audio Language Models
Korea Advanced Institute of Science and Technology, South Korea · University of Oxford, United Kingdom
MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Models
Sep 27, 2026Zhi Wen Soi, Giulio Segalini, Jian-Jia Chen +1Large Audio Language Models Large Language Model Hallucination
University of Neuchâtel · TU Dortmund University · RWTH Aachen University +1
When Does the Concept of "Dog" Emerge in an Audio LLM?
Sep 27, 2026Zhe Wang, Shiqi Liu, Ruiyun Zhong +2Large Audio Language Models Audio Understanding
Huazhong University of Science and Technology, Wuhan, China
Audio LLMs Know When They Can't Hear You
Sep 24, 2026Amirhosein Javadi, Richa Dixit, Mehrdad Farajtabar +3Large Audio Language Models Transcription
Apple · University of California San Diego
To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speech
Sep 24, 2026Debajyoti Mazumder, Mamta, Abhirama Subramanyam PenamakuriFact-Checking Misinformation
IISER Bhopal · King’s College London · MBZUAI
Reward-Tilted On-Policy Distillation for Acoustic Grounding in Audio-Language Models
Sep 23, 2026Kaiyang Li, Shaobo Han, Yue Tian +1Large Audio Language Models
NEC Laboratories America, Inc., USA · School of Computing, University of Connecticut, USA
Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?
Sep 23, 2026Avishai Weizman, Yehuda Ben-Shimol, Itshak LapidotSpoofing Self-Supervised Speech Models
School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Israel · Department of Electrical Engineering, Afeka the Academic College of Engineering, Israel · Avignon University, LIA, France
Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding
Sep 23, 2026Kaiyang Li, Shaobo Han, Yue Tian +1Large Audio Language Models Opencode
NEC Laboratories America, Inc, USA · School of Computing, University of Connecticut, USA
REVE: Efficient Hallucination Correction for Large Audio-Language Models via Reused Encoder States
Sep 22, 2026Hongjin Song, Jiasheng Kuang, Xinyu Yang +4Sound Event Detection Large Audio Language Models
Beijing Institute of Technology, Zhuhai, Guangdong, China
Listen, Critique, and Refine: RL-Based Self-Refinement for Instruction-Following Speech Synthesis
Sep 21, 2026Chee-En Yu, Yi-Cheng Lin, Sung-Feng Huang +4Speech Synthesis Large Audio Language Models
Graduate Institute of Electrical Engineering, National Taiwan University, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · NVIDIA Research 4 Artificial Intelligence Center of Research Excellence, National Taiwan University, Taiwan
Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
Sep 20, 2026Jiaheng Dong, Xiaofeng Yu, Jean Honorio +3Large Audio Language Models Reasoning Skills
The University of Melbourne, Australia · University of Auckland, New Zealand · ARC OPTIMA, Australia +1
Discrete vs. Continuous: A Comprehensive Study of Unified Audio Understanding in LALMs
Sep 19, 2026Jing Peng, Zichao Nie, Zhisheng Zhang +2Large Audio Language Models Audio Understanding
Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models
Sep 16, 2026Pei-Jun Liao, Hung-Shin Lee, Wenze Ren +3Large Audio Language Models Encoders
Inst. of Information Science, Academia Sinica, Taiwan · Grad. Inst. of Electrical Engineering, National Taiwan University, Taiwan · Grad. Inst. of AI Interdisciplinary Applied Technology, National Taiwan Normal University, Taiwan +3
Augmenting Large Audio-Language Models with Frame-Level Grounding for Fine-Grained Temporal Perception
Sep 14, 2026Yanfeng Shi, Yan Song, Junhui Li +4Large Audio Language Models Perception
National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei, China · ICT Cluster, Singapore Institute of Technology, Singapore
ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models
Sep 14, 2026Hongyu Jin, Wenda Zhang, Runqiu Fei +3Empathy Emotional Regulation
What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainability
Sep 14, 2026Lucia Cascone, Valeria Fraenza, Michele Nappi +2Large Audio Language Models Mllm-Based
Department of Computer Science, University of Salerno, Italy
NVV-Locator: From Transcript Tags to Acoustic Boundaries for Fine-Grained Nonverbal Vocalization Grounding
Sep 9, 2026Yuang Cao, Bingshen Mu, Zhennan Lin +7Transcript Acoustic
School of Intelligence Science and Technology, Nanjing University, China · State Key Laboratory of Novel Software Technology, Nanjing University, China
Beyond Accuracy: ARIA-Rubrics for Evaluating Audio Reasoning in Large Audio Language Models
Sep 9, 2026Yupei Li, Qiyang Sun, Mohamed Mady +4Audio Understanding Large Audio Language Models
Imperial College London, UK · Technische Universität München München, Germany · Mohamed bin Zayed University of Artificial Intelligence Abu Dhabi, AE +2
TAD: Token-Adaptive Contrastive Decoding with Confidence-Guided Gating for Hallucination Mitigation in Large Audio-Language Models
Sep 7, 2026Heyu Chang, Nianwen Si, Hao Zhang +2Large Audio Language Models Contrastive Decoding
Information Engineering University, China
Heard but Not Heeded: Paralinguistic Information Encoding and Loss in Audio-Language Models
Sep 1, 2026Bhuvan Koduru, Dareen Safar B Alharthi, Rita Singh +1Paralinguistic Cues Large Audio Language Models
Language Technologies Institute Carnegie Mellon University
TEMPO: Temporally-grounded Multi-task Post-training for Large Audio-Language Models
Aug 30, 2026Apoorva Kulkarni, Kaousheik Jayakumar, Sreyan Ghosh +3Large Audio Language Models Neural Audio
University of Maryland, College Park, USA · CNH Industrial India
Auditing generative audio calls for known-task audio-llm evaluation
Aug 28, 2026Mengzhe GengModern Generative Audio Models Large Audio Language Models
National Research Council Canada
Compositional Failure in Audio-Visual LLMs: Late-Layer Prior Dominance Under Cross-modal Conflict
Aug 27, 2026Adarsh Sudheer, David Li, Omar Elbanna +3Cross-Modal Conflicts Large Audio Language Models
Independent Researcher.
LongAudioSpan: Spanning the Duration and Depth of Audio Comprehension
Aug 26, 2026Wen Huang, Yunfei Chu, Meng Gao +2Audio Understanding Large Audio Language Models
Qwen Team, Alibaba Group · Tsinghua University · The Chinese University of Hong Kong
MRMAD: A Multi-Round Multi-Audio Benchmark for Evaluating Acoustic Degradation Perception in Large Audio-Language Models
Aug 23, 2026Yize Li, Ningyuan Yang, Sile Yin +6Large Audio Language Models Audio Understanding
Northeastern University · Stony Brook University · Bose Corporation
Beyond Naturalness: Probing Automated Text-To-Speech Evaluators on Linguistically Grounded Dimensions
Aug 10, 2026Oluwanifemi Bamgbose, Simon Rosen, Jash Shah +6Seed-Tts-Eval Benchmark Text-To-Speech Synthesis
ServiceNow
From Inaudible Inputs to Model Failures: Low-Frequency Safety Risks in LALMs
Aug 10, 2026Yuanhe Zhang, Weiliu Wang, Jie Ren +7Large Audio Language Models Audio Understanding
Beijing University of Posts and Telecommunications · Institute of Information Engineering, Chinese Academy of Sciences · Nanyang Technological University +3
Multilingual Emotion Neurons in Large Audio-Language Models
Aug 9, 2026Xiutian Zhao, Philipp Koehn, Björn Schuller +1Cross-Lingual Consistency Large Audio Language Models
Center for Language and Speech Processing (CLSP), Johns Hopkins University, USA · Group on Language, Audio & Music (GLAM), Imperial College London, UK
Do Audio Language Models Use Paralinguistic Evidence? Counterfactual Audits for Response Evaluation
Aug 7, 2026Kevin Miller, Arjun Chandra, Venkatesh SaligramaParalinguistic Cues Large Audio Language Models
Boston University
Spoken Function Calling: A New Perspective on Spoken Language Understanding for Large Audio Language Models
Aug 5, 2026Yuezhang Peng, Yuxin Liu, Changfeng Gao +4Speech Language Models Large Audio Language Models
Shanghai Jiao Tong University Shanghai, China · Token Foundry, Alibaba Group Hangzhou, China · Shanghai Jiao Tong University, Shanghai Innovation Institute Shanghai, China
HyPASE: Hyperbolic Geometry for Parameter-Efficient Speech Emotion Fine-Tuning Framework for Large Audio-Language Models
Aug 5, 2026Tian Jin, Ruikang Zhang, Zefeng Zhao +2Large Audio Language Models Emotion Recognition
Tongji University Shanghai, China · Peking University Beijing, China · The Chinese University of Hong Kong, Shenzhen Shenzhen, China
Learning Music Style for Piano Arrangement Through Cross-Modal Bootstrapping
Aug 4, 2026Jingwei Zhao, Gus Xia, Ziyu Wang +1Symbolic Music Generation Instrument
1Songscription · School of Computing, National University of Singapore · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) +1
Hear, Invoke, and Understand: A Skill-Calling Multimodal Agent for Large Audio Language Models
Aug 3, 2026Yuwen Wang, Tian-Hao Zhang, Minghao Cai +7Audio Understanding Voice Agents
University of Science and Technology Beijing, China · Li Auto Inc., Beijing, China
MMAC: A Massive Multi-dimensional Benchmark for Audio Captioning
Jul 29, 2026Weijie Wu, Junbo Li, Lin Li +2Large Audio Language Models Audio Understanding
School of Informatics, Xiamen University, China · DiDi Global Inc., Beijing, China · School of Electronic Science and Engineering, Xiamen University, China
ThinkOmni: A Reasoning-Driven Omni-Modal LLM Framework for Audio Forgery Detection and Localization
Jul 29, 2026Yuxiong Xu, Kaiqing Lin, Bin Li +2Large Audio Language Models Localization
Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen Key Laboratory of Media Security, Shenzhen University · Afirstsoft Technology Group Co., Ltd.
Prosody-driven Jailbreaks in Audio LLMs: A Controlled Study and Mechanistic Analysis
Jul 29, 2026Jiachen Qian, Junyu LiText-To-Audio Large Audio Language Models
City University of Hong Kong · City University of Hong Kong (Dongguan)
LLM4OSC: Profile-Bound Natural Language Control with Deterministic Validation for Open Sound Control
Jul 28, 2026Yuan-Yi FanLarge Audio Language Models Large Language Models(Llms
Los Angeles
From Semantics to Readout: Mechanistic Understanding of Audio Tokens after Fine-Tuning for Temporal Audio Grounding
Jul 28, 2026Yujian Ma, Jinqiu Sang, Ruizhe Li +2Large Audio Language Models Audio Tokenizers
1Shanghai Institute of Artificial Intelligence for Education, East China Normal University, China · School of Computer Science and Technology, East China Normal University, China · School of Computer Science, University of Birmingham, UK +1
X $^3$ -OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
Jul 23, 2026Dongjie Fu, Di Cao, Xize Cheng +6Large Audio Language Models Reasoning Skills
1Tencent Hunyuan · 2Zhejiang University
ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions
Jul 20, 2026Fernando López, Ana Ayala, Guillermo Segovia +4Automatic Speech Recognition Evaluation Large Audio Language Models
Telefónica Innovación Digital · Universidad Autónoma de Madrid · Universidad Complutense de Madrid
Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
Jul 17, 2026Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19Audio-Visual Reasoning Large Audio Language Models
1NVIDIA, USA · University of Maryland, USA
Large Audio Language Models for Spoofing-Aware Speaker Verification
Jul 16, 2026Sofya Savelyeva, Mariia Perunova, Evgeny Kushnir +3Automatic Speaker Verification Large Audio Language Models
Applied AI Institute · MIRAI · AXXX, HSE +3
Auditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech Evaluation
Jul 15, 2026Joonyong Park, David M. Chan, Yuki Saito +1Large Audio Language Models Large Language Model Judges
Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan · Berkeley AI Research (BAIR), University of California, Berkeley, CA, USA
Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models
Jul 15, 2026Chun-Yi Kuan, Siwon Kim, Byeonggeun Kim +7Large Audio Language Models Instruction
National Taiwan University, Taiwan · Amazon, USA
Encoder-Side Neuron Identification and Amplification for Acoustic Perception in Large Audio-Language Models
Jul 13, 2026Yu-Han Huang, Chih-Kai Yang, Ke-Han Lu +2Large Audio Language Models Speaker
National Taiwan University, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE), Taiwan
GigaChat Audio: Time-aware Large Audio Language Model
Jul 11, 2026Aleksandr Kutsakov, Mariia Sadovina, Georgii Gospodinov +4Large Audio Language Models Text-To-Audio
SaluteDevices, Russia
Dual-BEATs: Unlocking Zero-Shot Stereo Audio Perception in Audio Large Language Models via Dithering
Jul 9, 2026Shuo-Chun Lin, Hen-Hsen HuangSpatial Audio Large Audio Language Models
Institute of Information Science, Academia Sinica, Taiwan
Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Grounding
Jul 5, 2026Zihan Zhang, Xize Cheng, Wenhao Yan +5Sound Event Detection Large Audio Language Models
Zhejiang University · Tsinghua University
OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models
Jul 3, 2026Shijie Cao, Qingyu Zhang, Boxi Yu +6Token Compression Audio-Visual Reasoning
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Limerick +1
Adaptive Perturbation Selection for Contrastive Audio Decoding
Jun 30, 2026Aaron Isidore Grace, Zhouyuan Huo, Weiran WangContrastive Decoding Large Audio Language Models
Department of Computer Science University of Iowa Iowa City, IA, USA · Google Mountain View, CA, USA

Sep 30, 2026, cs.SDJ/K move · Enter open · S save

AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models

Pooneh Mousavi, Amir Ivry, Mirco Ravanelli, Cem Subakan

Concordia University · Mila – Quebec AI Institute · Technion – IIT+1

Large Audio Language Models Hallucination Mitigation

Open paper AskPDF arXiv

Large audio-language models (LALMs) are sensitive to input perturbations, such as noise, waveform corruption, and adversarial injections. We propose AnchorPrompt, an efficient adaptation method that keeps the model frozen and learns a single block of prompt vectors inserted at the decoder input, between the audio and question embeddings. We train these vectors through self-distillation over diverse audio and text perturbations. To improve answer consistency and mitigate hallucination, we use the model's prediction on the clean recording as the target for answerable inputs, and assign a refusal target when the audio lacks sufficient evidence to answer. Furthermore, AnchorPrompt is perturbation-agnostic at inference, requiring no prior detection of perturbations and enabling zero-shot transfer to unseen distortions. We evaluate three LALMs across three benchmarks and show that AnchorPrompt improves answer consistency in most tested conditions. Clean accuracy improves in six of nine model-benchmark pairs, with minimal impact on the remainder of 1.2% at most. Crucially, AnchorPrompt reduces hallucinations under severe audio corruption while keeping false refusals on clean audio rare. Finally, these consistency gains transfer to unseen perturbations, such as choice permutations and reverberation.

Momentum

Related topics

Latest papers 150