Audio-Language Models

Follow this topic Ask about this topic

Momentum

36 papers in the last four weeks, up 414% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 184

All topics

STEMMA: Song-to-Stem Multi-Audio Reasoning for Large Audio Language Models
Oct 8, 2026Hoyeol Sohn, Wonil Kim, Keunhyoung Kim +7Audio Reasoning Audio-Language Models
Graduate School of Culture Technology, KAIST, Daejeon, Republic of Korea · Neutune, Seoul, Republic of Korea
Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models
Oct 8, 2026Yulin Sun, Kele Xu, Yong DouAudio-Language Models Multimodal Reasoning
College of Computer Science and Technology, National University of Defense Technology · State Key Laboratory of Complex & Critical Software Environment
MiDashengLM-Spatial: Unifying General Audio Understanding and Spatial Awareness
Oct 8, 2026Jinbo Hu, Hang Su, Lichun Fan +10Audio-Language Models Audio Understanding
Xiaomi Inc., China
Listen-to-Reason: Listen with Experts, Retrieve over a Graph, Reason with LLMs
Oct 7, 2026Pooneh Mousavi, Mirco Ravanelli, Cem SubakanAudio-Language Models Audio Reasoning
Concordia University · Mila – Quebec AI Institute · Laval University
BEANS-Next and ROOTS: Broadening Audio-Language Capabilities for Bioacoustics
Oct 7, 2026Christos Plachouras, David Robinson, Marius Miron +17Bioacoustics Audio-Language Models
Earth Species Project · Queen Mary University of London
A Study on Improving Multi-class Audio Source Separation Via Decoupled CLAP Query Optimization and an Automated Data Engine
Oct 7, 2026Amirhossein Hajavi, Hanhee Lee, Pushya Jain +4Audio Source Separation Prompt Optimization
Noah’s Ark Lab, Huawei Technologies Canada co.
SkillFormer: Skill-Decomposed Adaptation for Audio Language Models
Oct 6, 2026Lee Seung-woo, Bowen Qi, Kim Min-jun +1Multi-Task Learning Audio Understanding
Pusan National University · Shanghai Jiao Tong University · Hanyang University
SEA-LM: Egocentric Spatial Audio Understanding for Wearable Microphone Arrays
Oct 4, 2026Sonal Kumar, Sinan Hersek, Artem Dementyev +6Direction-of-Arrival Estimation Audio-Language Models
University of Maryland, College Park · Google · Google DeepMind
AudioJev: Direct Audio Decisions with Order-Calibrated Probabilities
Oct 1, 2026Sihan Lv, Zhen Li, Zhiqi Cao +4Audio QA Audio Reasoning
Zhejiang University, Hangzhou, China · China Academy of Space Technology, Beijing, China · Innovation and Management Center of the School of Software (Ningbo), Zhejiang University, Ningbo, China +2
AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models
Sep 30, 2026Pooneh Mousavi, Amir Ivry, Mirco Ravanelli +1Audio-Language Models Prompt Tuning
Concordia University · Mila – Quebec AI Institute · Technion – IIT +1
SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Models
Sep 30, 2026Rong Wan, Suliu Qin, Jiaxi Li +5Audio-Language Model Evaluation Audio Deepfake Detection
University of Surrey · Singapore University of Technology and Design · Guangxi University +1
SE-ADD: Self-Evolving Audio Deepfake Detection with Mistake-Driven Supervision
Sep 30, 2026Rong Wan, Wei Xie, Jiaxi Li +4Audio Deepfake Detection Self-Training for Language Models
University of Surrey · Guangxi University · Shenzhen University of Advanced Technology +1
Audio Token Attention Is Predictable Before the Language Model Runs
Sep 30, 2026Kyoungjun Park, Yunzhe Li, Lili QiuAudio Token Compression Audio Understanding
The University of Texas at Austin
AS $^2$ D: Accelerating On-Demand Audio Understanding on Mobile Devices
Sep 29, 2026Yunzhe Li, Kyoungjun Park, Hongzi Zhu +1On-Device Language Model Inference Language Model Decoding
The University of Texas at Austin · Shanghai Jiao Tong University
When Capabilities Fail to Compose: Diagnosing the Compositionality Gap in Large Audio-Language Models
Sep 29, 2026Chien-Feng Liu, Chih-Kai Yang, Bo-Han Feng +3Audio-Language Model Evaluation Audio QA
National Taiwan University · ASUS Open Cloud Infrastructure Software Center · NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)
Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Models
Sep 29, 2026Zhenhong Zhou, Xuanyue Zhao, Youji Liu +4Audio-Language Models Speech Enhancement
Nanyang Technological University · Beijing University of Posts and Telecommunications
HEAR: Real Voices, Real Bias: A Large-Scale Human-Recorded, Demographically Diverse Benchmark for Audio Language Models
Sep 28, 2026Shen Yan, Duc Le, Irina-Elena VelicheAudio-Language Model Evaluation Audio-Language Models
Meta Superintelligence Labs
Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions
Sep 28, 2026Michel Olvera, Paraskevas Stamatiadis, Changhong Wang +1Audio-Language Model Evaluation Audio Reasoning
S2A, LTCI, IDS · S2A, IDS
On Temporal Binding in Large Audio Language Models
Sep 28, 2026Paul Primus, Gerhard WidmerLLM Interpretability Audio Reasoning
Institute of Computational Perception, Johannes Kepler University Linz, Austria · LIT Artificial Intelligence Lab, Johannes Kepler University Linz, Austria
SAIL: Spatial Audio Intelligence with Large Language Models via Disentangled Acoustic-Spatial Encoding and Dual-Stream Q-Former
Sep 28, 2026Zhengding Luo, Jinyang Wu, Haozhe Ma +3Audio Reasoning Direction-of-Arrival Estimation
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · Singapore Management University · Tencent Hy Frontier Lab, Singapore +2
MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Models
Sep 27, 2026Zhi Wen Soi, Giulio Segalini, Jian-Jia Chen +1Audio-Language Model Evaluation Audio-Language Model Hallucination Detection
University of Neuchâtel · TU Dortmund University · RWTH Aachen University +1
When Does the Concept of "Dog" Emerge in an Audio LLM?
Sep 27, 2026Zhe Wang, Shiqi Liu, Ruiyun Zhong +2Audio Understanding Audio-Language Models
Huazhong University of Science and Technology, Wuhan, China
Audio LLMs Know When They Can't Hear You
Sep 24, 2026Amirhosein Javadi, Richa Dixit, Mehrdad Farajtabar +3Audio-Language Model Evaluation Language Model Self-Assessment
Apple · University of California San Diego
Do Audio Language Models Hear and Read Distinctive Features Alike?
Sep 24, 2026Yuanhao Chen, Peter ChinAudio-Language Models Self-Supervised Speech Representation Learning
Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
STAM-ASR: Speaker-Temporal Anchoring with Memory for Multi-Speaker ASR
Sep 24, 2026Victor Tolulope Olufemi, Syeda Faiza Ahmed Sara, Shammur Absar ChowdhuryAudio-Language Models Automatic Speech Recognition
Qatar Computing Research Institute (QCRI), Doha, Qatar
AEGIS: Audio Endogenous Guarding via Internal Signals Against Large Audio-Language Model Jailbreaks
Sep 24, 2026Yu-Ling Liao, Tzu-Chin Chiu, Zong-You Chen +2Audio-Language Models Jailbreak Defense
National Taiwan University
Broadening Uncertainty Estimation for Audio Question Answering Across Methods, Formats, and Inputs
Sep 24, 2026Aaron Isidore Grace, Weiran WangAudio-Language Model Evaluation Audio QA
David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON, Canada · Department of Computer Science, University of Iowa, Iowa City, IA, USA
Reward-Tilted On-Policy Distillation for Acoustic Grounding in Audio-Language Models
Sep 23, 2026Kaiyang Li, Shaobo Han, Yue Tian +1Audio-Language Models Language Model Distillation
NEC Laboratories America, Inc., USA · School of Computing, University of Connecticut, USA
Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?
Sep 23, 2026Avishai Weizman, Yehuda Ben-Shimol, Itshak LapidotAudio-Language Model Evaluation Audio Deepfake Detection
School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Israel · Department of Electrical Engineering, Afeka the Academic College of Engineering, Israel · Avignon University, LIA, France
Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding
Sep 23, 2026Kaiyang Li, Shaobo Han, Yue Tian +1Audio QA Audio-Language Models
NEC Laboratories America, Inc, USA · School of Computing, University of Connecticut, USA

Oct 8, 2026, cs.SDJ/K move · Enter open · S save

STEMMA: Song-to-Stem Multi-Audio Reasoning for Large Audio Language Models

Hoyeol Sohn, Wonil Kim, Keunhyoung Kim, Sangeun Kum+6

Graduate School of Culture Technology, KAIST, Daejeon, Republic of Korea · Neutune, Seoul, Republic of Korea

Audio Reasoning Audio-Language Models Audio-Language Model Evaluation Music Information Retrieval

Open paper AskPDF arXiv

Music understanding often requires comparing excerpts and reasoning about relationships among songs, sections, and stems. However, existing large audio-language models (LALMs) and music question-answering datasets typically operate on single recordings or compare independently sampled tracks with no known production relationship. We introduce STEMMA, a multi-audio music question-answering framework built around production provenance: whether excerpts originate from the same track or section, and which stems belong to which mixtures. Because such relations are sparse under conventional audio-first sampling, STEMMA adopts a relation-first construction strategy: it first specifies a target relation and then queries the catalog for excerpts that satisfy it and hard negatives that do not. Labels are determined directly from catalog provenance rather than generated by a language model from metadata. We build STEMMA-Bench for evaluation and a track-disjoint training set, STEMMA-Instruct. Fine-tuning two LALMs on STEMMA-Instruct improves multi-audio reasoning, with the largest gains on structural relations directly determined by the catalog, while preserving single-audio music understanding.

Momentum

Related topics

Latest papers 184