Large Audio Language Models

Follow this topic Ask about this topic

Recent momentum

-13%

13 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

3 new papers

A weekly snapshot of new work published in Large Audio Language Models.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Large Audio Language Models.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Large Audio Language Models.

135 papers

Latest in Large Audio Language Models

Browse all topics →

Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation
Jun 10, 2026Zhen Ye, Xu Tan, Yiming Li +10Large Audio Language Models Frame Rate
Steering Where to Listen: Instruction-Based Activation Steering Redirects Temporal Attention in Large Audio-Language Models
Jun 9, 2026Tsung-En Lin, Hung-Yi LeeLarge Audio Language Models Activation Steering
RAIL: Rethinking Auditory Intelligence in Large Audio-Language Models with a CHC-Grounded Benchmark
Jun 9, 2026Hongyu Jin, Siyi Wang, Yang Xiao +10Large Audio Language Models Cognitive Science
From Senses to Decisions: The Information Flow of Auditory and Visual Perception in Multimodal LLMs
Jun 8, 2026Wish Suharitdamrong, Muhammad Awais, Xiatian Zhu +1Video Multimodal Large Language Models Large Audio Language Models
Titans-as-a-Layer: Test-Time Memory for Conversational Speech Emotion Recognition
Jun 7, 2026Daniel Chen, Qicong Hu, Yang Xiao +2Large Audio Language Models Emotion Recognition
TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints
Jun 7, 2026Vinh-Thuan LyLarge Audio Language Models Audio Representation
GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models
Jun 6, 2026Ryner Tan, Wenxuan ZhangLarge Audio Language Models Multilingual Benchmark
Phun-Bench: Evaluating LLMs on Phonological Understanding in Chinese
Jun 5, 2026Xing Yue, Yongliang Shen, Weiming LuPhonological Understanding Phonetic Representations
Continuous Audio Thinking for Large Audio Language Models
Jun 5, 2026Gyojin Han, Dong-Jae Lee, Changho Choi +2Large Audio Language Models Audio Representation
Beyond Semantic Dominance: Cognitive Affective Reasoning and Empathetic Response Alignment in Audio Language Models
Jun 5, 2026Zhixian Zhao, Shuiyuan Wang, Wenjie Tian +3Large Audio Language Models Empathy
SpectCount: Spectrotemporal Counting via Synthetic Signals Improves Large Audio Language Models
Jun 5, 2026Seonuk Kim, Yonghyeon Jun, Ju Yeon Kang +3Large Audio Language Models Fine-Grained Spatio-Temporal Information
USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding
Jun 4, 2026Heng-Jui Chang, Alexander H. Liu, Saurabhchand Bhati +4Large Audio Language Models Audio
SpeechJBB: Probing Safety Alignment and Comprehension in Large Audio Language Models under Code-Switched Speech
Jun 4, 2026Virginia Ceccatelli, Yejin Jeon, David Ifeoluwa AdelaniLarge Language Model Jailbreaks Large Audio Language Models
Beyond Text Following: Repairable Arbitration Reversals in Audio-Language Models
Jun 3, 2026Yichen Gao, Yiqun Zhang, Zijing Wang +7Large Audio Language Models Training Language Models
MOSS-Audio Technical Report
Jun 1, 2026Chen Yang, Chufan Yu, Hanfu Chen +27Large Audio Language Models Audio
SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models
May 31, 2026Chenshuang Zhang, Kyeong Seon Kim, Chengxin Liu +1Hallucinations Large Audio Language Models
Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
May 28, 2026Bo-Han Feng, Yu-Hsuan Li Liang, Chien-Feng Liu +2Large Language Model Jailbreaks Large Audio Language Models
MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMs
May 28, 2026Daeyong Kwon, Qiyu Wu, Shinobu Kuriya +6Music Understanding Large Audio Language Models
Mind Your Tone: Does Tone Alter LLM Performance?
May 27, 2026Om Dobariya, Akhil KumarLarge Audio Language Models Multiple-Choice Questions
VoiceGiraffe: A Benchmark for Extreme Long-Context Audio-Language Understanding
May 27, 2026Jashin Ye, Dongxiao Wang, Yixuan Ye +10Large Audio Language Models Efficient Long-Context Inference
Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadox
May 26, 2026Jiacheng Pang, Ashutosh Chaubey, Mohammad SoleymaniParalinguistic Cues Large Audio Language Models
OmniMem: Perturbation-aware Memory Compression for Streaming Audio-Visual LLMs
May 26, 2026Guangzhi Sun, Yixuan Li, Yudong Yang +1Audio-Visual Reasoning Large Audio Language Models
Learning When to Think While Listening in Large Audio-Language Models
May 26, 2026Zhiyuan Song, Weici Zhao, Yang Xiao +3Large Audio Language Models Interaction Trajectories
FSA-GRPO: Teaching Auditory LLMs to Use Few-shot Demonstrations
May 26, 2026Haolong Zheng, Siyin Wang, Xulin Fan +2Large Audio Language Models Few-Shot Learning
Why Can't They Remember? Uncovering Representation and Retrieval Bottlenecks in Multi-Turn Acoustic Memory
May 26, 2026Yang Xiao, Siyi Wang, Han Yin +4Large Audio Language Models Large Language Model Memory
PitchBench: Measuring Pitch Hearing in Audio-Language Models
May 25, 2026Milan Liessens Dujardin, Song-Ze Yu, Craver Corbyn Thomas-Smith +2Large Audio Language Models Pitch
Codec-Robust Attacks on Audio LLMs
May 19, 2026Jaechul Roh, Jean-Philippe Monteuuis, Jonathan Petit +1Neural Audio Codecs Large Audio Language Models
Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation
May 19, 2026Zhifei Xie, Kaiyu Pang, Haobin Zhang +4Large Audio Language Models Acoustic
Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Training
May 18, 2026Yanru Wu, Jianning Wang, Chongxin Gan +1Large Audio Language Models Audio Representation
A Survey of Large Audio Language Models: Generalization, Trustworthiness, and Outlook
May 18, 2026Kaiwen Luo, Zhenhong Zhou, Leo Wang +31Large Audio Language Models Large Language Model Safety
Acoustic Interference: A New Paradigm Weaponizing Acoustic Latent Semantic for Universal Jailbreak against Large Audio Language Models
May 18, 2026Yanyun Wang, Yu Huang, Zi Liang +2Large Audio Language Models Large Language Model Safety
SpeakerLLM: A Speaker-Specialized Audio-LLM for Speaker Understanding and Verification Reasoning
May 14, 2026KiHyun Nam, Jungwoo Heo, Siu Bae +2Speaker Verification Performance Speech Evaluation
Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs
May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Large Audio Language Models
Afrispeech Semantics: Evaluating Audio Semantic Reasoning in Spoken Language Models Across Domains and Accents
May 11, 2026Chibuzor Okocha, Christan GrantLarge Audio Language Models Paralinguistic Cues
Probing Cross-modal Information Hubs in Audio-Visual LLMs
May 11, 2026Jihoo Jung, Chaeyoung Jung, Ji-Hoon Kim +1Large Audio Language Models Cross-Modal Learning
EchoDistill:Alignment Noisy-to-Clean Self-Distillation for Robust Audio LLMs
May 11, 2026Liang Lin, Chunxi Luo, Kaiwen Luo +9Large Audio Language Models Audio
MultiLinguahah : A New Unsupervised Multilingual Acoustic Laughter Segmentation Method
May 7, 2026Sofia Callejas, Nahuel Gomez, Catherine Pelachaud +2Humor Multilingual Automatic Speech Recognition
Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization
May 6, 2026Zheng Fang, Xiaosen Wang, Shenyi Zhang +2Audio Tokens Large Language Model Jailbreaks
VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models
May 6, 2026Yukun Chen, Tianrui Wang, Zhaoxi Mu +2Singing Voice Conversion Large Audio Language Models
Benchmarking LLMs on the Massive Sound Embedding Benchmark (MSEB)
May 6, 2026Cyril Allauzen, Tom Bagby, Georg Heigold +2Large Audio Language Models Audio Latent
Audio-Visual Intelligence in Large Foundation Models
May 5, 2026You Qin, Kai Liu, Shengqiong Wu +12Audio-Visual Reasoning Multimodal Foundation Model
Walking Through Uncertainty: An Empirical Study of Uncertainty Estimation for Audio-Aware Large Language Models
Apr 28, 2026Chun-Yi Kuan, Wei-Ping Huang, Hung-yi LeeLarge Audio Language Models Large Language Model Uncertainty
All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluation
Apr 27, 2026Leonardo Haw-Yang Foo, Chih-Kai Yang, Chen-An Li +2Large Audio Language Models Audio Representation
Exploring Audio Hallucination in Egocentric Video Understanding
Apr 26, 2026Ashish Seth, Xinhao Mei, Changsheng Zhao +9Audio-Visual Reasoning Hallucination Rate
HeadRouter: Dynamic Head-Weight Routing for Task-Adaptive Audio Token Pruning in Large Audio Language Models
Apr 26, 2026Peize He, Yaodi Luo, Xiaoqian Liu +7Audio Tokens Large Audio Language Models
Au-M-ol: A Unified Model for Medical Audio and Language Understanding
Apr 25, 2026Meizhu Liu, Nistha Mitra, Paul Li +3Large Audio Language Models Audio
SpeechParaling-Bench: A Comprehensive Benchmark for Paralinguistic-Aware Speech Generation
Apr 22, 2026Ruohan Liu, Shukang Yin, Tao Wang +6Paralinguistic Cues Large Audio Language Models
HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models
Apr 21, 2026Feiyu Zhao, Yiming Chen, Wenhuan Lu +3Large Audio Language Models Hallucination Detection
UAF: A Unified Audio Front-end LLM for Full-Duplex Speech Interaction
Apr 21, 2026Yadong Li, Guoxin Wu, Haiping Hou +1Full-Duplex Speech Models Large Audio Language Models
Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints
Apr 20, 2026Hao Meng, Siyuan Zheng, Shuran Zhou +2Music Generation Large Language Model Alignment
Putting HUMANS first: Efficient LAM Evaluation with Human Preference Alignment
Apr 20, 2026Woody Haosheng Gan, William Held, Diyi YangLarge Audio Language Models Mean Opinion Scores
VIBE: Voice-Induced open-ended Bias Evaluation for Large Audio-Language Models via Real-World Speech
Apr 19, 2026Yi-Cheng Lin, Yusuke Hirota, Sung-Feng Huang +1Large Language Model Bias Large Audio Language Models
Benign Fine-Tuning Breaks Safety Alignment in Audio LLMs
Apr 17, 2026Jaechul Roh, Amir HoumansadrLarge Audio Language Models Audio Flow
TinyMU: A Compact Audio-Language Model for Music Understanding
Apr 17, 2026Xiquan Li, Aurian Quelennec, Slim EssidLarge Audio Language Models Music Understanding
Listen, Pause, and Reason: Toward Perception-Grounded Hybrid Reasoning for Audio Understanding
Apr 16, 2026Jieyi Wang, Yazhe Niu, Dexuan Xu +1Audio Representation Large Audio Language Models
Geo2Sound: A Scalable Geo-Aligned Framework for Soundscape Generation from Satellite Imagery
Apr 16, 2026Kunlin Wu, Yanning Wang, Haofeng Tan +6Sonification Satellite Imagery
Hijacking Large Audio-Language Models via Context-Agnostic and Imperceptible Auditory Prompt Injection
Apr 16, 2026Meng Chen, Kun Wang, Li Lu +2Large Audio Language Models Hijacking
Temporal Contrastive Decoding: A Training-Free Method for Large Audio-Language Models
Apr 16, 2026Yanda Li, Yuhan Liu, Zirui Song +3Large Audio Language Models Contrastive Decoding
KoALa-Bench: Evaluating Large Audio Language Models on Korean Speech Understanding and Faithfulness
Mar 30, 2026Jinyoung Kim, Hyeongsoo Lim, Eunseo Seo +4Large Audio Language Models Multilingual Benchmark
SocialOmni: Benchmarking Audio-Visual Social Interactivity in Omni Models
Mar 17, 2026Tianyu Xie, Jinfa Huang, Yuexiao Ma +11Omni-Modal Conversational Benchmarks

Jun 10, 2026 · eess.ASJ/K move · Enter open · S save

Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation

Zhen Ye, Xu Tan, Yiming Li, Guangyan Zhang+9

Spoken dialogue models typically start from text LLM backbones, yet reasoning often degrades when conditioning on speech instead of text. We attribute part of this modality gap to a temporal-granularity mismatch: speech tokens are temporally redundant and far longer than text under matched semantics, diluting per-token semantic density and weakening text-native reasoning dynamics. We study speech token design as a representation selection problem and sweep frame rates under a frozen LLM backbone with a fixed information rate. To make low frame rates feasible, we introduce factorized FSQ and a lightweight non-autoregressive audio LM head, scaling capacity to nearly 300,bits/frame without sacrificing efficient prediction. With the bottleneck removed, we sweep frame rates (50

\rightarrow

2.08,Hz) and alignment depth, and observe a consistent best regime for speech QA at 4.17,Hz with intermediate-layer representation alignment.

Large Audio Language Models Frame Rate

Open paper Ask about it PDF

Recent momentum

Neighbouring directions

Recent digests

3 new papers

8 new papers

1 new paper

Latest in Large Audio Language Models