Spatial Audio

Follow this topic Ask about this topic

Momentum

15 papers in the last four weeks, up 275% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 54

All topics

MiDashengLM-Spatial: Unifying General Audio Understanding and Spatial Awareness
Oct 8, 2026Jinbo Hu, Hang Su, Lichun Fan +10Audio-Language Models Audio Understanding
Xiaomi Inc., China
WorldSonus: Bringing Sound to Worlds
Oct 6, 2026Pengjun Fang, Jingyi Fa, Kam Man Wu +9Audio-Video Generation Audio Diffusion Models
The Hong Kong University of Science and Technology · Noiz AI · MetaX +1
SEA-LM: Egocentric Spatial Audio Understanding for Wearable Microphone Arrays
Oct 4, 2026Sonal Kumar, Sinan Hersek, Artem Dementyev +6Direction-of-Arrival Estimation Audio-Language Models
University of Maryland, College Park · Google · Google DeepMind
RMS-AQA: A Two-Stage Spatial Audio Question Answering Benchmark for Real-World Domestic Environments
Oct 1, 2026Peihao Chen, Qing Wang, Lichun Fan +12Audio-Language Model Evaluation Audio QA
University of Science and Technology of China, China · Xiaomi Corporation, China · DataoceanAI, China +2
PLACE: Positional Latent Adaptation via Conditioned Embeddings for Binaural Audio Generation
Sep 30, 2026Tiernon Riesenmy, You Zhang, Gautam Bhattacharya +1Text-to-Audio Generation Audio-Video Generation
The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, USA · Advanced Technology Group, Dolby Laboratories, San Francisco, CA, USA
Hear the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation
Sep 30, 2026Hanmo Chen, Chengcheng Liu, Tianxiao Chen +7Audio-Video Generation Audio-Visual Alignment
Xidian University · vivo BlueImage Lab, vivo Mobile Communication Co., Ltd.
Audible World Models: Spatially Aware Sound Generation for 3D Worlds
Sep 29, 2026Duowen Chen, Jinjin He, Gouthaman KV +2Sound Effects Generation 3D Scene Generation
Georgia Institute of Technology · Dolby Laboratories
HelixWorld: A Real-time Interactive Audio-Visual World Model
Sep 29, 2026Lei Ke, Jiahao Pan, Zeyue Tian +13World Model Learning Real-Time Interactive Video Generation
The Hong Kong University of Science and Technology · Noiz AI
Multichannel Audio Quality Assessment: Extending Pretrained Perceptual Models to Spatial Audio
Sep 29, 2026Gouthaman KV, Shiv Gehlot, Vishnu Raj +2Spatial Audio Feature Fusion
Dolby Laboratories
Enabling Immersive Audio-Visual Experience from Any Video
Sep 28, 2026Zitong Lan, Mutian Tong, Jiatao Gu +1Audio-Video Generation Audio-Visual Alignment
University of Pennsylvania
SAIL: Spatial Audio Intelligence with Large Language Models via Disentangled Acoustic-Spatial Encoding and Dual-Stream Q-Former
Sep 28, 2026Zhengding Luo, Jinyang Wu, Haozhe Ma +3Audio Reasoning Direction-of-Arrival Estimation
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · Singapore Management University · Tencent Hy Frontier Lab, Singapore +2
Transformer-based Neural Beamforming for Real-Time Speech Enhancement on Smart Low-Power Hearable Devices
Sep 27, 2026Luca Bompani, Marco Fariselli, Giovanni Oltrecolli +1Speech Enhancement Spatial Audio
Electrical, Electronic and Information Engineering (DEI), University of Bologna, Italy
An Efficient Parametric Codec for Low-Bitrate First-Order Ambisonics
Sep 27, 2026Wei-Ting Lai, Amy Bastine, Lachlan Birnie +2Residual VQ Spatial Audio
Audio & Acoustic Signal Processing Group, The Australian National University, Canberra, Australia
Fast Time-Varying Exponentiated Convolution Methods for Generative Direction Dependent Reverberation
Sep 21, 2026Yuancheng LuoSynthetic Data Generation Spatial Audio
NuSpace Audio, Cambridge, MA, USA
LiteCASS: A Lightweight End-to-End Network for Real-Time Stereo Cinematic Audio Source Separation
Sep 20, 2026Yuanxin Guo, Qiang Ji, Mengmei Liu +3Spatial Audio Audio Source Separation
Southwestern University of Finance and Economics, Chengdu, China · Xiaomi Automobile Co., Ltd., Beijing, China · Wuhan University, Wuhan, China
OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents
Sep 20, 2026Ruixun Liu, Yuxuan Wang, Jiacheng Xie +10Audio-Visual Understanding Spatial Reasoning Benchmarks
School of Intelligence Science and Technology, Peking University · State Key Laboratory of General Artificial Intelligence, Peking University · Alibaba Token Hub, Alibaba Group +1
Geometry-Informed Distributed Acoustic Scene Understanding
Sep 7, 2026Yiyuan Yang, Shitong Xu, Niki Trigoni +1Scene Graph Generation Audio Understanding
Department of Computer Science, University of Oxford, United Kingdom
One-Stage Multi-Task Instruction-Guided 3D Spatial Audio Editing
Sep 4, 2026Ke Lei, Chenyuhao Wen, Yu Zhang +9Audio Editing Spatial Audio
Zhejiang University · ByteDance
Human-robot conversation with multiple participants in noisy public spaces
Sep 1, 2026Divesh Lala, Yogeeswaran Muthukumaran, Vincent Fernandes +10Spoken Dialogue Systems Speech Enhancement
1Kyoto University Graduate School of Informatics · 2Osaka University, Graduate School of Engineering Science · 3National University of Singapore +1
SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristic Rewards
Aug 31, 2026Zixun Guo, Calvin Murdock, Sanjeel Parekh +4Audio-Language Models Spatial Audio
1Meta Reality Labs, USA 2Queen Mary University of London, UK
Listen, See and Track: Spatio-Temporal Audio-Visual Sound Event Reasoning for Omni-Modal Language Models
Aug 10, 2026Zhi Zeng, Cheng Zhang, Zesheng Yang +9Unified Multimodal Models Audio-Visual QA
Xi’an Jiaotong University · The Hong Kong Polytechnic University · National University of Singapore +2
Scene2Sound: Auditory-Grounded Soundscape Generation for 3D Gaussian Worlds
Aug 1, 2026Masaki Yoshida, Ren Togo, Takahiro Ogawa +1Spatial Audio Audio Generation
Hokkaido University
RIPPLE: Generating Multi-Channel Phase, Not Recovering It
Jul 30, 2026Jaehyuk Lee, Yeajin Lee, Dayeon Shin +1Spatial Audio
Department of Mathematics, Korea University · 145, Anam-ro, Seongbuk-gu, Seoul, Republic of Korea · Program in Actuarial Science and Financial Engineering, Korea University
S2A2: Audio-Visual Imitation Learning for Manipulation Tasks Using Acoustic Spatial Information
Jul 28, 2026Kaneyoshi Hiratsuka, Benjamin Yen, Ryosuke KojimaImitation Learning Robotic Manipulation
Kyoto University · RIKEN, Institute of Science Tokyo · Kyoto University, RIKEN
Spacing Out: On the Reliability of Binaural Music Source Separation Metrics
Jul 28, 2026Richa Namballa, Magdalena FuentesMusic Information Retrieval Spatial Audio
Music and Audio Research Laboratory, New York University, United States · Integrated Design and Media, New York University, United States
Mind the Microphone Gap: Benchmarking Array Upsampling Strategies for Latent Acoustic Mapping
Jul 27, 2026Philipp Schmidt, Huw Cheston, Juan Azcarreta +3Audio Representation Learning Self-Supervised Learning
Queen Mary University of London · Meta Reality Labs Research
PathRIR: Physics-Guided Acoustic Path Selection and Late-Tail Compensation for Fast Room Impulse Response Simulation
Jul 25, 2026Shaoheng Xu, Chunyi Sun, Jihui Zhang +3Physics-Informed ML Spatial Audio
The Australian National University, Australia · The University of Queensland, Australia
Dual-BEATs: Unlocking Zero-Shot Stereo Audio Perception in Audio Large Language Models via Dithering
Jul 9, 2026Shuo-Chun Lin, Hen-Hsen HuangAudio-Language Models Spatial Audio
Institute of Information Science, Academia Sinica, Taiwan
EscFOA: Enhancing Spatial Learning for Visually Impaired Learners via Generative Spatial Audio in 360-Degree Educational Environments
Jul 8, 2026Ziyu Luo, Xiaowei Dai, Siying Zhu +1Audio Diffusion Models Spatial Audio
School of Computer and Artificial Intelligence, Beijing Technology and Business University, Beijing, China · College of Fundamental Studies, Beijing Vocational College of Labour and Social Security, Beijing, China
ForestIR: Physics-Informed Forest Sound Simulation for Array-Based Bioacoustic Remote Sensing
Jul 7, 2026Xin Shen, Jennifer N. Kampe, Changwoo J. Lee +7Direction-of-Arrival Estimation Bioacoustics
Department of Statistical Science, Duke University, Durham, NC, USA · Department of Biological and Environmental Science, University of Jyväskylä, Jyväskylä, Finland · Organismal and Evolutionary Biology Research Programme, Faculty of Biological and Environmental Sciences, University of Helsinki, Helsinki, Finland +2

Oct 8, 2026, cs.SDJ/K move · Enter open · S save

MiDashengLM-Spatial: Unifying General Audio Understanding and Spatial Awareness

Jinbo Hu, Hang Su, Lichun Fan, Heinrich Dinkel+9

Xiaomi Inc., China

Audio-Language Models Audio Understanding Spatial Audio Sound Event Detection

Open paper AskPDF arXiv

Large audio-language models (LALMs) have achieved strong performance in general audio understanding, yet most are designed for monaural input and discard the inter-channel cues essential for spatial perception. In contrast, existing spatial audio-language models are purpose-built for spatial tasks and fail to capitalize on the general understanding capabilities of monaural LALMs. We present MiDashengLM-Spatial, the first open-source end-to-end unified audio-language model, to our knowledge, which supports both general audio understanding and spatial awareness within a single architecture. It extends MiDashengLM with a spatial audio encoder, Spatial-Dasheng, integrated through a hierarchical semantic-to-spatial conditioning module that injects intermediate semantic representations into the spatial branch at multiple depths while preserving the original semantic pathway. To provide spatial audio-language supervision at scale, we develop a data synthesis pipeline that renders diverse spatial acoustic scenes with scene-level spatial descriptions and question-answer pairs. Experiments show that Spatial-Dasheng achieves strong performance on sound event localization and detection in real-world scenes, and that MiDashengLM-Spatial substantially outperforms existing LALMs on spatial understanding and reasoning benchmarks. Meanwhile, it remains competitive with state-of-the-art 8B-scale LALMs on diverse monaural benchmarks, demonstrating that spatial awareness can be acquired without compromising general audio understanding. The source code and model checkpoint are available at https://github.com/xiaomi-research/midashenglm-spatial and https://huggingface.co/mispeech/midashenglm-spatial.

Momentum

Related topics

Latest papers 54