cs.SDJul 27, 2026

Mind the Microphone Gap: Benchmarking Array Upsampling Strategies for Latent Acoustic Mapping

Authors: Philipp SchmidtHuw ChestonJuan AzcarretaAdrian StepienÇağdaş BilenIran R. Roman

Organizations: Queen Mary University of London · Meta Reality Labs Research

Abstract

Latent Acoustic Mapping (LAM) is a self-supervised learning method that generates high-resolution spherical acoustic maps from multichannel recordings without labelled data, matching supervised baselines on direction-of-arrival benchmarks. However, LAM degrades significantly with sparse 4-channel arrays, as the low-resolution cross-spectral matrix captures far less spatial information than the 32-channel inputs LAM was designed for. We benchmark a diverse set of upsampling architectures, spanning lightweight convolutional networks, iterative back-projection models, physics-informed networks, and generative adversarial approaches. We also study whether aligning these upsamplers with LAM by training them jointly or in different stages helps preserve the spatial structure that LAM depends on. Results show that the original full-resolution LAM is the strongest, that separately trained lightweight models are the most competitive learned approaches, and that representation alignment between the upsampler and LAM matters more than model complexity.

Explore similar work

CardsList
  1. CNN Models for Microphone Array Covariance Matrix Upsampling and Acoustic Imaging

    Jul 1, 2026Marianthi Adamopoulou, Parthasaarathy Sudarsanam, David Diaz-Guerra +5Direction-Of-Arrival EstimationUpsampling

  2. DiffAU: Diffusion-Based Ambisonics Upscaling

    Sep 30, 2025Amit Milstein, Nir Shlezinger, Boaz RafaelySpatial AudioPerceptual Understanding