cs.SDJun 3, 2026

Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching

Authors: Yuhuan YouYufan QianTianshu QuBin WangXueyang Lv

Organizations: State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University, Beijing, China · 2Beijing Xiaomi Mobile Software Co., Ltd · 3Xiaomi Communications Co., Ltd

Abstract

Higher-Order Ambisonics (HOA) encoding from sparse, irregular microphone arrays remains a critical challenge for consumer spatial audio capture in immersive communication and XR. We propose Flow-HOA, a generative framework that jointly optimizes a multi-dimensional objective encompassing time-domain, spectral, and spatial fidelity while producing a deployable, time-invariant bank of Finite Impulse Response (FIR) encoding filters. Using conditional flow matching, the model learns to map a simple prior distribution to the target distribution of FIR filter coefficients. Training is guided by a composite loss that balances time-domain waveform fidelity, multi-resolution spectral consistency, sub-band energy preservation, and spatial directivity constraints. Objective evaluations on synthetically simulated data demonstrate improved performance over strong model-based baselines in both signal fidelity and spatial accuracy metrics. Subjective listening tests on real microphone array recordings further confirm that Flow-HOA yields higher overall sound quality with reduced artifacts, demonstrating generalization from synthetic training data to real-world capture conditions.

Explore similar work

CardsList
  1. DiffAU: Diffusion-Based Ambisonics Upscaling

    Sep 30, 2025Amit Milstein, Nir Shlezinger, Boaz RafaelySpatial AudioPerceptual Understanding