cs.SDOct 16, 2026

Framing Spatial Hearing within the Free Energy Principle: A Hierarchical Model of Perceptual Learning

Authors: Roberto Barumerli, Nils Meyer-Kahlen, Lorenzo Picinali

Organizations: Dyson School of Design Engineering, Imperial College London, UK · Dept. of Information and Communications Engineering, Aalto University, Finland

Abstract

Spatial hearing relies on dynamic internal representations to decode spatial information from ever-changing acoustic conditions. A fundamental example is sound localisation, where listeners infer the direction of an invisible sound. Bayesian inference provides a computational account of such a localisation process; however, modelling efforts are largely limited to static listening scenarios. Instead, the free energy principle (FEP) describes perception, learning, and action as joint minimisation of variational free energy (VFE), providing a principled framework to account for dynamic conditions. Here, we take a first step toward applying the FEP to spatial hearing. We characterise how listeners' beliefs evolve across trials, in which they estimated sound direction and received subsequent visual feedback on each trial. Listeners are described by a hierarchical generative model where visual feedback drives gradient descent on VFE, updating beliefs over three independent quantities: lateral and polar localisation precisions and hemifield disambiguation. The model captures individual learning trajectories and reveals components with different dynamics: lateral precision improves, as does hemifield disambiguation, consistent with increased sensitivity of the auditory pathway in decoding vertical direction. Notably, polar precision also increases, most for listeners with the lowest initial precision, suggesting that the observed vertical improvement is driven by both hemifield disambiguation and polar precision. This work establishes spatial hearing as a tractable domain for FEP and motivates future closed-loop experiments with full action-perception cycles.

Figures & tables

Explore similar work

CardsList
  1. Statistical validation and full-sphere extension of a Bayesian model for human static sound localisation

    Jun 23, 2026Roberto Barumerli, Fabian Brinkmann, Emanuele Zanoni +3Bayesian InferenceSpatial Audio

  2. BiEAR: A Human Auditory-Inspired Adaptive Binaural Front-end for Multi-Speaker Localisation and Distance Estimation

    Jun 5, 2026Hanyu Meng, Eliathamby Ambikairajah, Vidhyasaharan Sethu +2Adaptive InferenceDirection-of-Arrival Estimation

  3. SEA-LM: Egocentric Spatial Audio Understanding for Wearable Microphone Arrays

    Oct 4, 2026Sonal Kumar, Sinan Hersek, Artem Dementyev +6Direction-of-Arrival EstimationAudio-Language Models