Insight into Parametric First-Order Ambisonics Upscaling in Time and Frequency Domains
Organizations: School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, P.O. Box 653, Beer-Sheva, 8410501, Israel
Abstract
First-Order Ambisonics (FOA) offers a practical representation for spatial audio, but its low-order reproduction introduces distinct perceptual limitations during binaural rendering. While recent methods synthesize Higher-Order Ambisonics (HOA) from FOA to overcome these constraints, the importance and potential of early reflections in the upscaling process have not yet been comprehensively explored. To bridge this knowledge gap and understand the potential of incorporating early reflections in FOA upscaling, this work develops an experimental framework that selectively upscales these reflections. By utilizing an energy-based criterion, the proposed framework identifies and selectively renders the strongest early reflections with high-order resolution. The selection mechanism is evaluated across three domains: long-term temporal, short-time temporal, and the joint time-frequency (TF) domain. Validation through objective metrics, including the Scale-Invariant Signal-to-Distortion Ratio (SI-SDR), the clarity index (), and Interaural Cross-Correlation (IACC), alongside listening tests, demonstrates that the TF-domain provides superior performance. By exploiting the sparsity of speech, the TF approach maintains robust performance in complex multi-talker scenarios, providing insights into the benefits of early reflections for the design of future parametric and data-driven FOA upscaling methods.
Figures & tables
| Parameter | Value / Description |
|---|---|
| Number of Rooms | with volumes – m 3 |
| Rooms Dimensions ( ) | m |
| Range | s |
| Source Positions | positions per room ( m from boundaries) |
| Array Positions | varying distances per source position ( total per room) |
| Direct-to-Reverberant Ratio | dB |
| Screen | Anchor | lt | st | tf |
|---|---|---|---|---|
| 1: Single talker, | 4.25 | 16.41 | 16.43 | 16.64 |
| 2: Two talkers, | 2.77 | 4.69 | 10.05 | 15.65 |
| 3: Two talkers, | 2.77 | 16.61 | 12.32 | 19.35 |
Spatial Audio
Spatial audio studies how sound is captured, represented, generated, and perceived with direction, distance, motion, and room acoustics.
See all 118 papers