Spatial DJ: Spatial Audio Control for Arbitrary Loudspeaker Layouts
Organizations: AVINCE, San Francisco, CA 94115, USA · Department of Electrical Engineering and Computer Science, University of California, Berkeley, Berkeley, CA 94720, USA
Abstract
Object-based spatial audio promises render-anywhere playback, yet deploying it in a new venue still requires two tasks that are rarely addressed together: acquiring the physical loudspeaker geometry and enabling creators manipulate spatial audio while listening through the target loudspeaker system rather than a headphone proxy. We present Spatial DJ, a system for on-site loudspeaker layout acquisition and real-time spatial audio rendering and control, using head-worn AR in a coordinate frame aligned to the physical loudspeakers. In an 18-loudspeaker room, we evaluate calibration accuracy, repeatability, and control latency, and conduct an 18-participant listener study comparing diffuse and orbiting point-source rendering configurations applied to vocal and instrumental layers. Orbiting point-source conditions received higher ratings of perceived immersion, energy, and novelty than the diffuse baseline. Beyond this controlled setting, four representative deployments illustrate reuse of the same system across heterogeneous loudspeaker venues.
Figures & tables
| Metric | Median [p25, p75] | Mean (SD) | p95 | |
|---|---|---|---|---|
| (network+parse) | 6164 | 2.18 [1.30, 3.18] | 4.55 (9.38) | 22.54 |
| (engine+block) | 6164 | 5.15 [2.63, 7.87] | 5.33 (4.52) | 9.82 |
| (control) | 6164 | 8.07 [5.07, 11.00] | 9.88 (10.08) | 27.40 |
| by number of active speakers | ||||
| 1596 | 8.20 [5.34, 11.04] | 9.96 (8.52) | 27.89 | |
| 1629 | 8.11 [4.96, 10.73] | 9.01 (6.89) | 22.36 | |
| Perceived motion type | C 1 | C 2 | C 3 | C 4 |
|---|---|---|---|---|
| Diffuse or scattered | 16 (44.4%) | 7 (19.4%) | 10 (27.8%) | 10 (27.8%) |
| Elliptical movement | 2 (5.6%) | 26 (72.2%) | 28 (77.8%) | 25 (69.4%) |
| Horizontal movement | 8 (22.2%) | 9 (25.0%) | 18 (50.0%) | 8 (22.2%) |
| Vertical movement | 7 (19.4%) | 1 (2.8%) | 0 (0.0%) | 1 (2.8%) |
| Two moving layers or objects | 5 (13.9%) | 9 (25.0%) | 9 (25.0%) | 23 (63.9%) |
| Not sure | 5 (13.9%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
Spatial Audio
Spatial audio studies how sound is captured, represented, generated, and perceived with direction, distance, motion, and room acoustics.
See all 118 papers