cs.SDOct 30, 2026

One Waveform, Two Stories: Benchmarking Speech-Acoustic Conflict in Audio-Language Models

Authors: Wenbin Wang, Yuheng Li, Koichiro Yoshino

Organizations: The University of Osaka · University of Wisconsin-Madison

Abstract

Audio-language models (ALMs) are evaluated on their understanding of both speech and environmental sounds. What remains underexplored is how they respond when spoken claims contradict acoustic evidence within the same recording. We introduce SAC-Bench, a benchmark of intra-audio speech--acoustic conflict comprising 616,031 unique clips from 188 sound-event classes across seven semantic, temporal, and spatial tasks. It pairs environmental recordings with compatible or contradictory synthesized spoken claims and includes audio-only controls where applicable. Across five open-weight ALMs evaluated on semantic and temporal tasks, high audio-only accuracy often coexists with large losses under conflicting claims; Event Identity accuracy is 24.8--46.5 percentage points lower in conflict than compatible conditions. Temporal Order failures persist even when speech follows the complete event sequence, so simultaneous speech--event masking cannot fully explain them. A spatial case study with Spatial-Omni finds lower motion accuracy associated with both spoken claims and the speech source's physical trajectory. Prompt interventions sometimes restore acoustic accuracy, but can also reduce claim-aligned answers without improving grounding or worsen performance. SAC-Bench thus separates acoustic competence, conflict robustness, and intervention effects.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Beyond Text Following: Repairable Arbitration Reversals in Audio-Language Models

    Jun 3, 2026Yichen Gao, Yiqun Zhang, Zijing Wang +7Audio-Language Model EvaluationAudio Understanding

  2. TRACE: Trustworthy Reasoning from Acoustic Cues and Evidence

    Oct 15, 2026Giovana Morais, Yujin Kim, Atilay Kucukoglu +1Audio-Language Model EvaluationAudio-Language Models