Audio language models (ALMs) are increasingly used for audio deepfake detection (ADD), yet existing benchmarks assess their verdicts or rationale plausibility without verifying the underlying acoustic evidence. To address this issue, we first introduce spoofing evidence-grounded audio reasoning (SEAR), a four-task AQA benchmark to evaluate ALM-based ADD through acoustic evidence identification and quantification, deepfake detection, and forensic rationale generation. We further propose a bona-fide-based acoustic evidence agent (BAEA), which equips a frozen ALM with controlled acoustic tools under \textsc{fixed} or \textsc{adaptive} evidence-acquisition policies. Experiments with six ALMs reveal a clear gap between plausible rationales and verifiable acoustic evidence reasoning, while BAEA-\textsc{Fixed} improves final verdicts and forensic rationales on both evaluation partitions. Controlled interventions further show that misleading evidence degrades both detection and grounding performance.
Figures & tables
Figure 1: The proposed SEAR benchmark tasks and BAEA method.
T1 (F1 ↑ )
T2 (ACC ↑ )
T3 (ACC ↑ )
T4 (B-F1 ↑ )
ALM
19Tr
19Dev
19Eval
21Eval
19Tr
19Dev
19Eval
21Eval
19Tr
19Dev
19Eval
21Eval
19Tr
19Dev
19Eval
21Eval
Qwen2-Audio
39.28
40.50
39.13
42.92
23.90
24.20
24.20
23.90
23.61
21.10
22.95
24.73
83.74
83.50
83.32
83.78
Qwen2.5-Omni
34.19
30.85
25.24
24.00
20.30
21.05
18.65
23.90
15.07
12.84
16.26
15.67
84.01
83.80
83.60
83.81
MiniCPM-o
13.95
14.00
13.76
16.06
19.30
16.65
14.65
23.70
22.16
20.23
22.25
25.77
84.43
84.19
83.97
84.16
MOSS-Audio
33.66
32.04
23.52
25.56
18.65
14.55
11.80
20.25
22.55
21.69
23.46
25.79
83.99
83.73
83.61
83.95
Gemini-Flash
49.27
52.47
48.61
45.07
20.00
18.10
14.65
24.30
14.79
13.05
15.32
16.11
85.17
85.03
84.60
84.82
Table 1: Zero-shot performance (%) across SEAR tasks and partitions. Note that the training, development and evaluation sets are abbreviated as Tr, Dev and Eval, respectively.
The University of Melbourne, Melbourne, Australia · Xi’an University of Posts and Telecommunications, Xi’an, China · The University of Auckland, Auckland, New Zealand