AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plan
Organizations: Communication University of China · Ant Group · Machine Intelligence, Ant Group · Institute of Automation, Chinese Academy of Sciences · Beijing Institute of Technology · Shanghai Jiao Tong University
Abstract
The rapid advancement of Audio Large Language Models (ALLMs) has enabled cost-effective, high-fidelity generation and manipulation of both speech and non-speech audio, including sound effects, singing voices, and music. While these capabilities foster creativity and content production, they also introduce significant security and trust challenges, as realistic audio deepfakes can now be generated and disseminated at scale. Existing audio deepfake detection (ADD) countermeasures (CMs) and benchmarks, however, remain largely speech-centric, often relying on speech-specific artifacts and exhibiting limited robustness to real-world distortions, as well as restricted generalization to heterogeneous audio types and emerging spoofing techniques. To address these gaps, we propose the All-Type Audio Deepfake Detection (AT-ADD) Grand Challenge for ACM Multimedia 2026, designed to bridge controlled academic evaluation with practical multimedia forensics. AT-ADD comprises two tracks: (1) Robust Speech Deepfake Detection, which evaluates detectors under real-world scenarios and against unseen, state-of-the-art speech generation methods; and (2) All-Type Audio Deepfake Detection, which extends detection beyond speech to diverse, unknown audio types and promotes type-agnostic generalization across speech, sound, singing, and music. By providing standardized datasets, rigorous evaluation protocols, and reproducible baselines, AT-ADD aims to accelerate the development of robust and generalizable audio forensic technologies, supporting secure communication, reliable media verification, and responsible governance in an era of pervasive synthetic audio.
Figures & tables
| Split | T1 | T2 | ||||
|---|---|---|---|---|---|---|
| Speech | Sound | Singing | Music | Total | ||
| Train | 49,575 | 49,575 | 39,840 | 36,000 | 21,366 | 146,781 |
| Dev | 49,734 | 49,734 | 19,929 | 16,000 | 5,406 | 91,069 |
| Progress | 29,269 | 45,875 | ||||
| Eval | 146,346 | 229,373 | ||||
| Model / Condition | Train | Dev |
|---|---|---|
| Real | 9,999 | 10,000 |
| ProDiff ( Huang et al., 2022b ) | 1,999 | 1,998 |
| PortaSpeech (normal) ( Ren et al., 2021b ) | 1,996 | 1,994 |
| DiffSpeech ( Liu et al., 2022 ) | 1,998 | 1,999 |
| FastSpeech2 ( Ren et al., 2021a ) | 1,998 | 1,998 |
| Kokoro ( Nayak, 2025 ) | 2,000 | 1,998 |
| Type | Model / Source | Train | Dev |
|---|---|---|---|
| Sound | Real | 9,854 | 4,940 |
| AudioLDM ( Liu et al., 2023a ) | 9,995 | 4,997 | |
| AudioLDM 2 ( Liu et al., 2024 ) | 10,000 | 5,000 | |
| AudioGen ( Kreuk et al., 2022 ) | 9,991 | 4,992 | |
| Total | 39,840 | 19,929 | |
| Singing | Real | 9,000 | 4,000 |
| Type | Model | T1 | T2 | T2 Progress (by Type) | T2 Eval (by Type) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dev | Progress | Eval | Dev | Progress | Eval | Speech | Sound | Singing | Music | Speech | Sound | Singing | Music | ||
| Conventional | Spec-ResNet | 81.85 | 47.93 | 47.41 | 57.51 | 53.22 | 53.83 | 51.08 | 52.92 | 48.41 | 60.48 | 51.79 | 54.35 | 49.29 | 59.88 |
| AASIST | 94.16 | 60.78 | 60.39 | 93.63 | 62.38 | 62.21 | 63.69 | 56.88 | 64.08 | 64.87 | 63.58 | 56.62 | 63.81 | 64.85 | |
| SSL-based | FT-XLSR-AASIST | 99.70 | 76.98 | 76.73 | 98.48 | 79.25 | 79.47 | 79.43 | 66.08 | 96.33 | 75.17 | 79.50 | 66.82 | 96.30 | 75.28 |
| WPT-XLSR-AASIST | 96.27 | 73.56 | 73.35 | 95.00 | 66.59 | 66.68 | 69.42 | 52.97 | 79.81 | 64.17 | 69.31 | 53.83 | 79.56 | 64.04 | |
| ALLM-based | Qwen2.5-Omni-3B | 93.97 | 68.65 | 68.02 | 94.44 | 63.42 | 63.23 | 69.47 | 50.38 | 66.31 | 67.52 | 68.74 | 50.41 | 65.78 | 67.99 |
| Event | Date (2026) |
|---|---|
| Release of Data, Baseline Code, and Paper | April 8 |
| Opening of Progress Evaluation Stage | April 8 |
| Opening of Final Evaluation Stage | June 8 |
| Final Leaderboard Freeze | June 15 |
| Metadata and Technical Report Submission | June 17 |
| Participant Paper Submission Deadline | June 25 |