From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild
Organizations: School of Computer Science and Technology, MOEKLINNS Lab, Xi’an Jiaotong University, Xi’an, Shaanxi, China · National University of Singapore, Singapore · Xi’an Jiaotong University, Xi’an, Shaanxi, China
Abstract
The rise of micro-videos has reshaped how misinformation spreads, amplifying its speed, reach, and impact on public trust. Existing benchmarks typically focus on a single deception type, overlooking the diversity of real-world cases that involve multimodal manipulation, AI-generated content, cognitive bias, and out-of-context reuse. Meanwhile, most detection models lack fine-grained attribution, limiting interpretability and practical utility. To address these gaps, we introduce WildFakeBench, a large-scale benchmark of over 10,000 real-world micro-videos covering diverse misinformation types and sources, each annotated with expert-defined attribution labels. Building on this foundation, we develop FakeAgent, a Delphi-inspired multi-agent reasoning framework that integrates multimodal understanding with external evidence for attribution-grounded analysis. FakeAgent jointly analyzes content and retrieved evidence to identify manipulation, recognize cognitive and AI-generated patterns, and detect out-of-context misinformation. Extensive experiments show that FakeAgent consistently outperforms existing MLLMs across all misinformation types, while WildFakeBench provides a realistic and challenging testbed for advancing explainable micro-video misinformation detection. Data and code are available at: https://github.com/Aiyistan/FakeAgent.
Figures & tables
| Datasets | Time Span | #Post (Misinformation/Real) | #Video | Type | In Wild | Source |
|---|---|---|---|---|---|---|
| FVC ( Papadopoulou et al., 2019 ) | -2018 | 2,916/2,090 | 5,006 | 1 | YT/TW | |
| (Palod et al. 2019) ( Palod et al., 2019 ) | 2013-2016 | 123/423 | 546 | 1 | FB | |
| (Hou et al. 2019) ( Hou et al., 2019 ) | -2019 | 118/132 | 250 | 1 | TT | |
| (Serrano et al. 2020) ( Serrano et al., 2020 ) | -2020 | 113/67 | 180 | 1 | YT | |
| (Choi and Ko 2021) ( Choi and Ko, 2021 ) | -2021 | 902/903 | 1,805 | 1 | YT | |
| (Shang et al. 2021) ( Shang et al., 2021 ) | -2020 | 226/665 | 891 | 1 | TT |
| Modality | Content Manipulation | Semantic Biases | Out-of-Context | AIGC | Mean | |||||||||
| A | V | T | TT | VT | AT | FL | EN | OC | KE | EF | ES | AIGC | ||
| Smaller-Parameter MLLMs | ||||||||||||||
| Qwen2-Audio-7B (Direct) | 41.02 | 39.20 | 34.33 | 70.42 | 43.30 | 22.92 | 35.48 | 40.28 | 43.88 | 21.39 | 49.29 | |||
| InternVL-3-8B (Direct) | 14.83 | 1.78 | 6.67 | 29.33 | 28.87 | 24.65 | 24.19 | 19.14 | 11.22 | 36.87 | 19.76 | |||
| InternVL-2.5-8B (Direct) | 14.33 | 12.00 | 13.33 | 13.33 | 65.94 | 81.94 | 64.92 | 72.53 | 74.15 | 91.98 | 50.45 | |||
| Qwen2.5-VL-7B (Direct) | 34.33 | 9.78 | 13.33 | 33.33 | 70.10 | 60.62 | 65.73 | 62.65 | 52.38 | 95.51 | 49.78 | |||
| Model | Acc | F1 | Macro-P | Macro-R |
| w/o Text | 61.34 | 54.74 | 58.16 | 55.86 |
| w/o Video | 61.15 | 54.49 | 57.86 | 55.65 |
| w/o Audio | 59.62 | 53.92 | 56.01 | 54.71 |
| w/o CKR | 60.49 | 52.29 | 56.36 | 54.16 |
| w/o EER | 63.49 | 61.19 | 59.87 | 59.89 |
| FakeAgent-7B | 67.98 | 65.42 | 66.39 | 65.68 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Fake News Detection
Fake news detection identifies false or misleading claims by analyzing content, context, evidence, and how information spreads.
See all 98 papers