Organizations: School of Computer Science and Technology, MOEKLINNS Lab, Xi’an Jiaotong University, Xi’an, Shaanxi, China · National University of Singapore, Singapore · Xi’an Jiaotong University, Xi’an, Shaanxi, China
The rise of micro-videos has reshaped how misinformation spreads, amplifying its speed, reach, and impact on public trust. Existing benchmarks typically focus on a single deception type, overlooking the diversity of real-world cases that involve multimodal manipulation, AI-generated content, cognitive bias, and out-of-context reuse. Meanwhile, most detection models lack fine-grained attribution, limiting interpretability and practical utility. To address these gaps, we introduce WildFakeBench, a large-scale benchmark of over 10,000 real-world micro-videos covering diverse misinformation types and sources, each annotated with expert-defined attribution labels. Building on this foundation, we develop FakeAgent, a Delphi-inspired multi-agent reasoning framework that integrates multimodal understanding with external evidence for attribution-grounded analysis. FakeAgent jointly analyzes content and retrieved evidence to identify manipulation, recognize cognitive and AI-generated patterns, and detect out-of-context misinformation. Extensive experiments show that FakeAgent consistently outperforms existing MLLMs across all misinformation types, while WildFakeBench provides a realistic and challenging testbed for advancing explainable micro-video misinformation detection. Data and code are available at: https://github.com/Aiyistan/FakeAgent.
Figures & tables
Figure 1. WildFakeBench at a glance: over 10,000 real-world micro-videos capturing diverse forms of misinformation.
Figure 2. Comparison of our proposed FakeAgent, neural-network-based and LLM-based methods.
Datasets
Time Span
#Post (Misinformation/Real)
#Video
Type
In Wild
Source
FVC ( Papadopoulou et al., 2019 )
-2018
2,916/2,090
5,006
1
√
YT/TW
(Palod et al. 2019) ( Palod et al., 2019 )
2013-2016
123/423
546
1
√
FB
(Hou et al. 2019) ( Hou et al., 2019 )
-2019
118/132
250
1
√
TT
(Serrano et al. 2020) ( Serrano et al., 2020 )
-2020
113/67
180
1
√
YT
(Choi and Ko 2021) ( Choi and Ko, 2021 )
-2021
902/903
1,805
1
√
YT
(Shang et al. 2021) ( Shang et al., 2021 )
-2020
226/665
891
1
√
TT
Table 1. Comparison of micro-video misinformation benchmarks. WildFakeBench spans the longest period, includes the most videos, and covers the most diverse deception types and sources. Source platforms: YT (YouTube), TW (Twitter), FB (Facebook), TT (TikTok), BB (Bilibili), WB (Weibo), DY (Douyin), IS (Instagram), KS (Kuaishou).
Figure 3. Overview of the data annotation process.
Figure 4. Data analysis of our WildFakeBench.
Figure 5. Domain-specific word clouds in WildFakeBench.
Figure 6. Overview of our proposed FakeAgent framework.
Modality
Content Manipulation
Semantic Biases
Out-of-Context
AIGC
Mean
A
V
T
TT
VT
AT
FL
EN
OC
KE
EF
ES
AIGC
Smaller-Parameter MLLMs
Qwen2-Audio-7B (Direct)
√
×
√
41.02
39.20
34.33
70.42
43.30
22.92
35.48
40.28
43.88
21.39
49.29
InternVL-3-8B (Direct)
×
√
√
14.83
1.78
6.67
29.33
28.87
24.65
24.19
19.14
11.22
36.87
19.76
InternVL-2.5-8B (Direct)
×
√
√
14.33
12.00
13.33
13.33
65.94
81.94
64.92
72.53
74.15
91.98
50.45
Qwen2.5-VL-7B (Direct)
×
√
√
34.33
9.78
13.33
33.33
70.10
60.62
65.73
62.65
52.38
95.51
49.78
Table 2. Main results (%). Performance of all models on the primary evaluation metric, Micro-Acc. Misinformation types are abbreviated: TT (Text Tampering), VT (Video Tampering), AT (Audio Tampering), FL (Faulty Logic), EN (Exaggerated Narration), OC (Offensive Content), KE (Knowledge Error), EF (Event Fabrication), ES (Event Splicing), and AIGC (AI-Generated Content).
Model
Acc
F1
Macro-P
Macro-R
w/o Text
61.34
54.74
58.16
55.86
w/o Video
61.15
54.49
57.86
55.65
w/o Audio
59.62
53.92
56.01
54.71
w/o CKR
60.49
52.29
56.36
54.16
w/o EER
63.49
61.19
59.87
59.89
FakeAgent-7B
67.98
65.42
66.39
65.68
Table 3. Ablation results (%). Macro-level performance of different model variants on WildFakeBench.
Figure 7. Evaluation of model explanation quality using both automatic and human assessments.
Figure 8. Qualitative examples illustrating how FakeAgent detects and explains different types of micro-video misinformation.
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Figure 9. Error case. A real-world example highlighting the limitation of FakeAgent in handling domain-specific misinformation.
Video misinformation increasingly operates at the semantic and evidential level: authentic footage may be selectively edited, temporally reordered, spliced across sources, or augmented with AI-generated content to construct false narratives. Such evidence-dependent manipulations cannot be reliably verified from the input video alone, because the missing, reordered, replaced, or recontextualized evidence lies outside the video itself. We introduce EVID-Bench, a benchmark for search-grounded video misinformation detection, where a system must search the open web for related videos and identify what information is false through cross-video comparison. EVID-Bench comprises 222 videos spanning 9 manipulation types across 3 categories: AI generation, single-source editing, and multi-source editing. All samples are verified to be undetectable by frontier models through visual inspection alone. We evaluate nine frontier multimodal models using a retrieval-augmented verification baseline. The best system achieves only 61.43% point-level accuracy and 43.24% video-level accuracy, while AI-generated manipulations remain especially challenging. Error analysis reveals recurring challenges: models fixate on irrelevant anchors, misattribute synthetic content to editorial splicing, and terminate search prematurely before fully explaining the manipulation.
Multimodal large language models (MLLMs) have substantially advanced video misinformation detection through unified multimodal reasoning, but they often rely on fixed-depth inference and place excessive trust in internally generated assumptions, particularly in scenarios where critical evidence is sparse, fragmented, or requires external verification. To address these limitations, we propose FactGuard, an agentic framework for video misinformation detection that formulates verification as an iterative reasoning process built upon MLLMs. FactGuard explicitly assesses task ambiguity and selectively invokes external tools to acquire critical evidence, enabling progressive refinement of reasoning trajectories. To further strengthen this capability, we introduce a two-stage training strategy that combines domain-specific agentic supervised fine-tuning with decision-aware reinforcement learning to optimize tool usage and calibrate risk-sensitive decision making. Extensive experiments on FakeSV, FakeTT, and FakeVV demonstrate FactGuard's state-of-the-art performance and validate its excellent robustness and generalization capacity.
Zehao Li, Hongwei Yu, Hao Jiang +7
Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · University of Science and Technology Beijing, Beijing, China +1
Multimodal video misinformation detection is commonly formulated as a holistic video-understanding task, where the entire video and its associated content are processed and judged in a single pass. However, real-world misinformation often exhibits a sparse and compositional evidence structure: a reliable decision may depend on only a few coupled clues, while most video content contributes limited additional information. Exhaustive multimodal reasoning may therefore introduce substantial redundancy and obscure decisive evidence. This motivates decoupling evidence acquisition from verification: first identifying sparse, decision-relevant clues and then judging veracity based on the acquired evidence. Accordingly, we propose SIEVE, a framework for Sparse Interactive Evidence Verification via Extraction in multimodal video misinformation detection. An evidence-seeking agent actively explores the available multimodal evidence and constructs a compact evidence package, which is then used by a verifier to determine veracity. The agent is trained with supervised evidence-seeking trajectories and an evidence-aware reinforcement learning objective that promotes informative evidence acquisition while discouraging unnecessary or invalid interactions. Experiments on multiple video misinformation benchmarks show that SIEVE consistently outperforms the evaluated baselines and supports reliable verification using compact evidence packages. Moreover, the resulting acquisition process provides an explicit and inspectable evidence trail, improving the transparency and groundedness of multimodal misinformation detection.
Haochen Zhao, Yongxiu Xu, Xinkui Lin +6
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China · Baidu, Beijing, China