Let the Bullets Fly: Multimodal Fake News Detection with Temporal-Aligned Generative Danmaku

Xiansheng Luo; Chaowei Zhang; Zewei Zhang; Yi Zhu; Jipeng Qiang

cs.AIAug 24, 2026

Let the Bullets Fly: Multimodal Fake News Detection with Temporal-Aligned Generative Danmaku

Authors: Xiansheng Luo, Chaowei Zhang, Zewei Zhang, Yi Zhu, Jipeng Qiang

Organizations: Yangzhou University Yangzhou, Jiangsu, China · Auburn University Auburn, Alabama, USA

Abstract

The social interactions among crowds via Danmaku (a.k.a., bullet comments) on modern multimedia platforms can facilitate both viewpoint conflicts and consensus, providing fine-grained discriminative social signals that can benefit fake news detection. However, the inherent accumulation latency of Danmaku in real-world scenarios violates the real-time necessity of fake news detection, making the studies of Danmaku-related fake news detection underexplored. To break this violation, we simulate this temporal-aware user interactive process by proposing a novel temporal Generative danmaku framework, called Genda, which consists of: (1) a Danmaku Trigger for predicting the timing and intensity of user reactions; and (2) a Danmaku Generator for synthesizing corresponding semantic and emotional expressions, thereby mutually constructing a temporally aligned and human-like pseudo Danmaku streams. To make the generated Danmaku useful for identifying fake news videos, we further design a Danmaku-guided Temporal Multimodal fake news detection model - DM-FEND, which enables fine-grained multimodal interactions among video, audio, text, and Danmaku, enhancing dynamic modalities alignment and semantic noise inhibition. The experimental results demonstrate that DM-FEND consistently outperforms state-of-the-art baselines across both Chinese (FakeSV) and English (FakeTT) benchmarks. Further ablations validate the crucial role of temporal Danmaku modeling in enhancing robustness and discriminative capability. Finally, this study offers a bright and robust solution for multimodal fake news detection in modern social interactive fashions by bridging the temporal inconsistency between news and user behaviors.

Figures & tables

Panel of Figure 1 — Figure 1. (a) Temporal distribution of Danmaku across real and fake videos, showing consistent early-stage concentration and distinct evolution patterns. (b) Semantic relatedness comparison between Danmaku and video content.

Figure 2. The workflow of our proposed approach. (A) Genda : a temporal Generative Danmaku module that models user interaction dynamics by performing segment-level video understanding, followed by a Danmaku Trigger to estimate reaction intensity and a Danmaku Generator to produce semantically and temporally aligned Danmaku. (B) DM-FEND : a Danmaku-guided temporal multimodal learning module that enhances unimodal representations via importance-aware and noise-aware masking, and captures fine-grained cross-modal interactions among text, video, audio, and Danmaku. (C) Classification block: temporally aggregated multimodal representations are fed into an MLP for final fake news prediction.

Models	FakeSV				FakeTT
Models	Acc	Mac-F1	Prec	Rec	Acc	Mac-F1	Prec	Rec
Unimodal Baselines
Text(Bert)	81.36	81.29	81.36	81.33	76.54	75.00	74.70	77.24
Image(CLIP-vit)	73.99	73.97	75.65	75.35	68.90	68.49	71.02	73.73
Audio(wav2vec2)	75.52	75.13	76.86	76.37	70.54	69.77	71.75	74.00
Video(VideoMAEv2)	72.86	72.58	72.53	72.71	73.24	71.92	71.81	74.39

Table 1. This paper validates the performance of various baseline methods against our proposed method on the FakeSV and FakeTT datasets. Best results are highlighted in bold , and second-best results are highlighted with underlines . Paired t-tests were used to test the statistical significance of all baselines (p < 0.05), and significant differences are indicated by (*).

DA	EN	CM	FakeSV		FakeTT
DA	EN	CM	Acc	Mis-F1	Acc	Mis-F1
$\times$	$\times$	$\times$	81.49	80.64	77.58	76.95
$\times$	$\times$		83.12	82.87	79.79	79.81
$\times$		$\times$	83.72	82.47	80.39	80.26
	$\times$	$\times$	82.95	84.83	80.16	83.42
$\times$			84.32	83.56	81.18	80.20

Table 2. Ablation study of different components. DA: Temporal Danmaku Generation, EN: Danmaku-guided unimodal learning , CM: Danmaku-guided multimodal learning.

Figure 3. Visualized comparison between DM-FEND and its representative variants on the FakeSV dataset using Principal Component Analysis (PCA). Green represents real news sample points, and red represents fake news sample points.

Figure 4. Case study of a short video with the video clip-level pseudo Danmaku generated using our proposed Genda framework.

Fake News Detection

Fake news detection identifies false or misleading claims by analyzing content, context, evidence, and how information spreads.

See all 99 papers

Rethinking Multimodal Fake News Detection in the Generative AI Era
Sep 29, 2026Wenbin Shen, Guoxuan Qin, Guangxu Yao +3Social Media Analysis Fake News Detection
Nanjing University of Science and Technology, Nanjing, China · University of Chinese Academy of Sciences, Beijing, China
Retrieval-Augmented Multimodal Model for Fake News Detection
Apr 20, 2026Yiheng Li, Weihai Lu, Hanyi Yu +1Fake News Detection Text Classification
University of International Business and Economics · Beijing, China · Peking University +4
Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?
Sep 20, 2026Jiyao Yang, Yang Liu, Zhenyue Qin +2Fake News Detection Multimodal Large Language Models
Independent Researcher · Carnegie Mellon University · RMIT University +1

Sep 29, 2026J/K move · Enter open · S save

Rethinking Multimodal Fake News Detection in the Generative AI Era

Wenbin Shen, Guoxuan Qin, Guangxu Yao, Baodong Wang+2

Nanjing University of Science and Technology, Nanjing, China · University of Chinese Academy of Sciences, Beijing, China

Social Media Analysis Fake News Detection AI-Generated Text Detection

Open paper AskPDF arXiv

Generative content is increasingly entering the production and dissemination of news, transforming fake news from manually fabricated or simply manipulated material into complex forms in which native and generated content jointly participate. Existing multimodal fake news detection research primarily focuses on veracity assessment and rarely characterizes how generativity differences affect the reliability of evidence. In contrast, AIGC detection primarily determines whether content is generated or modified by generative models, but it does not by itself establish whether the underlying news event is true. To bridge the separation between these tasks in data and evaluation, we construct Weibo26, a multimodal fake news detection dataset for generative-content scenarios. On this basis, we propose the Generativity-Aware Hierarchical Reasoning (GAHR) framework, which combines global judgment with local correction so that generativity information participates in news-veracity reasoning. Experiments on multiple existing fake news detection benchmarks and Weibo26 show that GAHR achieves competitive veracity-detection performance while effectively identifying generative content.

Abstract

Fake News Detection

Explore similar work

Rethinking Multimodal Fake News Detection in the Generative AI Era

Retrieval-Augmented Multimodal Model for Fake News Detection

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?