EA-Swin: An Embedding-Agnostic Swin Transformer for AI-Generated Video Detection
Authors: Hung Mai, Loi Dinh, Duc Hai Nguyen, Dat Do, Luong Doan, Khanh Nguyen Quoc, Huan Vu, Naeem Ul Islam, +1 more
Organizations: N2TP Technology Solution JSC, Hanoi, Vietnam · College of Technology, National Economics University, Hanoi, Vietnam · University of Science, Vietnam National University, Ho Chi Minh City, Vietnam · Faculty of AI and Data Science, Phenikaa University, Hanoi, Vietnam · The Saigon International University, Ho Chi Minh City, Vietnam · College of Informatics, Yuan Ze University, Taoyuan, Taiwan
Recent advances in foundation video generators such as Sora2, Veo3, and other commercial systems have produced highly realistic synthetic videos, exposing the limitations of existing detection methods that rely on shallow embedding trajectories, image-based adaptation, or computationally heavy MLLMs. We propose EA-Swin, an Embedding-Agnostic Swin Transformer that models spatiotemporal dependencies directly on pretrained video embeddings via a factorized windowed attention design, making it compatible with generic ViT-style patch-based encoders. Moreover, we construct the EA-Video dataset, a benchmark dataset comprising 130K videos that integrates newly collected samples with curated existing datasets, covering diverse commercial and open-source generators and including unseen-generator splits for rigorous cross-distribution evaluation. Extensive experiments show that EA-Swin achieves 0.97-0.99 accuracy across major generators, outperforming prior SoTA methods (typically 0.8-0.9) by a margin of 5-20%, while maintaining strong generalization to unseen distributions, establishing a scalable and robust solution for modern AI-generated video detection.
Figures & tables
Figure 1: Sampled video frames from some AI video generators. Top: Recent generators produce high-quality visuals and realistic motion, closely resembling real videos. Bottom: Earlier models show clear artifacts, distorted content, and unnatural motion.
Figure 2: Real video data and AI videod data portion by Generators and Sources.
Figure 3: Train/Validation/Test set split.
Figure 4: t-SNE visualization of embedding trajectories. Each polyline represents the temporal evolution of video embeddings from V-JEPA 2 encoder.
Figure 5: Spatiotemporal window shifting mechanism. The input video embedding is first partitioned into non-overlapping local windows (1) along spatial and temporal dimensions. To enable cross-window interaction and enhance global context modeling, the windows are then shifted (2) spatially across adjacent regions and temporally across neighboring frames.
Figure 6: Temporal Swin attention.
Figure 7: Spatial Swin attention.
Figure 8: EA-Swin architecture.
Model
Metric
Veo3
Sora2
HY
CVX
EA
LTX
Pika1
Wan2
Kling2
Sora
Avg
Acc
0.511
0.510
0.512
0.511
0.512
0.511
0.511
0.511
0.506
0.511
0.5105
Recall
1.000
1.000
1.000
1.000
1.000
1.000
1.000
0.999
0.993
1.000
0.9991
F1
0.676
0.675
0.677
0.676
0.677
0.676
0.676
0.676
0.671
0.676
0.6757
D3
AUC
0.374
0.671
0.190
0.304
0.168
0.366
0.264
0.573
0.548
0.319
0.3778
Acc
0.683
0.641
0.641
0.723
0.736
0.725
0.726
0.698
0.655
0.646
0.6874
Recall
0.890
0.802
0.986
0.956
0.988
0.963
0.968
0.903
0.810
0.837
0.9103
Table 1: Benchmark results on the evaluation (seen) set , grouped by video generator. For each generator in the test set, the number of real videos is approximately balanced with the number of AI-generated videos from that generator. Abbreviation: HY (Hunyuan), CVX (CogVideoX), EA (EasyAnimate)
Model
Metric
Unk
RM2
Kling
Hailuo
SD
Mochi
JM
Gen3
Luma
Vidu
PRM
SKR
PV
Pika2
Gen4
Avg
Acc
0.511
0.511
0.512
0.510
0.512
0.515
0.512
0.512
0.513
0.512
0.511
0.519
0.515
0.514
0.545
0.515
Recall
1.000
1.000
1.000
0.997
1.000
0.998
0.998
1.000
1.000
1.000
1.000
0.992
1.000
1.000
0.981
0.998
F1
0.676
0.676
0.677
0.675
0.677
0.678
0.676
0.677
0.678
0.677
0.676
0.678
0.678
0.678
0.688
0.678
D3
AUC
0.507
0.321
0.281
0.572
0.449
0.467
0.293
0.389
0.246
0.347
0.290
0.411
0.447
0.544
0.550
0.408
Acc
0.628
0.699
0.718
0.654
0.619
0.638
0.703
0.599
0.726
0.698
0.713
0.722
0.701
0.676
0.701
0.680
Recall
0.774
0.901
0.928
0.791
0.741
0.822
0.940
0.696
0.956
0.925
0.943
0.925
0.917
0.914
0.883
0.870
Table 2: Benchmark results on the test (unseen) set , grouped by video generator. Abbreviation: RM2 (Realmotion2), SD (SeeDance), JM (Jimeng), PRM (PyramidFlow), SKR (SkyReels), PV (PixVerse)
Figure 9: Model architecture ablations experiment result on test set.
Figure 12
Base
Blur
Comp.
Noise
Acc
0.974
0.955
0.931
0.916
Prec
0.983
0.969
0.976
0.994
Recall
0.965
0.942
0.938
0.841
F1
0.974
0.955
0.956
0.912
AUC
0.997
0.991
0.990
0.988
Table 4: Robustness test for EA-Swin on the validation set
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
Split
Generator
#AI_vids
%in_split
#correspond_real
Published
Train set
train
veo3
5054
13.691
-
7/2025
train
sora2
4857
13.158
-
9/2025
train
cogvideox
4605
12.475
-
3/2025
train
hunyuan
4524
12.256
-
3/2025
train
easyanimate
4199
11.375
-
7/2024
Appendix
Table 5: Dataset composition per generator and split
Following major advances in text and image generation, the video domain has surged, producing highly realistic and controllable sequences. Along with this progress, these models also raise serious concerns about misinformation, making reliable detection of synthetic videos increasingly crucial. Image-based detectors are fundamentally limited because they operate per frame and ignore temporal dynamics, while supervised video detectors generalize poorly to unseen generators, a critical drawback given the rapid emergence of new models. These challenges motivate zero-shot approaches, which avoid synthetic data and instead score content against real-data statistics, enabling training-free, model-agnostic detection. We introduce STALL, a simple, training-free, theoretically justified detector that provides likelihood-based scoring for videos, jointly modeling spatial and temporal evidence within a probabilistic framework. We evaluate STALL on two public benchmarks and introduce ComGenVid, a new benchmark with state-of-the-art generative models. STALL consistently outperforms prior image- and video-based baselines. Code and data are available at https://omerbenhayun.github.io/stall-video.
Omer Ben Hayun, Roy Betser, Meir Yossef Levi +2
Technion – Israel Institute of Technology, Haifa, Israel
Recent advances in generative video models have enabled the synthesis of visually realistic content, posing significant challenges to synthetic video detection. Existing detectors often rely on appearance artifacts, semantic inconsistencies, and temporal patterns that may be generator-specific, limitating generalization to unseen synthesis models. We investigate whether responses to a pretrained generative model provide more transferable forensic cues. Our key observation is that real and AI-generated videos exhibit distinct velocity responses under a pretrained Flow Matching video model. This distinction persists when different pretrained video-generation backbones are used as probes, suggesting that velocity responses offer transferable forensic signals beyond visual artificts. Motivated by this observation, we propose TRACE (Trajectory Representation and Consistency Estimation), a generation-process-aware framework for AI-generated video detection. TRACE leverages a pretrained video DiT as a velocity-field probe to extract representations at multiple flow time points, and models cross-frame consistency through velocity differences between adjacent frames. We further introduce a Real-Centered Trajectory Optimization objective that encourages generator-invariant representation learning. Extensive experiments on AIGVDBench demonstrate that TRACE generalizes effectively across diverse generators, substantially outperforming prior state-of-the-art methods on unseen open- and closed-source video generation models.
Huangsen Cao, Hongkang chu, Siyao Yu +3
Zhejiang University · University of the Chinese Academy of Sciences · Nanjing University of Information Science and Technology +1
AI-generated video detection, which aims to distinguish AI-generated videos from real ones, has recently received increasing research attention. To perform this task reliably, a key challenge lies in accurately identifying subtle-yet-measurable unnatural artifacts. In this work, we address this challenge from a novel perspective of tool-mediated evidence discovery and propose Tool-Using Expert MLLM-based AI-generated Video Detector (TUE-Detector), a novel framework for AI-generated video detection. TUE-Detector trains a general MLLM into a task-tailored tool-using expert detector that learns to invoke suitable tools, collect concrete evidence of unnaturalness, and reason over the evidence for reliable detection. Meanwhile, TUE-Detector further introduces novel designs to equip the expert detector with high-quality and suitable tools. Extensive experiments demonstrate the effectiveness of our framework.
Yichen Wu, Haoxuan Qu, Yongxing Dai +5
University of Nottingham · Lancaster University · Peking University