Temporal Slice Learning for AI-Generated Video Detection with 400 Fewer FLOPs
Organizations: School of Computing and Information Systems, Singapore Management University
Abstract
Recent advances in generative video models have improved visual realism, making detection increasingly dependent on subtle temporal inconsistencies. However, these signals are weak and spatially localized, while most of the video content is redundant. This creates a fundamental mismatch: existing detectors rely on heavy backbones to model full videos, which leads to high computational cost and limited scalability. In this work, we rethink AI-generated video detection from a representation perspective. Instead of modeling entire videos, we restructure them into compact temporal slice representations that isolate informative temporal evolution. We introduce a lightweight framework using frequency-aware temporal slice consistency learning, where informative spatial rows and columns are aggregated over time to form slice-domain inputs. This reparameterization suppresses redundant appearance while preserving discriminative temporal dynamics, enabling efficient and targeted detection. By constructing slices from both high- and low-frequency regions, our method exposes complementary temporal artifacts, including unstable details and abnormal motion smoothness. We instantiate this idea in a Temporal Slice Consistency Network, which integrates task-driven slice localization, hierarchical positional encoding, and a lightweight Transformer to model cross-slice and cross-frequency dependencies. We further introduce AI-Artist, a new benchmark with artist-curated videos from recent high-fidelity generators, including Seedance and Kling. Experiments on GenVideo and AI-Artist show that our method achieves strong performance while requiring over 400 fewer model-forward FLOPs and 3.6 faster model inference than the strong video-based baseline ReStraV (2.9 faster end to end, including preprocessing), enabling scalable and practical deployment.
Figures & tables
| Model | Metric | Dataset | Mean | |||||||||
| Sora | Morph Studio | Gen2 | HotShot | Lavie | Show-1 | Moon Valley | Crafter | Model Scope | Wild Scrape | |||
| MLEP (I) | ACC | 0.1964 | 0.1214 | 0.1340 | 0.2586 | 0.1970 | 0.1429 | 0.0208 | 0.0770 | 0.3614 | 0.1384 | 0.1648 |
| AP | 0.6180 | 0.6324 | 0.7211 | 0.6645 | 0.5559 | 0.6048 | 0.4855 | 0.5815 | 0.7319 | 0.6331 | 0.6229 | |
| AUROC | 0.6116 | 0.6803 | 0.7943 | 0.6187 | 0.6098 | 0.6722 | 0.5580 | 0.6313 | 0.7564 | 0.6714 | 0.6604 | |
| NPR (I) | ACC | 0.5536 | 0.9943 | 0.9970 | 0.7643 | 0.9710 | 0.9957 | 0.9984 | 0.9980 | 0.9829 | 0.7299 | 0.8985 |
| AP | 0.8434 | 0.9971 | 0.9920 | 0.9122 | 0.9893 | 0.9898 | 0.9977 | 0.9985 | 0.9854 | 0.8892 | 0.9595 | |
| Model | Params | GFLOPs | Inference Time (ms) | Real-video FP | |||||
| Prep. | Model | Total | Prep. | Model | Total | #FP | FPR (%) | ||
| MLEP (I) | 1.441 M | 0.012 | 14.35 | 14.362 | 7.975 | 5.998 | 13.973 | 422 | 4.22 |
| NPR (I) | 1.438 M | 0.012 | 14.01 | 14.022 | 5.495 | 2.185 | 7.680 | 1,387 | 13.87 |
| VIBAIGCD (I) | 430.0 M | 0.012 | 415.2 | 415.212 | 8.322 | 30.50 | 38.822 | 4,813 | 48.13 |
| AIDE (I) | 897.8 M | 1.131 | 225.7 | 226.831 | 68.972 | 20.58 | 89.552 | 972 | 9.72 |
| TALL (V) | 86.92 M | 0.012 | 15.21 | 15.222 | 4.903 | 9.496 | 14.399 | 6,949 | 69.49 |
| Method | GenVideo | AI-Artist | ||
| mAP | mAUROC | mAP | mAUROC | |
| Select Patch | 0.9871 | 0.9846 | 0.9644 | 0.9684 |
| Resize | 0.9919 | 0.9893 | 0.9541 | 0.9365 |
| Only Row | 0.9965 | 0.9958 | 0.9735 | 0.9762 |
| Only Column | 0.9969 | 0.9960 | 0.9815 | 0.9784 |
| 1-Seg. MP | 0.9904 | 0.9879 | 0.9808 | 0.9807 |
Appendix figures & tables18 assets
Supplementary material from the paper’s appendix.
Appendix
| Collection Protocol | Sub-dataset | #Videos | Duration | Resolution | Frame Rate |
| Web-Collection | Seedance (Film) | 55 | 0.5–15s | – | 24–60 fps |
| Kling 3.0 | 46 | 1–15s | – | 24–30 fps | |
| AI_artists | 120 | 1–8s | – | 24–30 fps | |
| Self-Generation | Runway Gen-4.5 | 40 | 5s | 720p | 24 fps |
| PixVerse V5.6 | 40 | 3s | 720p | 24 fps | |
| Hailuo 2.3 | 35 | 5s | 24 fps |
| Model | Metric | AI-Artist | Mean | |||||||
| Seedance (Film) | Seedance | Kling | Runway | PixVerse | Hailuo | Luma | AI_artists | |||
| MLEP (I) | ACC | 0.0926 | 0.0000 | 0.1522 | 0.1000 | 0.1795 | 0.0000 | 0.0000 | 0.0083 | 0.0666 |
| AP | 0.4942 | 0.5377 | 0.5361 | 0.5544 | 0.6382 | 0.5345 | 0.6031 | 0.3387 | 0.5296 | |
| AUROC | 0.4781 | 0.6168 | 0.4920 | 0.5262 | 0.6220 | 0.4971 | 0.5900 | 0.1622 | 0.4980 | |
| NPR (I) | ACC | 0.4444 | 0.1471 | 0.8696 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.3750 | 0.7295 |
| AP | 0.7717 | 0.6426 | 0.9342 | 0.9882 | 0.9929 | 0.9949 | 1.0000 | 0.6768 | 0.8752 | |
| Method | GenVideo | AI-Artist | Time | ||||
| ACC | mAP | mAUROC | ACC | mAP | mAUROC | (ms) | |
| Raw Temporal Slice | 0.9651 | 0.9970 | 0.9962 | 0.8618 | 0.9775 | 0.9763 | 1.426 |
| 1st-order Diff Slice | 0.9658 | 0.9969 | 0.9955 | 0.8638 | 0.9745 | 0.9757 | 1.460 |
| 2nd-order Diff Slice | 0.9635 | 0.9939 | 0.9906 | 0.8520 | 0.9691 | 0.9562 | 1.465 |
| Select Patch | 0.9164 | 0.9871 | 0.9846 | 0.8536 | 0.9644 | 0.9684 | 1.414 |
| Resize | 0.9323 | 0.9919 | 0.9893 | 0.8297 | 0.9541 | 0.9365 | 1.463 |
| Method | GenVideo | AI-Artist | Prep. | Model | ||||
| ACC | mAP | mAUROC | ACC | mAP | mAUROC | (ms) | (ms) | |
| 1-Seg. MP | 0.9375 | 0.9904 | 0.9879 | 0.8903 | 0.9808 | 0.9807 | 4.668 | 1.451 |
| 4-Seg. | 0.9785 | 0.9982 | 0.9977 | 0.9125 | 0.9849 | 0.9836 | 8.908 | 1.522 |
| Ours (1-Seg.) | 0.9698 | 0.9973 | 0.9967 | 0.8558 | 0.9805 | 0.9773 | 3.198 | 1.478 |
| Stage | Time (ms) | GFLOPs |
| Temporal-window/key-frame selection and grayscale processing | 0.796 | 0.0415 |
| Frequency-aware patch selection | 1.652 | 0.0230 |
| Temporal-slice and difference construction | 0.750 | 0.0136 |
| Preprocessing subtotal | 3.198 | 0.0781 |
| Model forward | 1.478 | 0.109 |
| Full pipeline | 4.676 | 0.187 |
| Method | TN | FP | FPR (%) | Specificity (%) |
| MLEP (I) | 9,578 | 422 | 4.22 | 95.78 |
| NPR (I) | 8,613 | 1,387 | 13.87 | 86.13 |
| VIBAIGCD (I) | 5,187 | 4,813 | 48.13 | 51.87 |
| AIDE (I) | 9,028 | 972 | 9.72 | 90.28 |
| TALL (V) | 3,051 | 6,949 | 69.49 | 30.51 |
| XCLIP (V) | 3,494 | 6,506 | 65.06 | 34.94 |
Deepfake Detection
Deepfake detection identifies manipulated or AI-generated media to support trustworthy communication, identity verification, and forensic analysis.
See all 240 papers