cs.CVNov 9, 2026

MoSTE: Mixture of Spatio-Temporal Experts for Deepfake Detection in Videos

Authors: Charbel Yahchouchi, Nabyl Quignon, Noemi Roggero, Laurent Saroul, Antitza Dantcheva

Organizations: Inria Centre at Université Côte d’Azur · Probayes

Abstract

Generalizable deepfake video detection remains challenging because forgery artifacts vary substantially across manipulation types and often combine diverse spatial and temporal inconsistencies. Existing parameter-efficient adaptation methods typically rely on a single shared representation, rendering them prone to manipulation-specific bias and limiting transfer to unseen forgeries. To address this challenge, we propose Mixture Of Spatio-Temporal Experts (MoSTE), an adaptation framework that enables conditional specialization of forensic representations. Instead of forcing one adapter to model all forgery patterns, MoSTE decomposes adaptation into parallel spatial and temporal expert pools and dynamically routes tokens to the most relevant experts through an unsupervised token-level routing mechanism. This allows experts to naturally specialize in complementary forgery cues without requiring explicit manipulation labels or multi-stage training, while effectively transferring representations from CLIP to the video domain. Extensive experiments across cross-dataset and cross-manipulation benchmarks demonstrate that MoSTE sets a new state of the art in average generalization while preserving strong performance across diverse manipulation families. Additional analysis of expert routing and attention behavior reveals the emergence of expert diversity, suggesting that MoSTE learns complementary spatio-temporal forensic features. Code is available at https://github.com/charbelyah/MoSTE

Figures & tables

Explore similar work

CardsList
  1. Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection

    Mar 2, 2026Jianfeng Liao, Yichen Wei, Raymond Chan Ching Bon +3Deepfake DetectionDigital Image Forensics

  2. DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts

    Aug 24, 2026Vlad Hondru, Florinel Alin Croitoru, Iuliana Georgescu +2Multimodal Deepfake DetectionDeepfake Detection

  3. Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling

    Oct 2, 2026Chahira Benhama, Mohand Saïd Allili, Assia HamadeneVideo ForensicsDeepfake Detection