Multimodal Deception Detection

Follow this topic Ask about this topic

Latest papers

19 papers2 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

ModalFidelity: Routing Modalities for Deepfake Detection on a Budget
Sep 29, 2026Oguzhan Baser, Kaan Kale, Sriram Vishwanath +1Multimodal Deepfake Detection Deepfake Detection
The University of Texas at Austin, Austin, TX, USA · Georgia Institute of Technology, Atlanta, GA, USA
MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning
Sep 25, 2026Peipei Li, Shuhan Xia, Shengyang Liu +2Multimodal Deception Detection Multimodal Tool Use
Beijing University of Posts and Telecommunications · Minzu University of China · NLPR, Institute of automation, Chinese academy of science, Chinese Academy of Sciences
Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulation
Aug 8, 2026Yichun Yeh, Yiheng Li, Xiaobo Hu +2Multimodal Grounding Digital Forensics
MAIS, CASIA; SAI, UCAS · SAI, UCAS; MAIS, CASIA
Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation
Jul 29, 2026Xuan Feng, Guihong Liu, Tianlong Gu +5Fake News Detection Domain Generalization
1Jinan University · 2Guilin University of Electronic Technology · 3Nanyang Technological University +1
Catching Lies Without Sending the Video: Privacy-Preserving Multimodal Deception Detection
Jun 21, 2026Nikita Sharma, Pranav Sara, Karan SinglaPrivacy-Preserving ML Multimodal Deception Detection
University of California, San Diego · Case Western Reserve University, Ohio · WhissleAI, USA
ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection
Jun 17, 2026Jinhao Song, Shan Liang, Yiqun Yue +2RL for Language Model Reasoning Multimodal Large Language Models
Xi’an Jiaotong-Liverpool University · Suzhou, China
DeceptionX: Explainable Deception Detection with Multimodal Large Language Models
Jun 9, 2026Jiayu Zhang, Shuo Ye, Jiajian Huang +7Multimodal Large Language Models Multimodal Reasoning
Great Bay University Dongguan, Guangdong, China · Hong Kong Polytechnic University HongKong, China
IDO: Incongruity-aware Distribution Optimization for Multimodal Fake News Detection
Jun 2, 2026Hengyang Zhou, Rongman Hong, Yuxuan Zhou +2Fake News Detection Multimodal Deception Detection
Nanjing University · University of Birmingham · East China Normal University +1
CORE: Conflict-Oriented Reasoning for General Multimodal Manipulation Detection
Jun 2, 2026Jinjie Shen, Yaxiong Wang, Yujiao Wu +5Fake News Detection Multimodal Large Language Models
School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China · Wuhan University, Wuhan, China · Lab for Intelligence and visiON (LION) +2
REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection
May 27, 2026Jun Zhou, Bingwen Hu, Yaxiong Wang +4Multimodal Grounding Image Forgery Detection
Attribution-Guided Multimodal Deepfake Detection via Cross-Modal Forensic Fingerprints
Apr 29, 2026Wasim Ahmad, Wei Zhang, Xuerui MaoAudio Deepfake Detection Cross-Modal Representation Learning
School of Interdisciplinary Science, Beijing Institute of Technology, Beijing 100081, China
Dynamic Emotion and Personality Profiling for Multimodal Deception Detection
Apr 18, 2026Li Zheng, Yanyi Luo, Hao Fei +5Multimodal Emotion Recognition Uncertainty-Aware Multimodal Fusion
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan, China · National University of Singapore, Singapore, Singapore
SVC 2026: the Second Multimodal Deception Detection Challenge and the First Domain Generalized Remote Physiological Measurement Challenge
Apr 7, 2026Dongliang Zhu, Zhiyi Niu, Bo Zhao +14Multimodal Deception Detection Remote Photoplethysmography
Wuhan University · Hefei University of Technology · Great Bay University +4
MuDD: A Multimodal Deception Detection Dataset and GSR-Guided Progressive Distillation for Non-Contact Deception Detection
Mar 27, 2026Peiyuan Jiang, Yao Liu, Yanglei Gan +4Multimodal Deception Detection Cross-Modal Knowledge Distillation
School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China · School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China · Yizhou Prison, Sichuan Province, Chengdu, Sichuan, China
DecepGPT: Schema-Driven Deception Detection with Multicultural Datasets and Robust Multimodal Learning
Mar 25, 2026Jiajian Huang, Dongliang Zhu, Zitong YU +4Multimodal Robustness Cross-Domain Generalization
Great Bay University, China · Wuhan University, China · Dongguan Key Laboratory for Intelligence and Information Technology, China +1
Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detection
Mar 2, 2026Yuchen Zhang, Yaxiong Wang, Kecheng Han +4Multimodal Deception Detection Explainable Deepfake Detection
School of Software Engineering, Xi’an Jiaotong University · School of Computer Science and Information Engineering, Hefei University of Technology · CSIRO +2
Leveraging large multimodal models for audio-video deepfake detection: a pilot study
Feb 25, 2026Songjun Cao, Yuqi Li, Yunpeng Luo +2Multimodal Deepfake Detection Deepfake Detection
Tencent YouTu Lab, China · Tencent Youtu Lab, China · Fudan University, China
Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision
Feb 23, 2026Kartik Kuckreja, Parul Gupta, Muhammad Haris Khan +1Deepfake Detection Explainable Deepfake Detection
MBZUAI · Monash University *
Can MLLMs Read the Room? A Multimodal Benchmark for Assessing Deception in Multi-Party Social Interactions
Nov 20, 2025Caixin Kang, Yifei Huang, Liangyang Ouyang +3Multimodal Deception Detection Deception in Language Models
The University of Tokyo

Sep 29, 2026J/K move · Enter open · S save

ModalFidelity: Routing Modalities for Deepfake Detection on a Budget

Oguzhan Baser, Kaan Kale, Sriram Vishwanath, Sandeep Chinchali

The University of Texas at Austin, Austin, TX, USA · Georgia Institute of Technology, Atlanta, GA, USA

Multimodal Deepfake Detection Deepfake Detection Video Forensics Multimodal Deception Detection

Open paper AskPDF arXiv

Deepfakes no longer need to fake a whole video. Generators that read the transcript now alter only the few seconds in which a video's meaning turns, so a forgery hides in a small, unknown fraction of the video. Yet detectors still read every one-second window of both the audio and image streams, spending nearly all of their compute where nothing was altered. We observe that deciding where to look is far cheaper than looking. We present ModalFidelity, a lightweight router that previews each window and decides, before any forensic detector runs, which stream is worth reading, under a hard compute budget it can never exceed. On AV-Deepfake1M, reading at most a fifth of the windows, it is more accurate than gating after the detectors at 15.9x less compute, and retains over 96% of the accuracy of an oracle that knows where every forgery lies.