cs.CVSep 25, 2026

MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning

Authors: Peipei Li, Shuhan Xia, Shengyang Liu, Zekun Li, Ran He

Organizations: Beijing University of Posts and Telecommunications · Minzu University of China · NLPR, Institute of automation, Chinese academy of science, Chinese Academy of Sciences

Abstract

Real-world multimodal misinformation often involves mixed forgery sources, requiring sample-specific detection strategies. Existing tool-augmented methods rely on predefined workflows or inference-time planning, limiting adaptability or increasing inference cost. To address this issue, we introduce MM-VeriAgent, which learns to verify mixed-source multimodal misinformation with tools. We first build MM-VeriTools, a specialized toolkit for misinformation detection agents. By benchmarking various candidate models and methods on the sub-tasks required by mixed-source detection, we select the strongest for textual, visual, and cross-modal forgery analysis and encapsulate them as callable tools with a unified interface. On top of this toolkit, we train the LVLM agent with reinforcement learning to teach it how to use these tools to better solve mixed-source detection. Since many of the tools are specialized models whose online execution at every rollout severely limits RL efficiency, we further introduce Tool-Execution Cache, which pre-executes candidate tool calls and reuses their cached outputs during training. This preserves multi-step rollouts while reducing online tool execution, largely improving the training efficiency.Experiments on MMFakeBench demonstrate substantial accuracy gains over the base model without explicit tool search at inference time. Ablation and efficiency analyses further validate the learned tool-use policy and show that Tool-Execution Cache reduces online tool executions during training.

Figures & tables

Explore similar work

CardsList
  1. ReMMD: Realistic Multilingual Multi-Image Agentic Verification for Multimodal Misinformation Detection

    Jun 23, 2026Chenhao Dang, Dantong Zhu, Jun Yang +2Multimodal AgentsMultimodal Model Evaluation

  2. FactGuard: Agentic Video Misinformation Detection via Reinforcement Learning

    Feb 26, 2026Zehao Li, Hongwei Yu, Hao Jiang +7Automated Fact-CheckingTool Use in VLMs