Beyond Risk Cues: A Mechanism-Level Benchmark and Verifiable Debate for Scam Video Detection on the Web
Organizations: People’s Public Security University of China Beijing, China · Dalian University of Technology Dalian, China · Microsoft China · Beihang University Beijing, China ·
Abstract
Online scam videos pose significant threats to individuals and society. Existing studies primarily focus on binary classification, offering limited insights into how scams work and the reasoning behind detection decisions. Moreover, they often overlook the challenge of distinguishing scam videos from superficially similar non-scam content, such as advertisements, and the robustness of detection models against misleading arguments. These limitations hinder reliable scam video detection. To address these limitations, we introduce MechScam, a benchmark comprising 6,614 videos covering diverse scam mechanisms and non-scam categories. MechScam provides explanations supported by video evidence, annotations of potential scam elements and their context, and misleading arguments constructed from genuine evidence. Recognizing that genuine evidence can still be used to justify misleading conclusions, we further propose ScamCourt, a debate framework in which trained prosecution and defense debaters present opposing arguments, while a trained judge makes decisions based on a transcript with verified citations. Extensive experiments show that state-of-the-art MLLMs struggle to distinguish scam videos from similar non-scam content. ScamCourt outperforms larger MLLMs and same-backbone fine-tuned baselines, reducing false positives and showing stronger resistance to misleading arguments. Together, MechScam and ScamCourt contribute to more reliable and interpretable scam video detection. The dataset and code are available at https://github.com/SuperYFan/MechScam.
Figures & tables
| ID | Category | Description | Videos |
| S01 | Reward Claims | Claims free rewards, gift cards, or game assets in exchange for participation. | 214 |
| S02 | Trading Bots | Promises returns from trading bots or automated trading contracts that viewers authorize. | 363 |
| S03 | Platform Investments | Promises investment, lending, or staking returns on funds deposited with a platform. | 325 |
| S04 | Mining and Nodes | Promises returns from purchased mining capacity, mining packages, or node participation. | 448 |
| S05 | Token Investments | Promotes token purchases with promises of appreciation or holding-based dividends. | 327 |
| S06 | Recruitment Commissions | Promises commissions tied to recruiting others, downlines. | 507 |
| Detection | Misled rate | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Model | Acc | Macro-F1 | Scam P | Scam R | FPR | FPR hard | 12-way F1 | Single | Full |
Video Content Moderation
Video content moderation detects and explains harmful, misleading, or policy-violating material in videos, including its visual, audio, and temporal context.
See all 26 papers