From Intuition to Investigation: A Tool-Augmented Reasoning MLLM Framework for Generalizable Face Anti-Spoofing
Organizations: SAI, UCAS · MAIS, CASIA · Baidu Inc · CAIR, HKISI, CAS ·
Abstract
Face recognition remains vulnerable to presentation attacks, calling for robust Face Anti-Spoofing (FAS) solutions. Recent MLLM-based FAS methods reformulate the binary classification task as the generation of brief textual descriptions to improve cross-domain generalization. However, their generalizability is still limited, as such descriptions mainly capture intuitive semantic cues (e.g., mask contours) while struggling to perceive fine-grained visual patterns. To address this limitation, we incorporate external visual tools into MLLMs to encourage deeper investigation of subtle spoof clues. Specifically, we propose the Tool-Augmented Reasoning FAS (TAR-FAS) framework, which reformulates the FAS task as a Chain-of-Thought with Visual Tools (CoT-VT) paradigm, allowing MLLMs to begin with intuitive observations and adaptively invoke external visual tools for fine-grained investigation. To this end, we design a tool-augmented data annotation pipeline and construct the ToolFAS-16K dataset, which contains multi-turn tool-use reasoning trajectories. Furthermore, we introduce a tool-aware FAS training pipeline, where Diverse-Tool Group Relative Policy Optimization (DT-GRPO) enables the model to autonomously learn efficient tool use. Extensive experiments under a challenging one-to-eleven cross-domain protocol demonstrate that TAR-FAS achieves SOTA performance while providing fine-grained visual investigation for trustworthy spoof detection.
Figures & tables
| Tools | Results | |
|---|---|---|
| HTER(%) | AUC | |
| ZoomIn Tool | 10.63 | 93.90 |
| ZoomIn + Frequency Tools | 9.55 | 95.40 |
| ZoomIn + Texture Tools | 9.90 | 95.75 |
| ZoomIn + Structure Tools | 8.71 | 96.32 |
| All Tools | 7.54 | 96.67 |
| Training Stage | Results | |||
| KT | FI | RL | HTER(%) | AUC |
| ✓ | 20.79 | 86.43 | ||
| ✓ | 16.80 | 89.65 | ||
| ✓ | ✓ | 13.29 | 91.46 | |
| ✓ | ✓ | 9.23 | 95.11 | |
| ✓ | ✓ | ✓ | 7.54 | 96.67 |
| Backbone | Resize | Results | |
|---|---|---|---|
| HTER(%) | AUC | ||
| Qwen2.5-VL-7B | 9.45 | 95.32 | |
| Qwen2.5-VL-7B | ✓ | 8.60 | 96.08 |
| InternVL3-8B | ✓ | 7.54 | 96.67 |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Methods | O&C&I to M | O&M&I to C | O&C&M to I | I&C&M to O | Avg. | ||||
| HTER(%) | AUC | HTER(%) | AUC | HTER(%) | AUC | HTER(%) | AUC | HTER(%) | |
| FGHV [ 32 ] | 9.17 | 96.92 | 12.47 | 93.47 | 16.29 | 90.11 | 13.58 | 93.55 | 12.88 |
| GDA [ 64 ] | 9.20 | 98.00 | 12.20 | 93.00 | 10.00 | 96.00 | 14.40 | 92.60 | 11.45 |
| PatchNet [ 45 ] | 7.10 | 98.46 | 11.33 | 94.58 | 13.40 | 95.67 | 11.82 | 95.07 | 10.91 |
| SSAN [ 49 ] | 6.67 | 98.75 | 10.00 | 96.67 | 8.88 | 96.79 | 13.72 | 93.63 | 9.82 |
| IADG [ 63 ] | 5.41 | 98.19 | 8.70 | 96.40 | 10.62 | 94.50 | 8.86 | 97.14 | 8.40 |
| Results | ||
|---|---|---|
| HTER(%) | AUC | |
| Fast Answer | 10.54 | 95.06 |
| Reasoning Answer | 7.54 | 96.67 |
| RL | Results | |
|---|---|---|
| HTER(%) | AUC | |
| ST-GRPO [ 61 ] | 9.98 | 94.41 |
| DT-GRPO (Ours) | 7.54 | 96.67 |
Face Presentation Attack Detection
Face Presentation Attack Detection identifies spoofing attempts, such as printed, replayed, masked, or digitally altered faces, targeting face recognition systems.
See all 22 papers