What Does Anti-Hallucination Training Buy? Saying Less, Cheap Pruning, and the Rest
Organizations: Key Laboratory of Computing Power Network and Information Security, Ministry of Education Shandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Abstract
Preference training is the standard recipe for reducing object hallucination in vision-language models, and each new method reports a lower CHAIR score. We ask what that reduction consists of. Every trained system is compared with its base model's caption truncated to the same object recall, which removes the part of the gain that comes from saying less; the remainder is compared with what a deliberately weak, frozen, eleven-feature post-hoc probe fitted on 500 annotated images can reproduce. All criteria were specified in the analysis code and frozen before the outputs they judge existed. For eight public methods on LLaVA-1.5-7B, the probe reproduces at least two thirds of what training removes beyond saying less for 7 of 8 methods on COCO, 8 of 8 on AMBER and 6 of 8 on Object HalBench, with RLAIF-V the consistent exception; a later public method released for both LLaVA-1.5 and Qwen2.5-VL (SENTINEL) meets the same bar on both. On our own DPO checkpoints the accounting holds on Qwen2.5-VL but fails on InternVL2.5 on COCO (2 of 4 training designs). At matched recall, the base model plus the probe beats truncation for 8 of 9 LLaVA-1.5 systems on COCO and 9 of 9 on AMBER, on the two newer backbones, and when realized as actual sentence deletion. The same measure prices training signals: DPO on the model's own samples labelled by the probe or by an object-level CLIP score recovers 0.70 and 0.87 of the beyond-brevity gain of ground-truth-labelled DPO on Qwen2.5-VL (the probe 0.73 on InternVL2.5), both beat length-matched random labels, and CLIP labels buy more than probe labels on COCO. Human judgements show that the sentences the probe deletes are wrong more often than those truncation would delete; a human check of the CHAIR evaluator's precision falls below our pre-set bar, which we report as a limitation.
Figures & tables
| COCO held-out (1500 images) | AMBER | OHB | |||||
| method | share | share | share | ||||
| RLAIF-V | 780 | 1021 | 1192 | 0.59 | 0.83 | 0.62 | |
| HA-DPO | 461 | 686 | 738 | 0.81 | 1.48 | 0.75 | |
| OPA-DPO | 933 | 1142 | 1232 | 0.70 | 0.84 | 0.74 | |
| EOS | 452 | 671 | 741 | 0.76 | 1.40 | 0.68 | |
| HALVA | 274 | 457 | 489 | 0.85 | 2.01 | 0.73 | |
| system | full recall | COCO | AMBER | OHB |
|---|---|---|---|---|
| LLaVA-1.5-7B | 79.7 | |||
| RLAIF-V | 65.9 | |||
| HA-DPO | 75.6 | |||
| OPA-DPO | 56.1 | |||
| EOS | 76.9 | |||
| HALVA | 79.9 |
| backbone | labels | mean | recovery | vs. matched random |
|---|---|---|---|---|
| Qwen2.5-VL-7B | GT | 1 | ||
| probe | (P1 PASS) | (P2 ′ PASS) | ||
| CLIP | (C2 PASS) | (C3, secondary) | ||
| matched random | ||||
| probe CLIP: (C1, two-sided): CLIP labels buy more | ||||
| InternVL2.5-8B | GT | 1 | ||
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| analysis | criterion | bar | outcome | doc. |
|---|---|---|---|---|
| LLaVA, COCO, 5 methods | P1 accounting | share for | PASS (4/5) | B |
| P2 strong baseline | CI for | PASS (6/6) | B | |
| Qwen2.5-VL base | P4 strong baseline | CI | PASS ( ) | B |
| P6 sentence deletion | CI | PASS ( ) | B | |
| LLaVA, 3 added methods, batch | E1 accounting | share for | PASS (3/3) | B |
| E2 strong baseline | CI for | PASS (3/3) | B |
Object Hallucination in VLMs
Object hallucination in vision-language models is the production of object claims unsupported by visual evidence.
See all 137 papers