cs.CVNov 16, 2026

AnachroBench: Evaluating Historical Consistency in Large Vision-Language Models

Authors: Keunhyeung Park, Byeonggeuk Lim, Kahyeon Kim, Sunhee Jo, Hayeong Ryu, Hoejoon Kwon, Jinhee Jang, YoungBin Kim

Organizations: Department of Artificial Intelligence, Chung-Ang University · Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University

Abstract

Existing Large Vision-Language Model benchmarks primarily evaluate visual understanding in general everyday scenarios, leaving historical consistency with a specified era and country largely underexplored. To address this gap, we propose AnachroBench, a controlled discriminative benchmark for evaluating historical consistency in visual scenes. It contains 1,600 image pairs from eight countries spanning the late 19th to the early 20th century, each pairing an original historical image with an anachronistic version containing a seamlessly inserted modern object. AnachroBench evaluates three aspects: Inserted Object Perception, which tests whether models detect the inserted modern object; Era-Country Consistency, which assesses whether the scene is consistent with the specified era and country; and Conditional Era-Country Consistency, which measures consistency judgments only when the inserted object is correctly perceived. A false consistency judgment occurs when a model perceives the modern object but still judges the scene as historically consistent. Overall, AnachroBench reveals a gap between inserted object perception and era-country consistency judgments, providing a targeted evaluation of this behavior.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. On the Cultural Anachronism and Temporal Reasoning in Vision Language Models

    May 14, 2026Mukul Ranjan, Prince Jha, Khushboo Kumari +1VLM EvaluationVLM Reasoning

  2. What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

    Aug 24, 2026Marek Hradil, Danae Sánchez VillegasTemporal Reasoning in VLMsVLM Evaluation

  3. Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT

    Jun 15, 2026Parthaw Goswami, Jaynto Goswami DeepVLM EvaluationTemporal Reasoning