cs.CVOct 19, 2026

VHA: VQA-based Hallucination Assessment for Generative Image Super-Resolution

Authors: Donghun Ryou, Inju Ha, Jaeyoo Park, Bohyung Han

Organizations: 2IPAI · 1ECE

Abstract

Generative image super-resolution produces visually realistic high-resolution images, but may also introduce hallucinations by adding unsupported content or altering existing details. Because existing super-resolution metrics fail to measure whether generated details remain grounded in the reference image, we present a hallucination assessment technique based on bidirectional visual question answering (VQA), which we term VQA-based Hallucination Assessment (VHA). The proposed approach uses a vision-language model (VLM) to determine whether the semantic content and low-level visual evidence in a super-resolved image are supported by its ground-truth counterpart. To this end, it constructs question--answer pairs from each image and evaluates them on both images. Discrepancies between the resulting scores in both directions reveal missing or altered ground-truth information and unsupported additions. However, obtaining these scores requires computationally expensive VLM inference. We therefore develop VHA+, a learned, lightweight model that directly predicts VHA scores from ground-truth and super-resolved image pairs. We construct a hallucination benchmark, VHA-bench, through a human study and show that both VHA and VHA+ correlate highly with human judgments of hallucination. The code, benchmark, and model weights are available at https://github.com/dhryougit/Hallucination-Assessment

Figures & tables

Explore similar work

CardsList
  1. Detail Continuation over a Trustworthy Coarse Scale for Autoregressive Super-Resolution

    Aug 3, 2026Hongyi Fang, Jiahui Wu, Yichen Yue +2Visual Autoregressive ModelsAutoregressive Image Super-Resolution

  2. VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering

    May 20, 2026Jiayi Chen, Benteng Ma, Zehui Liao +3Hallucination Detection in VLMsHealthcare

  3. Deterministic Hallucination Detection in Medical VQA via Confidence-Evidence Bayesian Gain

    Mar 23, 2026Mohammad Asadi, Tahoura Nedaee, Jack W. O'Sullivan +2Hallucination Detection in VLMsHallucination Detection