Steering the Verifiability of Multimodal AI Hallucinations

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse tasks, they suffer from hallucinations where generated outputs contradict or misrepresent input semantics. Existing research typically addresses hallucination detection within a single modality or task type, limiting generalizability. We introduce OmniHallu, a unified hallucination detection framework spanning both comprehension and generation tasks across image, video, and audio modalities. We contribute OmniHallu-Bench, a 10,000-sample benchmark with claim-level human annotations covering six cross-modal tasks: image-to-text (I2T), video-to-text (V2T), audio-to-text (A2T), text-to-image (T2I), text-to-video (T2V), and text-to-audio (T2A). Our multi-agent architecture decomposes model outputs into atomic claims, verifies them through modality-specific experts, and aggregates evidence via structured reasoning. We further propose a preference-optimized trainable verifier that approximates the multi-agent decision boundary, reducing expert calls by 66% with minimal performance loss. Extensive experiments reveal a consistent modality-dependent performance gradient and provide fine-grained insights into cross-modal hallucination patterns.

Although Multimodal Large Language Models have achieved strong performance across a wide range of vision-language tasks, they still suffer from hallucinations, where model outputs become inconsistent with the visual content, textual context, or commonsense knowledge. Existing studies primarily address this problem through coarse-grained detection. However, these approaches often provide insufficient diagnostic information for understanding hallucination types and supporting downstream hallucination mitigation. To bridge this gap, we propose fine-grained hallucination diagnosis for MLLMs, a new unified task that jointly performs hallucination detection, classification, and interpretable explanation generation. We develop an automated data generation pipeline and construct HalluScope-30K, a large-scale diagnostic dataset covering eight sources and five task categories. Based on this dataset, we design a multi-granular joint reward function and train two diagnosis models, HalluScope-4B and HalluScope-8B, which achieve state-of-the-art performance on both the MHALO benchmark and our fine-grained hallucination classification benchmark. Notably, detection and classification are mutually beneficial under joint optimization. Furthermore, diagnosis-driven feedback experiments show that the fine-grained diagnostic explanations produced by our model effectively guide target models to correct their hallucinations, with full diagnosis substantially outperforming all baselines on both Qwen3-VL-8B-Instruct and LLaVA-1.5-7B. Our code, data, and models are available at https://github.com/wkinglin/HalluScope.

Hallucinations in multimodal large language models (MLLMs), where a model generates content inconsistent with the input image, pose significant risks in real-world applications. Existing hallucination benchmarks primarily test recognition, i.e., whether a model can select the correct answer among distractors. They overlook another capability that is essential for trustworthy AI: recognizing when none of the provided options is supported by the image and declining to commit to a false choice. We present HumbleBench, a hallucination benchmark that evaluates this false-option rejection behavior, a directly observable facet of epistemic humility, through multiple-choice questions that always include a "None of the above" (NOTA) option. HumbleBench is built from the Panoptic Scene Graph dataset: its object and relation annotations, together with candidate attribute cues, are used to prompt GPT-4-Turbo to generate questions, which are then manually verified, yielding 22,831 questions on object, relation, and attribute hallucinations. We evaluate 27 MLLMs, including general-purpose, reasoning-oriented, and proprietary models, and complement standard accuracy with NOTA-aware metrics, diagnostic stress tests, and a human evaluation. Even the strongest models select NOTA for only about half of the questions in which it is correct, cautious prompting shifts models toward NOTA without improving their ability to detect unsupported options, and humans reject unsupported options considerably more reliably than all evaluated models. These results show that recognition accuracy alone is insufficient for assessing hallucination robustness. Our code and dataset are publicly available at https://github.com/maifoundations/HumbleBench.