cs.CLApr 28, 2026

HIVE: Hidden-Evidence Verification for Hallucination Detection in Diffusion Large Language Models

Authors: Guoshenghui ZhaoTan YuWeijie Zhao

Organizations: Rochester Institute of Technology · NVIDIA Corporation

Abstract

Diffusion large language models generate text through iterative denoising, exposing hidden trajectories that may contain reliability signals beyond the final output. We propose HIVE, which compresses trajectory hidden states, selects informative step-layer evidence, and conditions a verifier through continuous prefix embeddings to produce a hallucination score and structured diagnostics. Across two D-LLMs and three QA benchmarks, HIVE outperforms eight established baselines and a verifier-backbone-matched text-only control in all six settings. Relative to text-only verification, hidden-evidence conditioning improves AUROC by 1.73--4.60 points and AUPRC by 1.10--3.62 points, with average gains of 3.15 and 2.28 points, respectively. Ablations, evidence interventions, and cross-dataset transfer further support the complementary value of fine-grained hidden trajectory evidence.

Explore similar work

CardsList