cs.CLAug 5, 2026

When Absence Is Evidence: Evaluating Completeness-Sensitive Negative Reasoning in Large Language Models

Authors: Byoungjae MinKennedy EdemacuSae-Hong ChoYoonhyuk ChoiBeakcheol JangJong Wook Kim

Organizations: Department of Computer Science, Sangmyung University, Seoul, Republic of Korea · College of Staten Island, The City University of New York, New York, NY, USA · School of Computer Engineering, Hansung University, Seoul, Republic of Korea · Sookmyung Women’s University, Seoul, Republic of Korea · Graduate School of Information, Yonsei University, Seoul, Republic of Korea

Abstract

Large language models (LLMs) are often asked whether something is absent from a record, list, or retrieved context. Yet non-observation licenses a negative answer only when evidence completely covers the query scope; otherwise, the answer should remain unknown. We call this completeness-sensitive negative reasoning. We introduce CROWN-QA, comprising CROWN-Synth, a controlled paired core that fixes the question and observed facts while varying only query-relative coverage, and CROWN-Real, a real-document contrast-set evaluation with controlled coverage variants. Across three LLM families, models show unstable closure judgments and substantial over-closure, failing to reliably distinguish a justified negative answer (Certified-Negative) from insufficient evidence (Unknown). The dominant CROWN-Synth failure is asymmetric: models often recognize implicitly complete evidence yet treat implicitly partial evidence as query-covering. Prompting redistributes errors between over- and under-closure rather than consistently resolving them. Structured certificate elicitation traces many errors to evidence-coverage mischaracterization. CROWN-Real shows that the core partial-coverage asymmetry persists on real-document content, while its strength and the balance between over- and under-closure vary by model, prompt, and source.

Explore similar work

CardsList
  1. How Language Models Process Negation

    May 4, 2026Zhejian Zhou, Tianyi Zhou, Robin Jia +1NegationLarge Language Model Performance