LLM Answer Verification

LLM: Large Language Model

Overview

The field studies how to check an LLM’s answers, reasoning steps, citations, and evidence before accepting, revising, or abstaining from them. Approaches include retrieval and natural-language inference for evidence checking, symbolic tools and proof assistants for formal tasks, learned reward models for ranking candidate answers, and self- or cross-model review. These methods are tested in settings such as mathematical reasoning, multi-hop question answering, long-document and medical QA, and code or SQL generation, using benchmarks including MATH, GPQA, HotpotQA, FEVER, and BIRD. A central challenge is that verifiers can share a generator’s blind spots or reject valid answers, so accuracy must be balanced against calibration, evidence coverage, cost, and the risk of harmful revisions.

Latest papers

CardsList

157 papers10 papers in the last four weeks, down 44% on the four weeks before. 0.1% of all new papers.

  1. Understanding the Effects of Multi-Agent Deliberation for Human-AI Decision-Making

    Nov 11, 2026Harry Yizhou Tian, Ming YinHuman-AI Decision MakingMulti-Agent Deliberation

  2. Signals, Evidence, and Context: User Scrutiny in Real-World LLM Conversations

    Nov 5, 2026Ahana Biswas, Yu-Ru LinLLM Answer VerificationLLM Reliability

  3. When Self-Verification Hurts: Calibrated Answer Repair for Financial Question Answering

    Nov 3, 2026Celine Guo, Weida Liang, Yujian Fu +4Question AnsweringFinancial QA

  4. Less but Sufficient: Relation Knowledge Selects Compact Knowledge-Graph Contexts, and What External Checks Can and Cannot Catch

    Nov 1, 2026Seunghui Jwa, Minsu Oh, Sangwoo Hong +1Knowledge Graph Question AnsweringKnowledge Retrieval in Language Models

  5. What Do LLM Judges Actually Verify? Matched Controls and Record Gaps for Document Currency

    Oct 31, 2026Unnati Shah, Samruddhi Kakade, Aum PatelLLM Answer VerificationLLM-as-a-Judge

  6. What Does an Ontology Catch? Curated, LLM-Generated and Data-Derived Ontologies as Checkers of LLM Agents over Knowledge Graphs

    Oct 27, 2026Michal Orzechowski, Rund Tawfiq, Tomasz KosciolekLLM Answer VerificationLLM Agent Evaluation

  7. Ask Before You Answer: A Question-Driven Evidence Reasoning Architecture (QERA) for In-Context Learning

    Oct 26, 2026Jinhu Qi, Minda Hu, Wentao Zhang +2Evidence-Grounded QAImplicit Reasoning in Language Models

  8. Recognizing Study Lineage Is Not Enough: Over-Crediting Same-Trial Evidence in LLM-Based Medical Verification

    Oct 16, 2026Mukand Krishna, Anoushka Harit, Chenghao Xiao +1LLM ReliabilityLLM Answer Verification

  9. VIGIL: Verifier-Informed Gated Improvement Loop for Spreadsheet Question Answering

    Oct 3, 2026Kang Li, Lu He, Sandarsita GuntupalliTable QAContinual Learning for LLM Agents

  10. JOVE: Joint Execution and Verification for Resource-Aware LLM Task Graphs

    Oct 2, 2026Haoran Zhang, Dongjun Kim, Seohyeon Cha +4LLM Inference SchedulingLLM Routing

  11. Halluscoring 2026: The first shared task on llms hallucination detection and answer verification

    Sep 29, 2026Aisha Alansari, Abdessalam Bouchekif, Ahmed Hasanaath +9LLM EvaluationLLM Answer Verification

  12. Locating Answer-Correctness Signals in Frozen Large Language Models

    Sep 29, 2026Yuansen Liu, Yixuan Tang, Anthony Kum Hoe TungLLM Answer VerificationLanguage Model Error Detection

  13. Test-Time Scaling via Budgeted Multi-Attribute Verification

    Sep 28, 2026Bo Xue, Ji Cheng, Shen-Huan Lyu +2Multi-Armed BanditsLLM Answer Verification

  14. Risk-Controlled Selective LLM Answering by Pricing Label-Free Checks

    Sep 27, 2026Dongyub Jude Lee, Jungseob Lee, Chanjun Park +2LLM Answer VerificationSelective Prediction

  15. Knowing Is Not Choosing: What Explicit Verification Adds Beyond Generative Preference

    Sep 27, 2026Yilong Li, Chengpo Yan, Aayan Arish +1LLM EvaluationLLM Answer Verification

  16. Can You Check That? The Checkability Boundary for Local LLM Network Automation

    Sep 25, 2026Maleeha Masood, Momina NofalLLM Answer VerificationLLM Routing

  17. Where Does Retrieval-Based Open-Ended Evaluation Fail? Automatic Taxonomy Induction from Long-Form Medical Answer Factuality Verification

    Sep 24, 2026Heyuan Huang, Jirui Dai, Alexandra DeLucia +5LLM Answer VerificationRAG Evaluation

  18. Return or Revise? Learning When Revision Helps Retrieval-Augmented QA

    Sep 24, 2026Nicholas Kashani Motlagh, Tim Anderson, Jeremy Gwinnup +1Retrieval-Augmented GenerationLLM Answer Verification

  19. Cross-Lingual Legal QA for Vietnamese Labour Law: Retrieval, Translation, and Verifier-Guided Correction

    Sep 23, 2026Nguyen Minh Chi, Mo El-Haj, Nguyen Ha Thanh +2LLM Answer VerificationLegal Citation Verification

  20. Human-LLM Deliberation as Interactive Proof: Conditions for Verifiability Without Transparency

    Sep 21, 2026Baotong Zhang, Dean Foster, João SedocLLM Answer VerificationAnytime-Valid Inference

  21. From Tables to Quantified Statements: Evaluating LLM Inference Generation through Executable Verification

    Sep 21, 2026Mai Mohamed Eida, Gunjan Anand, Ayush Singh +1Table QALLM Evaluation

  22. LLM-as-an-Improver: Turning Verification into Better Candidates

    Sep 17, 2026Akiyoshi Tomihari, Yuma IchikawaLLM Answer VerificationLLM Reranking