LLM Answer Verification

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

17 papers in the last four weeks, up 113% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 102

All topics

Agreement Before Diversity: Verification-First Complementarity for Heterogeneous Language-Model Coordination
Aug 5, 2026Ruitong Li, Binjie Guo, Aisheng Mo +3LLM Evaluation LLM Answer Verification
1The University of Hong Kong · Zhejiang University · 3Independent Researcher
Detecting Hallucinations and Recovering Verified Answers in Arabic Islamic Question Answering
Aug 4, 2026Khaled ZianiLLM Answer Verification Question Answering
Independent Researcher, Paris, France
VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations
Aug 4, 2026Ivan Kartáč, Jan Tovarys, Mateusz Lango +1LLM Answer Verification Factual Consistency Evaluation
PrimVeterinary · Institute of Formal and Applied Linguistics, Charles University
Right Answer, Wrong Method: Shortcut Hacking Misleads the Evaluation of LLM Reasoning on Frontier Science Benchmarks
Aug 3, 2026Xuan Ren, Weiqi Zhai, Tianle Pu +4LLM Answer Verification Reasoning Evaluation
1Alibaba Group · 2Alibaba DAMO Academy
Verification Without Sufficiency: Per-Chunk Filtering Fails on Multi-Hop RAG, and Decomposition Repairs It
Aug 1, 2026Randhir KumarMulti-Hop QA LLM Answer Verification
Independent Researcher
AMTFV: Agentic Mathematical Tool-Flow Verification for LLM Self-Correction
Jul 31, 2026Rui Zou, Yutao Zhu, Mengqi Wei +1LLM Self-Correction LLM Answer Verification
Gaoling School of Artificial Intelligence, Renmin University of China · National Engineering Research Center of Educational Big Data, Central China Normal University
Accuracy Hides How Language Models Fail: Measuring Failure States Under Matched Output Budgets
Jul 27, 2026Zongyou Yang, Yinghan HouLLM Evaluation LLM Answer Verification
Dyson School of Design Engineering Imperial College London London, United Kingdom · Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom
HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answering
Jul 22, 2026Abdessalam Bouchekif, Mohammed-En-Nadhir Zighem, Salah Eddine Bekhouche +9Arabic NLP LLM Answer Verification
Hamad Bin Khalifa University, Qatar · University of the Basque Country, Spain · University of Biskra, Algeria +2
Verify, Repair, Repeat, or Stop? Robust Stopping for Noisy Verify-Repair Loops in LLM Agents
Jul 20, 2026Yitao Wu, Si Shen, Rui Yang +2AI Agent Reliability LLM Self-Correction
saofund.ai, Shenzhen, China · Shenzhen Xingqing Zhiti Technology Co., Ltd., Shenzhen, China · School of Information Technology and Engineering, Lanzhou University, Lanzhou, China
SIRIN: A Unified Toolkit for Detecting Contextual Hallucinations in Retrieval-Augmented and Memory-Grounded LLM Systems
Jul 20, 2026Julia Belikova, Rauf Parchiev, Mikhail Filimonov +3Retrieval-Augmented Generation LLM Answer Verification
Sber AI Lab
Oracle Gap and Signal Fidelity: A Fixed-Pool Diagnostic for Test-Time Collaboration
Jul 20, 2026Jie HuLLM Evaluation LLM Answer Verification
Research Institute of China Telecom
Grounded verification of chemical and materials reasoning: detection is the bottleneck
Jul 19, 2026Can Polat, Mustafa Kurban, Erchin Serpedin +1LLM Self-Correction LLM Grounding
Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA · Department of Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, Qatar · Department of Prosthetics and Orthotics, Ankara University, Ankara, Turkey +1
Where Does Agent Reliability Come From? A Cross-Benchmark Decomposition of Verification Loops, Specialist Models, and Scaffolding in a Production Enterprise Agent
Jul 19, 2026Arunabh DastidarAI Agent Reliability LLM Answer Verification
for the Leni Team · Leni Inc.
Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilings
Jul 15, 2026Jiangang HanLatent Variable Models LLM Answer Verification
Independent researcher
STEC: Evidence Compression for Deep Search in Open-domain Multi-Hop QA
Jul 12, 2026Xinkang Li, Rong Jiang, Xin Song +3Multi-Hop QA LLM Answer Verification
National University of Defense Technology, China · Harbin Institute of Technology, Shenzhen, China
One Token Is Enough: Fingerprinting and Verifying Large Language Models from Single-Token Output Distributions
Jul 11, 2026Tomas BrucknerLLM Answer Verification LLM Auditing
Faculty of Informatics and Statistics, Prague University of Economics and Business, Prague, Czech Republic
LLMs as a Jury: Cross-Model Consensus Can Outperform Process Reward Models for LLM Reasoning
Jul 11, 2026Ning LiuLLM Answer Verification Test-Time Scaling
Independent Researcher
What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study
Jul 7, 2026Robert RichardsonLLM Answer Verification Selective Prediction
Affiliation
From Voting to Agent Collaboration: Answer-Type-Aware LLM Pipelines for BioASQ 14b
Jul 7, 2026Taeyun Roh, Eunha Lee, Wonjune Jang +3LLM Answer Verification Biomedical QA
Department of Computer Science and Engineering, Korea University, Seoul, 02841, Republic of Korea · Department of Mathematics, Myongji University, Yongin, 17058, Republic of Korea · 3AIGEN Sciences, Seoul, 04778, Republic of Korea
LLM-as-a-Verifier: A General-Purpose Verification Framework
Jul 6, 2026Jacky Kwok, Shulu Li, Pranav Atreya +6LLM Answer Verification LLM Agent Evaluation
Stanford University · UC Berkeley · NVIDIA Research
Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models
Jul 6, 2026MY Pitsane, Hope MogaleLLM Answer Verification LLM Inference
North-West University, RSA · Mankind Research Labs, Sandton · University of Pretoria, RSA
Theoria: Rewrite-Acceptability Verification over Informal Reasoning States
Jul 1, 2026Michael Saldivar, Ben SlivinskiLLM Answer Verification LLM Auditing
Independent Researchers
Test-Time Verification for Text-to-SQL via Outcome Reward Models
Jun 29, 2026Mattia Tritto, Giuseppe Farano, Dario Di Palma +4Reward Modeling LLM Answer Verification
Polytechnic University of Bari, Bari, Italy · IBM T.J. Watson Research Center, Yorktown Heights, NY, USA
Structural Certification for Reliable Physical Design with Language Models
Jun 29, 2026Nakul Vyas, Iliya D. StoevLLM Answer Verification Formal Verification
Heysuvi Labs, LLC, US Operations & Research, 7345 W Sand Lake Rd, Ste 210, Orlando, 32819, FL, United States. · Institute of Biological and Chemical Systems - Functional Molecular Systems, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, Eggenstein-Leopoldshafen, 76344, Baden-Württemberg, Germany.
DEEPMED Search: An Open-Source Agentic Platform for Medical Deep Research with Introspective Verification
Jun 29, 2026Maolin Liu, Fanyu Xu, Ruoqing Xu +3LLM Answer Verification Agentic Search
School of Computer Science and Software Engineering, Shanghai University · Department of Computer Science and Engineering, Shanghai Jiao Tong University
AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering
Jun 27, 2026Ansh KamthanRetrieval-Augmented Generation LLM Answer Verification
Department of Artificial Intelligence and Machine Learning Manipal University Jaipur Jaipur, India
Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA
Jun 26, 2026Sambaran BandyopadhyayIn-Context Retrieval LLM Evaluation
Adobe Research
Not All Claims Are Equally Risky: FACTOR for Adaptive Verification in Factual Long-Form Generation
Jun 21, 2026Areeba Hassan, Arooj Kausar, Syeda Kisaa Fatima +2LLM Answer Verification Long-Form Document Generation
School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan
CalVerT: Augmenting Agents with Calibrated Verifier Telemetry Improves Action and Learning in Knowledge-Intensive Tasks
Jun 19, 2026Ashwin Vinod, Ying Ding, Elias Stengel-EskinLLM Answer Verification LLM Agent Verification
The University of Texas at Austin
Denoising Iterative Self-Correction: Structured Verification Loops for Reliable LLM Reasoning
Jun 19, 2026Shen Yin, David Ken, Joel StremmelLLM Self-Correction LLM Self-Refinement
Thomson Reuters Labs

Aug 5, 2026, cs.AIJ/K move · Enter open · S save

Agreement Before Diversity: Verification-First Complementarity for Heterogeneous Language-Model Coordination

Ruitong Li, Binjie Guo, Aisheng Mo, Guowei Su+2

1The University of Hong Kong · Zhejiang University · 3Independent Researcher

LLM Evaluation LLM Answer Verification Language Model Ensembles

Open paper AskPDF arXiv

Heterogeneous language-model ensembles expand the space of candidate responses, yet they lack a principled criterion for when a newly generated answer should supersede an already supported one. We decouple candidate headroom from replacement authority, rendering the latter as an explicit, auditable object. Our proposed method, Agreement-Before-Diversity (ABD), is a frozen, label-free decision rule: an anchor answer is retained if two additional trusted samples corroborate it under a fixed equivalence relation; otherwise, it is replaced by a heterogeneous synthesis. For this gating mechanism, we prove two exact identities. The first shows that the accuracy gap relative to unconditional synthesis is determined jointly by the agreement coverage and the anchor's advantage on the protected subset. The second shows that the gap relative to never synthesizing reflects a contrast between authorized recovery and authorized destruction. Neither identity assumes independence or calibrated confidence, and the expected inference cost is approximately eight minus five times the coverage in number of calls. Under blind, exact-ID evaluation, ABD achieves 59.43% on the complete LiveCodeBench-v6 (vs. 52.57% for Single9 and 52.00% for HAC; n = 175) and 75.00% on an untouched GPQA-Diamond split (both controls at 72.78%; n = 180). Furthermore, these identities localize every aggregate difference to an enumerable protected stratum: no discordant items occur among the 3 protected cases on LiveCodeBench, where coverage bounds the gate's contribution to 1.71 points a priori; 13 versus 8 discordant cases among 132 on GPQA-Diamond; and 12 versus 0 among 71 under a frozen anchor perturbation. Diversity supplies potential; verification structure supplies authority.

Momentum

Related topics

Latest papers 102