LLM Reliability

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

78 papers in the last four weeks, up 105% on the four weeks before. 0.8% of all new papers.

Jul 13Week of Sep 28

Latest papers 507

All topics

When LLMs Agree, Are They Right? Auditing Self-Consistency and Cross-Model Agreement as Confidence Signals
Jul 9, 2026Kaihua DingLLM-as-a-Judge LLM Reliability
University of Pennsylvania
Validating LLMs in social science: Epistemic threats and emerging norms
Jul 8, 2026Meera Desai, Dallas Card, Abigail Z. JacobsLLM Evaluation Computational Social Science
School of Information, University of Michigan, Ann Arbor, USA · Center for the Study of Complex Systems, University of Michigan, Ann Arbor, USA.
Auto-DSM Under the Lens: A Black-Box Evaluation Framework for LLM-Based DSM Generation
Jul 7, 2026Niels Potters, Theo HofmanLLM Evaluation LLM Auditing
Eindhoven University of Technology (TU/e), Dept. of Mechanical Engineering, Control Systems Technology section, Engineering Systems Design group, P.O.Box 513, 5600 MB Eindhoven, The Netherlands.
Agentic Scaffolding Amplifies Sycophantic Behavior in Large Language Models
Jul 6, 2026Thantham JitthamLLM Sycophancy LLM Reliability
Cornell University
EvalLoop: A Methodology for Evaluation-Driven Iterative Improvement of Business AI Systems
Jul 6, 2026Kenneth Benavides, Josh Fleischer, Danti ChenLLM Evaluation LLM Reliability
Robert Half
Most LLM Conformity Needs No Speaker: Measuring the Speaker-Free Floor in Peer-Pressure Benchmarks
Jul 6, 2026Yibo Hu, Jiaming QuLLM Evaluation Normative Conformity in Language Models
Illinois Institute of Technology · Amazon
Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models
Jul 6, 2026MY Pitsane, Hope MogaleLLM Answer Verification LLM Inference
North-West University, RSA · Mankind Research Labs, Sandton · University of Pretoria, RSA
Mechanism-level routing failure in LLMs over Lean-verified algebraic structures
Jul 5, 2026Manuel Israel Cázares, Wenlin Zhang, Haobo MaLLM Reliability LLM Routing
Bytepro AI, Mazatlán, México · National University of Singapore / Omega Institute · ChronoAI / Omega Institute
Uncertainty-Aware Abstention in Large Language Models with Provable Alignment Guarantees
Jul 5, 2026Sijin Dong, Hiroyuki ShinnouSelective Prediction Confidence Estimation in Language Models
1Ibaraki University, Japan.
Knowing When to Stop: Predicting Execution-Consistency Convergence in Text-to-SQL
Jul 4, 2026Yaron Anavi, Mor Aisenberg, Nadav Nesher +2LLM Inference Efficiency LLM Inference
GIGASPACES
Consistent but Miscalibrated: Evaluating LLM Limitations for Risk Communication in Natural Language
Jul 4, 2026Diego Cerda-Mardini, Sarath Chandar, Sreenath MadathilLLM Evaluation Probability Calibration
Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montréal, QC, Canada · Chandar Research Lab, Polytechnique Montréal, Montréal, H3T 1J4, Canada · Mila – Québec Artificial Intelligence Institute, Montréal, H2S 3H1, Canada +2
Beyond Static Rules: Automated Discovery of Latent Vulnerabilities in Text-to-SQL
Jul 4, 2026Hanqing Wang, Yongdong Chi, Jian Yang +4LLM Security Text-to-SQL
Shanghai University of Finance and Economics · Beihang University · Deepexi Technology Co. Ltd. +1
Aligning Language Models with Selective Prediction
Jul 3, 2026Gaoxiang Luo, Yifan Wu, Sinian Zhang +2RL for Language Models LLM Alignment
Department of Computer Science and Engineering · 2Bioinformatics and Computational Biology Program · 3Division of Biostatistics and Health Data Science
Improving LLMs via Validator-to-Generator Alignment
Jul 2, 2026Juan Diego Rodriguez, Jocelyn Zhang, Katrin Erk +1LLM Alignment LLM Reliability
Department of Computer Science, The University of Texas at Austin · Departments of Linguistics and Computer Science, University of Massachusetts Amherst · Department of Computer Science & Center for Data Science, New York University
CheckRLM: Effective Knowledge-Thought Coherence Checking in Retrieval-Augmented Reasoning
Jul 2, 2026Dingling Xu, Ruobing Wang, Qingfei Zhao +8LLM Reliability LLM Reasoning
School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · Beijing Key Laboratory of Artificial Intelligence for Education, Beijing 100875, China · Institute of Information Engineering, Chinese Academy of Sciences +3
SPLIT: Cross-Lingual Empathy and Cultural Grounding in English and Ukrainian LLM Responses
Jul 2, 2026Anna ChornaMultilingual Language Model Evaluation LLM-as-a-Judge
On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain
Jul 1, 2026Atsuki Yamaguchi, Szymon Palucha, Léo Bijar +2Mixture-of-Experts Pruning LLM Reliability
University of Sheffield, United Kingdom · AstraZeneca · University of Exeter, United Kingdom +1
Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensions
Jul 1, 2026César Guerra-Solano, Xiang Lorraine LiLLM Evaluation Language Model Generation Evaluation
Department of Computer Science, University of Pittsburgh
The Moving Target: A Longitudinal Audit of Trustworthiness Drift Across Twelve Checkpoints of Open-Source Chat LLMs
Jul 1, 2026Zhichao Fan, Yanhang Li, Zexin Zhuang +2LLM Safety Benchmarks LLM Evaluation
University of Illinois Urbana-Champaign · Northeastern University · Southern Methodist University +2
Mapping the Evaluation Frontier: An Empirical Survey of the Bias-Reliability Tradeoff Across Eleven Evaluator-Agent Conditions
Jul 1, 2026Zewen LiuLLM Evaluation LLM-as-a-Judge
Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity
Jun 30, 2026Bytedance SeedLLM Evaluation Instruction Following
Bytedance Seed
Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth
Jun 30, 2026Sajjad Abdoli, Ghassan Al-Sumaidaee, Ahmad ElShiekh +2Multilingual Language Model Evaluation LLM-as-a-Judge
1Perle AI
Harnessing the Latent Space: From Steering Vectors to Model Calibrators for Control and Trust
Jun 30, 2026Nishant SubramaniLanguage Model Steering LLM Interpretability
Carnegie Mellon University, Language Technologies Institute
When LLMs Read Tables Carelessly: Measuring and Reducing Data Referencing Errors
Jun 30, 2026Yuqing Yang, Qi Zhu, Zhen Han +5LLM Evaluation LLM Grounding
University of Southern California · AWS AI Labs
CLExEval: A Human-in-the-Loop Framework for Qualitative Evaluation of LLM Clinical Reasoning
Jun 30, 2026Ajmal M., Abin Roy, Afthab Salam Kanniyan +4LLM-as-a-Judge Human-in-the-Loop Evaluation
1MBZUAI · 2IIT Madras · 3Calicut Medical College
CDR-Bench: Evaluating Faithful Execution of Compositional, Order-Sensitive Data Refinement Recipes
Jun 30, 2026Yuchen Huang, Xiang Li, Zhenqing Ling +5LLM Evaluation Instruction Following
1HKUST · 2NUS · 3Tongyi Lab , Alibaba Group
Comparing Large Language Models on Scrum Certification-Style Questions: Accuracy, Stability, and Error Patterns
Jun 29, 2026Robson Alves Vilar, Emanuel Dantas Filho, Ademar França de Sousa Neto +5Software Engineering LLM Evaluation
VIRTUS Research, Development and Innovation Center, Federal University of Campina Grande, Campina Grande, PB, Brazil
Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detection
Jun 29, 2026Asif Shahriar, Hongyu Cai, Hadjer Benkraouda +2Software Vulnerability Detection Adversarial Attacks on LLMs
BRAC University · Purdue University · University of Illinois Urbana-Champaign
Can LLMs Rank? A Tale of Triads and Triage
Jun 29, 2026Gaurab Pokharel, Shafkat Farabi, Patrick J. Fowler +1Pairwise Comparison Social Choice Theory
Virginia Tech Alexandria, VA · Washington University in St. Louis St. Louis, MO
Structural Certification for Reliable Physical Design with Language Models
Jun 29, 2026Nakul Vyas, Iliya D. StoevLLM Answer Verification Formal Verification
Heysuvi Labs, LLC, US Operations & Research, 7345 W Sand Lake Rd, Ste 210, Orlando, 32819, FL, United States. · Institute of Biological and Chemical Systems - Functional Molecular Systems, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, Eggenstein-Leopoldshafen, 76344, Baden-Württemberg, Germany.

Jul 9, 2026, cs.AIJ/K move · Enter open · S save

When LLMs Agree, Are They Right? Auditing Self-Consistency and Cross-Model Agreement as Confidence Signals

Kaihua Ding

University of Pennsylvania

LLM-as-a-Judge LLM Reliability LLM Uncertainty Estimation Self-Consistency in Language Models

Open paper AskPDF arXiv

LLM-as-judge (Zheng et al., 2023) is increasingly the default for evaluating AI systems in enterprise pipelines, often scaled to ensembles (Verga et al., 2024) or "mixture-of-experts" (Shazeer et al., 2017) panels of judges. These systems share a key assumption: that consistency -- agreement among judges, or among a model's own samples -- indicates correctness. We show this assumption is unreliable. Agreement is not accuracy: a model can agree with itself, and different models can agree with each other, out of shared bias, a memorized heuristic, or an option-position prior rather than truth. We ask when agreement is nonetheless a usable proxy, in a large-scale cross-runner study: 53 runners drew K=50 samples for assigned overlapping cases across comparisons of model tier, prompting, and scale on GPQA Diamond and AIME -- 265,000 samples. Using majority-correctness as the deployment label and a hierarchical runner-clustered bootstrap, agreement is a positive but weak predictor (rho 0.20-0.59, all positive under item-clustered resampling) whose usefulness is regime-dependent: best for unsaturated mid-tier models and for allocating compute, and worst -- over-confident yet no more accurate -- for the most consistent frontier model (agreement >=0.8 on 77% of GPQA case-result entries, 48% of those wrong). An exploratory cross-family check on three Claude tiers shows the same frontier over-confidence, with confident errors recurring across providers above a marginal-preserving null. Self-consistency is thus a conditional proxy for correctness, not a standalone confidence score. We publicly release the de-identified per-run rows and answer distributions.

Momentum

Related topics

Latest papers 507