Large Language Model Reliability

Ask about this topic

Momentum

24 papers in the last four weeks, up 85% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 182

All topics
CardsList

  1. How the Audit Rule Shapes Faithful Factor Explanations in LLMs

    Oct 1, 2026Taolin Zhang, Hanyu Wang, Jiuheng Wan +2Model AuditingLarge Language Model Reliability

    Hefei University of Technology · East China Normal University · Alibaba Cloud Computing

  2. The Price of Correlated Tests: How Strict Should a Model Release Gate Be?

    Oct 1, 2026Marco PollanenReleaseGating

    Department of Mathematics & Statistics Trent University Peterborough, ON, Canada

  3. Towards Robust Numerical Claim Verification

    Sep 30, 2026Peter Røysland Aarnes, Vinay SettyLarge Language Model ReliabilityCategory-Aware Atomic Claims

    University of Stavanger · Factiverse AI and University of Stavanger

  4. Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents

    Sep 29, 2026Jianchang Su, Yiwei Yang, Wei ZhangFact-CheckingAI Trustworthiness

    University of Connecticut · University of California, Santa Cruz

  5. A Polyphonic Conception of AI Understanding

    Sep 28, 2026Matthieu Queloz, Pierre BeckmannTrustworthy Artificial IntelligenceLarge Language Model Reliability

    University of Bern, Department of Philosophy · École Polytechnique Fédérale de Lausanne (EPFL) · Idiap Research Institute +1

  6. Toward a Graded Measure of Belief Stability in Large Language Models

    Sep 28, 2026Samantha Dies, Branden Fitelson, Tina Eliassi-RadLarge Language Model Reliability

    Northeastern University, 360 Huntington Ave, Boston, MA 02115 USA · Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501 USA

  7. LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systems

    Sep 27, 2026Liron Soffer, Ravid Shwartz-Ziv, Chen ShaniConformityMulti-Agent Large Language Model Systems

    Tel-Aviv University · New York University

  8. Technical Manual for Toolkit for Confidence-Corpus Consistency, Corpus Absorption and Rule Learning via Fine-Tuning on a Fabricated Corpus

    Sep 23, 2026José Luciano Verçosa Marques, Frederico Jorge Heitmann, Daniel Omar Perez +3Large Language Model ReliabilityText Corpora

    Center for Electric Mobility Research (CEMOBE) / Power Electronics Laboratories (LEPO), University of Campinas (Unicamp) · Institute of Computing (IC), University of Campinas (Unicamp) · Center for Logic, Epistemology and History of Science (CLE), University of Campinas (Unicamp) +1

  9. When Context Misleads: In-context Learning with Jurisdiction in Large Language Models

    Sep 23, 2026Pei-lin Li, Qingle Liu, Junyang Feng +4In-Context LearningIn-Context

    Department of Computer Science and Technology, Tsinghua University · School of Integrated Circuits, Huazhong University of Science and Technology

  10. Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance

    Sep 22, 2026Sebastian CochinescuConfabulationLarge Language Model Reliability

    University of Bucharest

  11. Human-LLM Deliberation as Interactive Proof: Conditions for Verifiability Without Transparency

    Sep 21, 2026Baotong Zhang, Dean Foster, João SedocLarge Language Model ReliabilityProvable Guarantees

    Stern School of Business New York University New York, NY, USA · Amazon New York, NY, USA

  12. From Articles to Publishers: Aggregating Language Model Predictions for News Source Reliability Inference

    Sep 21, 2026John Bianchi, Manuel Pratelli, Fabio Pinelli +1CredibilityHeadlines

    IMT School for Advanced Studies Lucca, 55100 Lucca, Italy · Institute of Informatics and Telematics, National Research Council (IIT-CNR), 56124 Pisa, Italy

  13. An Analysis of Training-Free Self-Reported Confidence in Language Models

    Sep 17, 2026Lukas Meyer, Sofia Rossi, Wei Chen +2Confidence CalibrationLarge Language Model Reliability

    DreamAI

  14. Perception, Layout, and Validation: Calibrated Confidence for Reliable Straight-Through Processing of Financial Documents

    Sep 17, 2026Yichao Jin, Yushuo Wang, Yuxuan Han +7ValidationLarge Language Model Reliability

    OCBC, Singapore

  15. Intrinsic Sequence-Likelihood Confidence in Retrieval-Dominated Extractive QA: Two Pre-Specified Negatives, and What They Do and Do Not Attribute

    Sep 17, 2026Gunwoo Lee, Changmin Sung, Sang-Hwan Gwak +3Large Language Model ReliabilityNegative Results

    Large-scale AI Research Center, Korea Institute of Science and Technology Information (KISTI), 245 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea. · Department of Applied AI, University of Science and Technology (UST), 217 Gajeong-ro, Yuseong-gu, Daejeon, 34113, Republic of Korea.

  16. Chain-of-Thought Entropy as a Reliability Signal: A Preregistered Reproduction

    Sep 17, 2026Theodore O. CochranLarge Language Model ReliabilityChain-of-Thought Reasoning

    AI for Altruism

  17. A Unified Evaluation Framework for Trustworthy Large Language Models, Agentic AI, and Multimodal Systems

    Sep 17, 2026Shaina Raza, Ahmed Y. Radwan, Imran Liaquat +1Trustworthy Artificial IntelligenceLarge Language Model Reliability

    Vector Institute for Artificial Intelligence, Toronto, ON M5G 0C6, Canada

  18. An Empirical Evaluation of Cost-Efficient Large Language Models on Algorithmic Programming Tasks

    Sep 16, 2026Chandimal Adikari, Nandika HerathLarge Language Model ReliabilityEmpirical Study

    Faculty of Engineering and Information Sciences University of Wollongong Wollongong, Australia · Faculty of Engineering, Computing and Science Western Sydney University Parramatta, Australia

  19. The Missing "I Don't Know": Why Three Reasoning-Reliability Findings Converge on Calibrated Abstention

    Sep 15, 2026Srijith RavikumarLarge Language Model ReliabilityAbstention

    Amazon.com LLC

  20. The Misery of Mechanistic Interpretability: A Formal Perspective

    Sep 14, 2026Tobias Ladner, Matthias AlthoffMechanistic InterpretabilityInterpretability

    Technical University of Munich, Germany

  21. Can LLMs Follow Medical Expert Logic? A Benchmark for Hierarchical Logical Consistency in Risk-of-Bias Assessment

    Sep 12, 2026Jiayu Huang, Zichen Tang, Qianhui Ling +2Clinical Reasoning TrainingLarge Language Model Reliability

    Beijing University of Posts and Telecommunications · Hypertension Center, Beijing Anzhen Hospital, Capital Medical University

  22. In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning

    Sep 10, 2026Iliano FasolinoAgentic Retrieval-Augmented Generation SystemsLarge Language Model Reliability

    Department of Computer Science University of Milan Milan, Italy

  23. Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation

    Sep 8, 2026Xingyu Deng, Mingzi Cao, Nikolaos Aletras +2Fact-CheckingLarge Language Model Reliability

    University of Sheffield · Sheffield, UK

  24. A Removal Based Approach to Improve LLM Faithfulness at Test-Time

    Sep 7, 2026Qinglan Luo, S M A Nahian, John Guttag +2Large Language Model ReliabilityFaithful Explanation

    MIT CSAIL · MGH, HMS

  25. Epistemic Warrant for LLM Recommendations: Characterizing the Basis for Reliance When Ground Truth Is Unavailable

    Sep 3, 2026Shai Vardi, João SedocLarge Language Model ReliabilityEpistemic States

    University of South Florida, Muma College of Business · New York University

  26. Does Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods

    Sep 1, 2026Mehrdad Fazli, Sina Mansouri, Mohit Marvania +1Large Language Model HallucinationHallucination Mitigation

    Department of Computer Science, George Mason University Fairfax, VA 22030, USA

  27. IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals

    Sep 1, 2026Md. Atabuzzaman, Christian Alexander, Chris ThomasRecent Vision-Language ModelsLarge Language Model Reliability

    Department of Computer Science Virginia Tech

  28. Reliability Challenges in Diffusion Vision-Language Models

    Sep 1, 2026Md. Atabuzzaman, Chris ThomasDiffusion Language ModelsLarge Language Model Reliability

    Department of Computer Science Virginia Tech

  29. Calibrating Small Language Models for Claim Check-Worthiness Detection

    Aug 31, 2026Pratuat Amatya, V Venktesh, Vinay SettyLarge Language Model ReliabilitySmall Large Language Models

    1Factiverse AS · University of Stavanger · 3Stockholm University

  30. Review Before Trust: Source-Grounded Integrity Gates for AI-Assisted Personal Health Records

    Aug 30, 2026Nora Girda, Adrian GrozaElectronic Health RecordsTrustworthy Artificial Intelligence

    Technical University of Cluj-Napoca, Cluj-Napoca, Romania

  31. Whether LLMs Can Navigate Beliefs and Facts Depends on How You Phrase It

    Aug 18, 2026Quang Minh Nguyen, Luis Frentzen SalimLarge Language Model ReliabilityFacts

    1KAIST · 2National Taiwan University of Science and Technology

  32. NetlistBench: Evaluating LLM Reliability in SPICE Netlist Recognition and Manipulation

    Aug 12, 2026Jiarui Ma, Jianghan Wang, Yuheng Ma +2Printed Circuit BoardLarge Language Model Reliability

    Southern University of Science and Technology School of Microelectronics Shenzhen, China

  33. Benchmarking Trustworthiness of SLMs: Pre-trained vs. Compressed

    Aug 12, 2026Haokun Lin, Kaijie Zhu, Haobo Xu +4Small Large Language ModelsLarge Language Model Reliability

    Institute of Automation, CAS Beijing, China · Tsinghua University Beijing, China · Harvard Medical School Boston, U.S. +1

  34. TRACES: A Benchmark for Epistemic Reliability in Scientific Reasoning by LLMs

    Aug 11, 2026Valentin Rodionov, Shamil AssylbekovLarge Language Model ReliabilityScientific Discovery

    Intellicat Cleveland, OH 44106

  35. From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop

    Aug 11, 2026Rahul Gupta, Abhinav Mohanty, Anaelia Ovalle +10Trustworthy Artificial IntelligenceLarge Language Model Reliability

    Amazon AGI · Meta · Autodesk +3

  36. Assessing Reliability of BERT-Based Models on Question Answering Tasks

    Aug 11, 2026Pooja Yadav, Priyanka Harjule, Basant Agarwal +1Large Language Model ReliabilityBert-Based Models

    Department of Mathematics, Malaviya National Institute of Technology, Jaipur, Rajasthan, India · Department of Computer Science and Engineering, Central University of Rajasthan, Kishangarh, Rajasthan, India · University of Ljubljana, Faculty of Computer and Information Science, Ljubljana, Slovenia

  37. Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility

    Aug 10, 2026Siyang Wu, Yibo Jiang, Bryon AragamLarge Language Model ReliabilityAnswer

    Data Science Institute University of Chicago Chicago, USA · Department of Computer Science University of Chicago Chicago, USA · Booth School of Business University of Chicago Chicago, USA

  38. Learning When to Trust via Selective Context Preference Optimization

    Aug 6, 2026Xian Sun, Wei Chow, Yingshuo Wang +4Large Language Model ReliabilityAI Trustworthiness

    1Duke University · 2National University of Singapore · 3UC Berkeley +3

  39. Decomposed Entailment for Factuality Checking and Hallucination Detection

    Aug 6, 2026Achir Oukelmoun, Nasredine Semmar, Gaël De ChalendarHallucination DetectionLarge Language Model Reliability

    CEA LIST NANO INNOV 2 Bd Thomas Gobert, 91120 Palaiseau, France

  40. Relational Response Fields: A General Theory of Black-Box LLM Response Consistency and Recovery

    Aug 5, 2026Song ZichenLarge Language Model ReliabilityResponses

    Sungkyunkwan University

  41. ExeCRE: Execution-Consistency Guided Reliability Estimation for Self-Correcting Code Generation

    Aug 5, 2026Yiru Dong, Richong Zhang, Fanshuang Kong +1Code GenerationIterative Self-Correction

    Beihang University Beijing, China

  42. Quantization Effects on Biomedical LLM Reliability

    Aug 4, 2026Anton Rasmussen, Hong QinLarge Language Model ReliabilityLarge Language Model Quantization

    Old Dominion University Norfolk, VA 23529, USA

  43. Control Under Compression: Reliability Frontiers for Tool-Using Agents

    Aug 2, 2026Yinghan Hou, Zongyou YangLanguage-Model AgentsLarge Language Model Reliability

    Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom · Dyson School of Design Engineering Imperial College London London, United Kingdom

  44. SCHEDBench: A Benchmark for Evaluating LLM Constraint Faithfulness in Natural-Language Combinatorial Scheduling

    Aug 2, 2026Shrenil Shaun Sharma, Avi SharmaJob Shop SchedulingLarge Language Model Reliability

    Department of Electrical Engineering and Computer Sciences University of California, Berkeley

  45. Tracing the Cascade: A Topology-Aware Evaluation Framework for Scientific Agent Hallucinations

    Aug 1, 2026Xinshun Feng, Ziqi Miao, Lijun Li +1Scientific DiscoveryLarge Language Model Reliability

    Shanghai Artificial Intelligence Laboratory Shanghai, China

  46. A Triple-Robustness Analysis of Retrieval-Augmented Generation for Multi-Hop Requirements Traceability

    Aug 1, 2026Meftun Akarsu, Burak Özdemir, Doğancan Büyükçolak +1Graph-Based Retrieval Augmented GenerationTraceability

    Turkish Aerospace Industries · Technical University of Munich

  47. Averaging Bias: Human Faithfulness Annotations are not Locally Faithful

    Jul 31, 2026Huajian Zhang, Yiyang Feng, Jiawei ZhouExplanation FaithfulnessFaithfulness

    Stony Brook University

  48. When Derived Measurements Mislead: Quantifying and Mitigating LLM Over-Trust with Privileged-Modality Reliability Evidence

    Jul 30, 2026Zongheng Guo, Tao Chen, Tianli Li +6Large Language Model ReliabilityAI Trustworthiness

    Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy · State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, China · Department of Integrated Traditional Chinese and Western Medicine Cardiology, China-Japan Friendship Hospital, Beijing, China +2

  49. Stemma: Induced Decision Regions Reveal LLM Provenance

    Jul 28, 2026Keyu Zhang, Vadim Safronov, Andrew MartinLarge Language Model ReliabilityFingerprint

    Department of Computer Science, University of Oxford

  50. Task-Conditional Faithfulness Auditing of Multimodal LLMs for Grid Diagnosis

    Jul 27, 2026Tianqiao Zhao, Meng Yue, Jianhui WangLarge Language Model ReliabilityMultimodal Large Language Models

    The University of Texas at Arlington, Arlington, TX, USA · Brookhaven National Laboratory, Upton, NY, USA · Southern Methodist University, Dallas, TX, USA

  51. Modeling Memory-Dependent Reliability of LLMs: A Hidden Markov Model

    Jul 24, 2026Robab Aghazadeh Chakherlou, Siddartha Khastgir, Peter Popov +1Large Language Model ReliabilityHidden Markov Models

    WMG, University of Warwick, Coventry, United Kingdom · Centre for Software Reliability, City St George’s, University of London, London, United Kingdom

  52. Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science

    Jul 24, 2026Davide Scarso, Hugo Noronha de Almeida, Joaquim PinaLarge Language Model ReliabilityCredibility

    CIUHCT - Interuniversity Centre for the History of Science and Technology · MARE - Marine and Environmental Sciences Centre, ARNET - Aquatic Research Network Associate Laboratory

  53. On Improving Faithfulness of Podcasts from Documents

    Jul 24, 2026Soumya Dutta, Tejas Indulal Dhamecha, Pannaga ShivaswamyExplanation FaithfulnessFaithfulness

    1Indian Institute of Science · 2Adobe Research

  54. Reliability-Contagion Feasibility in LLM Multi-Agent Networks

    Jul 24, 2026Ruiwu Niu, Xincheng Shu, Ying ZhaoMulti-Agent CommunicationLarge Language Model Reliability

    Department of Applied Data Science, Hong Kong Shue Yan University, Hong Kong SAR, China · Computational Communication Research Center, Beijing Normal University, Zhuhai 519087, China · School of Journalism and Communication, Beijing Normal University, Beijing 100875, China +1

  55. Trustworthiness Costs of Domain Adaptation in Small Language Models:A Cross-Architecture Empirical Study

    Jul 23, 2026Ramesh B. ParamkushamLarge Language Model AdaptationLarge Language Model Reliability

    Independent Researcher; Adjunct Faculty, University of the Cumberlands, Williamsburg, KY, USA

  56. Capital Markets LLM Reliability Score (CM-LRS): From Plausible to Bankable

    Jul 23, 2026Prerit AhujaFinance BenchmarksLarge Language Model Reliability

    Independent Researcher · London-based

  57. Reexamining zero-shot summarization: Empirical investigation of trustworthiness of LLM-summarizers

    Jul 23, 2026Vasudha Bhatnagar, Purnima Bindal, Vikas Kumar +1Large Language Model ReliabilitySummarization

    Department of Computer Science, University of Delhi, Delhi, 110007, Delhi, India · Department of Statistics, Ramjas College, University of Delhi, Delhi, 110007, Delhi, India

  58. LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports

    Jul 23, 2026Yunhan Li, Mingjie Xie, Zeyang Shi +2CitationsLarge Language Model Reliability

    Faculty of Data Science, City University of Macau, Macau · Southern University of Science and Technology, China · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China

  59. Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results

    Jul 22, 2026Yanyu Chen, Yue Li, Yongyi Cui +2Large Language Model ReliabilityLarge Language Model Judges

    East China Normal University · Shandong University

  60. Integrity of peer-to-peer distributed LLM inference under malicious nodes

    Jul 21, 2026Mert Cihangiroglu, Antonino NoceraPeer-To-PeerLarge Language Model Reliability

    DCALab, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy