LLM Abstention

LLM: Large Language Model

Overview

Large language model abstention studies how systems can recognize missing knowledge, insufficient evidence, or unreliable reasoning and choose whether to answer, clarify, defer, or stop. Methods include confidence and consistency signals, evidence checks and internal-state probes, post-hoc selection thresholds, and training with supervised or reinforcement-learning rewards for calibrated abstention. Benchmarks test factual question answering, retrieval-augmented generation, clinical decisions, and tool-using agents, measuring both answer quality and appropriate abstention. A central tension is balancing coverage against the risk of unsupported answers: models may recognize uncertainty but still commit, or abstain so often that useful answers are lost, especially when settings change.

Latest papers

CardsList

110 papers14 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. Attribute or Abstain: Evaluating Evidence-Grounded Retrieval on the Low-Resource African Business Web

    Nov 15, 2026Bakary Gibba, Muhammad Abba Mandara, Karim Ismail Abd-Ellah MohamedRAG EvaluationEvidence-Grounded QA

  2. Do Open Language Models Invent Scripture? BILAL-BENCH: Benchmarking Islamic-Source Fabrication in Bengali

    Oct 29, 2026Sabah Nushra, Md Kishor MorolHallucination in Language ModelsLLM Evaluation

  3. Deogen: Automatic Benchmark Generation for Reasoning over Policies

    Oct 28, 2026Sam Kouteili, William Liang, Keeran Murray +4Synthetic Benchmark GenerationLanguage Model Reasoning Evaluation

  4. Reinforcement Learning Done Right for Explicit Confidence Targets

    Oct 26, 2026Zefeng He, Yichen He, Yuan Lin +2LLM AbstentionSelective Prediction

  5. Commit or Abstain? System One Decision Models, LLMs, and Missing Legal Authority

    Oct 21, 2026M. Mikail DemirLegal Citation VerificationLLM Abstention

  6. Effects of Model Scale and Quantization on Social Bias and Abstention in Question Answering

    Oct 21, 2026Kuniko Paxton, Ifeoluwa Wuraola, Dhavalkumar ThakkerSocial Bias in Language ModelsLanguage Model Bias Evaluation

  7. Training Language Models to Fail Gracefully

    Oct 14, 2026Daman Arora, Xuecheng Liu, Himanshu Gaurav Singh +6RL for Language ModelsLLM Abstention

  8. How Reliable Are System-One Decisions in Medicine? A Comparative Study of Jev, Jev-like Models, and LLMs

    Oct 13, 2026Yanrui Du, Danyang Zhao, Sendong Zhao +6Clinical Decision-MakingLLM Reliability

  9. Strong yet Controllable LLM Abstention without Learning to Abstain

    Oct 12, 2026Junwei Zhang, Yifei Wang, Wanli Yang +6Factual QALLM Abstention

  10. ScienceBuddy-PV: A Verifier-Governed Recursive Improvement Protocol for Panvascular Intervention Research

    Oct 10, 2026Lingsen You, Yujun Guo, Xinyu Zhong +4LLM AbstentionSelective Prediction

  11. Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection

    Oct 9, 2026Juan Terven, Diana-Margarita Córdova-Esparza, Ruben Gomez +3Selective QALLM Abstention

  12. Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science

    Oct 7, 2026Benjamin Wilcox, Dawei Gao, Pradeeban Kathiravelu +3LLM AbstentionLLM Evaluation

  13. Knowing When Not to Answer: Cross-Domain and Multi-Turn Generalization of Latent Underspecification Signals

    Oct 6, 2026Jerzy Kamiński, Ilya Galyukshev, Artem Kuznetsov +6Multi-Turn Dialogue EvaluationLanguage Model Probing

  14. Penalty-Framed No-Valid-Option MCQA: Analyzing LLM Abstention under Invalid Choices

    Oct 6, 2026Jinhyeok Kim, Hye-Young JungLLM EvaluationMultiple-Choice Question Answering

  15. Rethinking Faithfulness in LLMs: A Pairwise Context-Sensitive Perspective

    Oct 6, 2026Zizhuo Zhang, Xiong Peng, Jingwei Sun +3Contextual FaithfulnessLLM Evaluation

  16. Unanimously Wrong: Certified Abstention from How Medical LLM Consensus Forms

    Oct 6, 2026Xiaoyang Wang, Tianrui Wang, Christopher C. YangLLM AbstentionSelective Prediction

  17. Decide, Ask, or Defer: Clinical LLMs under Incomplete Evidence

    Oct 3, 2026Mingzhan Yang, Weili WuClinical Decision-MakingClinical Language Model Evaluation

  18. A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models

    Oct 1, 2026Yingzhu Zhao, Vlad Pandelea, Han Yuan +4LLM EvaluationFinancial QA