Conformal Prediction for Language Models

Follow this topic Ask about this topic

Latest papers

14 papers1 paper in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Conformal Prediction-Enabled Sequence-level Policy Optimization for Reasoning Language Models
Oct 18, 2026Hui Yang, Wan Tian, Tao Ren +2RL for Language Models RL for Language Model Reasoning
Peking University · Beihang University · Nanjing University
Unifying Conformal Language Tasks with In-Context Ensembles
Sep 2, 2026Xiao Shi Huang, Chen-Yuan Lin, Bruce Kuwahara +2Conformal Prediction Language Model Ensembles
Signal 1 AI · Layer 6 AI
Conformalized Large Language Models under Configuration Shift
Aug 2, 2026Yuqicheng Zhu, Jialin Yu, Lin Li +7Conformal Prediction Conformal Prediction for Language Models
University of Stuttgart · Robert Bosch GmbH · University of Oxford +4
Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation
Jul 18, 2026Mingqiao Mo, Yunlong Tan, Hao ZhangLLM Self-Correction Scientific Reasoning
University of Chinese Academy of Sciences
Inference-Time Conformal Reasoning with Valid Factuality Control for Large Language Models
Jun 7, 2026Ting Wang, Yuanjie Shi, Yan Yan +1LLM Inference LLM Reasoning with Graphs
University of Illinois Urbana-Champaign · School of EECS, Washington State University.
Conformal Language Modeling via Posterior Sampling
Jun 2, 2026Nicolas Emmenegger, Theo X. Olausson, Armando Solar-Lezama +1Hallucination in Language Models Conformal Prediction
Massachusetts Institute of Technology
COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models
May 28, 2026Arya Fayyazi, Mehdi Kamal, Massoud PedramSocial Bias in Language Models Counterfactual Fairness
Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, California, USA.
Conf-Gen: Conformal Uncertainty Quantification for Generative Models
May 27, 2026Gabriel Loaiza-Ganem, Kevin Zhang, Wei Cui +2Uncertainty Quantification Conformal Prediction
Layer 6 AI, Toronto, Canada
Geometry-Calibrated Conformal Abstention for Language Models
Apr 30, 2026Rui Xu, Yi Chen, Sihong Xie +1Uncertainty Quantification Selective Prediction
Information Hub, AI Thrust Hong Kong University of Science and Technology (Guangzhou) Guangzhou, Guangdong, China
Differentiable Conformal Training for LLM Reasoning Factuality
Apr 22, 2026Nathan Hittesdorf, Marco Salzetta, Lu ChengLLM Hallucination Mitigation Conformal Prediction
Department of Computer Science, University of Illinois at Chicago, Chicago, United States · Department of Physics, University of Illinois at Urbana-Champaign, Urbana, United States
Beyond Surface Statistics: Robust Conformal Prediction for LLMs via Internal Representations
Apr 17, 2026Yanli Wang, Peng Kuang, Xiaoyu Han +2Language Model Robustness Conformal Prediction
Imperial College London · Zhejiang University · University of Illinois Urbana-Champaign +1
Adaptive Conformal Prediction for Improving Factuality of Generations by Large Language Models
Apr 15, 2026Aleksandr Rubashevskii, Dzianis Piatrashyn, Preslav Nakov +1Conformal Prediction for Language Models Conformal Prediction
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE
Uncertainty-Aware Transformers: Conformal Prediction for Language Models
Apr 10, 2026Abhiram Vellore, Niraj K. JhaConformal Prediction for Language Models LLM Uncertainty Estimation
Department of Electrical and Computer Engineering, Princeton University
Online Reasoning Calibration: Test-Time Training Enables Generalizable Conformal LLM Reasoning
Apr 1, 2026Cai Zhou, Zekai Wang, Menghua Wu +6Conformal Prediction for Language Models Language Model Calibration
Department of Electrical Engineering and Computer Science (MIT EECS) · Computer Science and Artificial Intelligence Laboratory (MIT CSAIL) · Laboratory for Information and Decision Systems (MIT LIDS) +1

Oct 18, 2026J/K move · Enter open · S save

Conformal Prediction-Enabled Sequence-level Policy Optimization for Reasoning Language Models

Hui Yang, Wan Tian, Tao Ren, Zhongyi Li+1

Peking University · Beihang University · Nanjing University

RL for Language Models RL for Language Model Reasoning LLM Reasoning Conformal Prediction for Language Models

Open paper AskPDF arXiv

Reinforcement learning improves the reasoning capability of large language models through verifiable rewards for mathematical and coding tasks. In token-level methods such as GRPO, clipping acts on individual token ratios while the reward and advantage apply to a complete response. Recent sequence-level methods align these units but still use fixed clipping bands, whose tail probabilities change as the score distribution evolves. We propose Conformal Prediction-Enabled Sequence-level Policy Optimization (CSPO), which adaptively calibrates sequence-level clipping bounds using recent training statistics. The resulting band targets a specified marginal tail budget and adapts to policy drift; calibration conditional on response length requires additional assumptions. We bound the probability that a fresh score falls outside the band by the target miscoverage level plus explicit CDF discrepancy and drift terms. Under additional moment conditions, this bound also controls the objective and gradient error relative to the unclipped GSPO power surrogate. Experiments with the Qwen3-1.7B series show improvements over GSPO on difficult mathematical reasoning benchmarks and ALFWorld, with clipping endpoints that adapt during training.