Process Supervision

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, up 125% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 53

All topics

CAPER: Clause-Aligned Process Supervision for Text-to-SQL
Jun 2, 2026Lujie Ban, Jiasheng Shi, Jinyang Li +3Process Reward Models RL for Language Model Reasoning
The Chinese University of Hong Kong, Shenzhen · The University of Hong Kong · Northwestern Polytechnical University +1
LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards
May 29, 2026Nianyi Lin, Jiajie Zhang, Lei Hou +1LLM Grounding RL for Language Model Reasoning
Tsinghua University
COMPASS: Cognitive MCTS-Guided Process Alignment for Safe Search Agents
May 29, 2026Wenkai Shen, Pengyang Zhou, Jiahe Xu +5LLM Safety Alignment LLM Agents
Zhejiang University
GTA: Generating Long-Horizon Tasks for Web Agents at Scale
May 28, 2026Tenghao Huang, Kung-Hsiang Huang, Prafulla Kumar Choubey +4Computer-Use Agent Benchmarks Web Agent Benchmarks
University of Southern California · Salesforce AI Research · University of California, Davis
ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs
May 25, 2026Jiangyang Li, Cong Wan, Changjie Wu +8Visual Spatial Reasoning VLM Reasoning
1Xi’an Jiaotong University · 2Amap, Alibaba Group · 4Shenzhen University +1
How to Steer Your Multi-Agent System: Human-LLM Collaborative Planning
May 21, 2026Zeyu He, Hannah Kim, Dan Zhang +1Multi-Agent LLM Systems Process Supervision
Penn State University · Work done during internship at Megagon Labs · Megagon Labs
From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agents
May 21, 2026Murong Ma, Tianyu Chen, Yun Lin +7Supervised Fine-Tuning Software Engineering Agents
1National University of Singapore · 2Microsoft Research Asia · 3Shanghai Jiao Tong University +1
Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
May 19, 2026Husnain Amjad, Raja Khurram Shahzad, Aamir Shahzad +1Mathematical Reasoning Benchmarks LLM Evaluation
School of Electrical Engineering and Computer Science, National University of Sciences and Technology, Islamabad, Pakistan · Department of Communication, Quality Management and Information Systems, Mid Sweden University, Östersund Campus, Sweden · School of Computing, Data, and Mathematical Sciences, Western Sydney University, Indonesia
LC-ERD: Mining Latent Logic for Self-Evolving Reasoning via Consistency-Regulated Reward Decomposition
May 19, 2026Yanyu Chen, Jiyue Jiang, Dianzhi Yu +8RL for Language Model Reasoning Process Supervision
The Chinese University of Hong Kong · Shanghai Jiaotong University · Fudan University
Self-Supervised On-Policy Distillation for Reasoning Language Models
May 17, 2026Zhiquan Tan, Yinrong HongRL for Language Model Reasoning Process Supervision
Tsinghua University · Beihang University
Product-Aware Deep Autoencoders for Robust Process Monitoring in Multi-Product Cyber-Physical Systems
May 13, 2026MD Shafikul Islam, Jordan CardenCyber-Physical Systems Autoencoders
STRIDE: Learnable Stepwise Language Feedback for LLM Reasoning
May 13, 2026Junjie Zhang, Guozheng Ma, Shunyu Liu +5RL for Language Model Reasoning Process Supervision
Generative AI Lab, College of Computing and Data Science, Nanyang Technological University, Singapore 639798 · Tongyi Lab, Alibaba Group
Emergence of Frontier Superposition: Möbius attractor and Cascade Supervision
May 12, 2026Hongyu Gu, Jingwen FuTransformer Process Supervision
University of Science and Technology of China · Zhongguancun Academy
Verifiable Counterfactual Supervision for Process Reward Models
May 4, 2026Yinghui Chi, Yuanhong WangProcess Reward Models Process Supervision
Jilin University
Dual-Track CoT: Budget-Aware Stepwise Guidance for Small LMs
Apr 27, 2026Sagnik Chatterjee, Atharva Patil, Sricharan RameshCoT Reasoning Small Language Models
Process Supervision of Confidence Margin for Calibrated LLM Reasoning
Apr 25, 2026Liaoyaqi Wang, Chunsheng Zuo, William Jurayj +2Confidence Estimation in Language Models RL for Language Model Reasoning
Johns Hopkins University
Process Supervision via Verbal Critique Improves Reasoning in Large Language Models
Apr 23, 2026Hao-Yuan ChenInference-Time Scaling Process Supervision
Mindify AI Research · University of London · Senate House, Malet Street, London WC1E 7HU, United Kingdom
V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization
Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Multimodal Reasoning Reinforcement Learning with Verifiable Rewards
School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China
GRPO-VPS: Enhancing Group Relative Policy Optimization with Verifiable Process Supervision for Effective Reasoning
Apr 22, 2026Jingyi Wang, Lei Zhu, Tengjin Weng +8RL for Language Model Reasoning Group Relative Policy Optimization
Tsinghua University · Huawei Noah’s Ark Lab · Shenzhen University
Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness
Apr 20, 2026Mengzhao Jia, Zhihan Zhang, Meng JiangMultimodal Reasoning Multimodal Reward Modeling
University of Notre Dame
Internalizing Outcome Supervision into Process Supervision: A New Paradigm for Reinforcement Learning for Reasoning
Apr 19, 2026Fei Ding, Yongkang Zhang, Runhao Liu +4RL for Language Model Reasoning Credit Assignment in RL
Alibaba Group · Tsinghua University
RAWR: Reward Assignment Without Rollouts in Verifiable Domains
Mar 18, 2026Corentin Royer, Anna Hedström, Debarun Bhattacharjya +3Process Reward Models Reinforcement Learning with Verifiable Rewards
International Business Machines · Department of Computer Science, ETH Zurich, 8092 Zurich, Switzerland · ETH AI Center +2
TagPR: Tag-Guided Process Supervision for Personalization Reasoning in Large Language Models
Sep 27, 2025Song Jin, Juntian Zhang, Ruyu Lyu +7LLM Alignment LLM Personalization
Gaoling School of Artificial Intelligence, Renmin University of China · Meituan · Wuhan University

Jun 2, 2026, cs.DBJ/K move · Enter open · S save

CAPER: Clause-Aligned Process Supervision for Text-to-SQL

Lujie Ban, Jiasheng Shi, Jinyang Li, Xiaolin Han+2

The Chinese University of Hong Kong, Shenzhen · The University of Hong Kong · Northwestern Polytechnical University+1

Process Reward Models RL for Language Model Reasoning Text-to-SQL Process Supervision

Open paper AskPDF arXiv

Text-to-SQL systems are typically evaluated by query-level execution correctness, but this terminal signal provides little guidance about which intermediate SQL decision caused success or failure. Token-level dense supervision is also ill-suited: SQL tokens do not align with complete semantic decisions, can penalize execution-equivalent queries, and are difficult to label reliably at scale. We therefore propose CAPER, which automatically derives clause-level supervision via counterfactual intervention on the SQL abstract syntax tree, enabling root-cause error localization for reward modeling; the resulting data is used to train CAPER-9B, a lightweight Clause-PRM that provides clause-boundary feedback for policy optimization and candidate verification. Experiments on BIRD and Spider show that clause-aligned supervision not only improves execution accuracy, achieving up to a 15.3% relative EX improvement over GPT-5.4, but also strengthens failure-localization capability, reaching 84.53% accuracy and 90.60% MRR on held-out failures. Our project page is at https://github.com/banrichard/RL-NL2SQL.

Momentum

Related topics

Latest papers 53