Overview

Process supervision studies how to assess and improve the steps an AI system takes, since a correct answer can result from flawed reasoning or a lucky guess. Approaches include human or model critiques, process reward models, and verifiers based on code execution, formal logic, or other checkable evidence; these signals can guide fine-tuning and reinforcement learning. The methods are applied to tasks such as mathematics, coding, tool use, medical reasoning, and multimodal question answering. A central challenge is producing step-level signals that are accurate and affordable while ensuring that visible reasoning is faithful to the process that actually drives the answer.

Latest papers

CardsList

77 papers5 papers in the last four weeks, down 44% on the four weeks before. 0.0% of all new papers.

  1. Learning to Reason with Predictive Gains for Generative Recommendation

    Nov 16, 2026Zhuoyang Li, Teng Shi, Jiakai Tang +10Generative RecommendationLarge Language Model-Based Recommendation

  2. Grounding-Aware Judge Reward Reinforcement Learning for Out-of-Domain Face Anti-Spoofing

    Nov 6, 2026Xiaoyong Yu, Xinge YuFace Presentation Attack DetectionOOD Generalization

  3. AdaPRA: Process Reward Agents with Adaptive Rubrics for Data Science

    Oct 23, 2026Atharva Naik, Vivek Chari, Pol Llado +5Data Analysis AgentsProcess Reward Models

  4. A Strong MoE Is All You Need for Process Supervision

    Oct 21, 2026Guanzhi Deng, Zengyan Liu, Haibo Wang +5Process SupervisionProcess Reward Models

  5. PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking

    Oct 20, 2026Pan Wang, Yihao Hu, Guangyuan Dong +8Length GeneralizationRecurrent Language Models

  6. C3: Rethinking Process Supervision via Confidence-Guided Credit Correction in Multi-Turn Reinforcement Learning

    Oct 14, 2026Ai Jian, Haoran Pan, Eryu Guo +5Multi-Turn RLReinforcement Learning

  7. LeanPRM: Lean-Grounded Process Supervision for Natural Language Proof Verification

    Oct 13, 2026Rodney Lafuente-Mercado, Salman Rahman, Jingyan Shen +3Process SupervisionProcess Reward Models

  8. Proactive Agentic Orchestration

    Oct 9, 2026Xueyang Feng, Chaozhuo Li, Xiaohe Bo +4LLM Agent OrchestrationLLM Agent Workflow Optimization

  9. HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agent

    Sep 29, 2026Zhangquan Chen, Yaoxin Niu, Xiang An +5Human-in-the-Loop AnnotationProcess Supervision

  10. Rewarding Novel Deductions: Solver-guided Process Supervision for Logical Reasoning

    Sep 28, 2026Muhammad Asif Ali, Wenqing Wang, Huan Wang +1RL for Language Model ReasoningProcess Supervision

  11. Reinforcement Learning from Intermediate Renders for Image-to-Code Generation

    Sep 28, 2026Omri Kaduri, Kate Feingold, Phillip Isola +1RL for Code GenerationImage-to-Code Generation

  12. FLARE: A Full-Lifecycle Dense Supervision Paradigm for Long-Horizon Coding Agents via Generative Reward Model

    Sep 20, 2026Jingxuan Xu, Gang Wu, Yanan Wu +14RL for Code GenerationReward Modeling

  13. ProcessLight: Process Supervision for Large Language Model Based Traffic Signal Control

    Sep 19, 2026Huaitao Zhao, Tianlong Zhou, Weijie Wang +2Language Model-Based ControlTraffic Signal Control

  14. The Imitation Game: When LLMs Learn to Reason Like Programs via Code-Centric Reasoning Data Synthesis

    Sep 13, 2026Jinyang Zhang, Weibin Liao, Keqin Bao +10Synthetic Data Generation for Language ModelsRL for Language Model Reasoning

  15. Structural Process Supervision for Latent Chain-of-Thought Reasoning

    Sep 9, 2026Yiqi Li, Xu Chen, Chen Ju +5Representation LearningProcess Supervision

  16. IPM-FM: A Foundation Model with Consensus Feature Selection for Industrial Process Monitoring

    Sep 8, 2026Liang Cao, Weide Liu, Yan Qin +3Predictive Process MonitoringProcess Supervision

  17. SiLR: Structure-Preserving Admission and Process Reward for LLM Tool Agents

    Sep 4, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1Constrained RLRuntime Enforcement for AI Agents

  18. Cliff: Learning Process Rewards from the First Mistake

    Sep 2, 2026Peixuan Han, Runhui Wang, Ketan Ramaneti +3Reinforcement Learning with Verifiable RewardsLLM Reasoning

  19. Monitoring Web Agents Without Internal Signals: Observable Trajectories and Key-Step Supervision

    Sep 2, 2026Sitong Pan, Yipeng Shen, Yilin Lu +3AI Agent MonitoringProcess Supervision

  20. Dense Process Supervision for Search Agents via Fact Utility Estimation

    Sep 1, 2026Rongzhi Zhu, Xiangyu Liu, Yi Liu +7Reinforcement LearningCredit Assignment in RL

  21. PRO-Step: Step-level Process Reward Optimization for Retrieval-Augmented Generation

    Aug 31, 2026MinKeon Kim, Namjun Lee, Jaekwang KimRetrieval-Augmented GenerationRetrieval-Augmented Reasoning

  22. Function-Level Execution Feedback for Code Preference Optimization

    Aug 23, 2026Idris Nechnech, Sehwan Kim, Jimin Seo +4Code GenerationPreference Optimization

  23. CEDAR-GRPO: Process-Aware Reinforcement Learning for General Abductive Reasoning in LLMs

    Aug 14, 2026Moein Salimi, Danial Parnian, Shaygan Adim +6Abductive Reasoning in Language ModelsAbductive Reasoning