Fine-Grained Credit Assignment

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 32

All topics

My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning
Oct 1, 2026Yihua Zhu, Qianying Liu, Weixu Qiao +10Agentic RL Credit Assignment in RL
Alibaba Group · Kyoto University · NII LLMC +6
SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents
Sep 29, 2026Shengtian Yang, Ziyu Xiong, Kaibing Yang +6Reinforcement Learning RL for GUI Agents
Southeast University, Nanjing, China · Kuaishou Technology, Beijing, China · Unaffiliated
Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learning
Sep 28, 2026Dongwon Jung, Hemanth Neelgund Ramesh, Yifan Wang +7Agentic RL Group Relative Policy Optimization
University of California, Davis · Microsoft · University of Washington
From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendation
Sep 24, 2026Mengdan Zhu, Yufan Zhao, Yao Zhao +5Semantic ID Recommendation Credit Assignment
Emory University Atlanta, GA, USA · Microsoft Redmond, WA, USA · Cornell University Ithaca, NY, USA
CausalLoss-Fin: Attributing Financial-Agent Loss to Decisions and Infrastructure Faults
Sep 22, 2026Abhishek SharmaAgent Failure Analysis Financial Services
From Citations to Contributions: LLM-Assisted Credit Scoring of Research Articles
Sep 7, 2026Sana Ebrahimi, Suraj Shetiya, Abolfazl AsudehImportance Weighting Bibliometric Analysis
University of Illinois Chicago · IIT Bombay
DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training
Sep 3, 2026Shubham Gandhi, Saurabh Goyal, Kiran Kate +1Agentic RL Step-Level Credit Assignment in RL
1Carnegie Mellon University · 2IBM Research
How Much, Then Where: Credit-Conserving Action-to-Token Allocation for Multi-Turn Agent Reinforcement Learning
Aug 7, 2026Lichao Ma, Yang Sun, Shuaitao Zhao +9Token-Level Credit Assignment Credit Assignment in RL
1Peking University · 2Meituan LongCat Interaction Team · 3Fudan University +4
Shared Prefixes, Better Credit: Adaptive Routing for Multi-Agent Reasoning
Aug 3, 2026Yiqing Liu, Zihao Wang, Hantao Yao +2Adaptive Model Routing Multi-Agent Collaboration
University of Science and Technology of China
Element-Aware Group Learning for E-Commerce Image Generation
Aug 1, 2026Jingtong Chen, Jiahui Wang, Xue Zhao +2Group Relative Policy Optimization Image Generation
MARS-RA: Rank Aggregation for Credit Assignment via Multimodal Comparisons in Embodied Multi-Agent Cooperation
Jul 30, 2026Dawei Wang, Di Zhao, Xinyuan Liu +5Credit Assignment in RL Cooperative MARL
Newcastle University, United Kingdom · University of Auckland, New Zealand
Attribution Markets: A Fisher-Market Formulation for Fractional Credit Assignment Between Planned Tasks and Performed Actions
Jul 22, 2026Salavat IshbulatovMechanism Design Fine-Grained Credit Assignment
Independent researcher
MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment
Jul 13, 2026Junyoung Park, Namgyu Park, Sechan Lee +3RL for Language Models LLM Jailbreak Attacks
POSTECH GSAI · Samsung SDS · POSTECH GSAI & CSE
TRIAGE: Role-Typed Credit Assignment for Agentic Reinforcement Learning
Jun 30, 2026Yuanda Xu, Zhengze Zhou, Hejian Sang +6Agentic RL Step-Level Credit Assignment in RL
1LinkedIn Corporation · 2Harvard University · 3Johns Hopkins University +1
Towards Value-Constrained Credit Assignment in Fully Delegated AI Cooperatives
Jun 26, 2026Young Yoon, Jimin Kim, Soyeon ParkGradient-Based Attribution Value Alignment
Hongik University, Seoul, Republic of Korea
The Weakest Link Tells It All: Outcome-Supervised Process Reward Modeling via Learnable Credit Assignment
Jun 26, 2026Tianyu Jia, Yue Fang, Hongxin Ding +6Process Reward Models Fine-Grained Credit Assignment
National Engineering Research Center of Software Engineering, Peking University, Beijing, China · School of Computer Science, Peking University, Beijing, China · Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +3
Attributed, But Not Incremental: Cannibalization-Corrected Attribution for Large-Scale Advertising
Jun 25, 2026Donghui Li, Bowen Yuan, Zili Yang +2Causal Effect Estimation Online Advertising
TikTok · San Jose, CA, USA · Shanghai, China +1
Blame is easier than praise: Measuring off-ball defensive performance in football
Jun 18, 2026Jonas Bischofberger, Runqing Ma, Pascal Bauer +2Automated Evaluation Fine-Grained Credit Assignment
Centre for Sport Science and University Sports, University of Vienna, Vienna, Austria · Vienna Doctoral School of Pharmaceutical, Nutritional and Sport Sciences (VDS-PhaNuSpo), University of Vienna, Vienna, Austria · VfB Stuttgart 1893 AG, Stuttgart, Germany +2
PBSD: Privileged Bayesian Self-Distillation for Long-Horizon Credit Assignment
Jun 8, 2026Yang Tian, Rui Wang, Xumeng Wen +5Step-Level Credit Assignment in RL Reinforcement Learning with Verifiable Rewards
School of AI, Shanghai Jiao Tong University · 2XYZ AI Lab
ARCA: Adapter-Residual Credit Assignment When Token Signals Degenerate
May 29, 2026Rodney Lafuente-MercadoToken-Level Credit Assignment RL for Language Model Reasoning
Scale AI
Beyond Trajectory Rewards: Step-level Credit Assignment for Agentic Search via Graph Modeling
May 28, 2026Yuchen Liu, Yingjie Feng, Lixiong Qin +5Reward Modeling Agentic RL
Beijing University of Posts and Telecommunications · Li Auto Inc.
Credit-assigned Policy Gradient for Early Stage Retrieval in Two-stage Ranking
May 25, 2026Haruka Kiyohara, Mihaela Curmei, Ariel Evnine +7Learning to Rank Information Retrieval
Computer Science Department, Cornell University, Ithaca, NY, USA · Central Applied Science, Meta, Menlo Park, CA, USA.
Credit Assignment with Resets in Language Model Reasoning
May 25, 2026Ankur Samanta, Akshayaa Magesh, Ayush Jain +7RL for Language Model Reasoning Credit Assignment in RL
1Meta AI · 2Columbia University · *Work done at Meta +2
Market Regime Council for Dynamic Credit Assignment in Multi-Agent LLM Decision Systems
May 23, 2026Yunhua Pei, Zerui Ge, Jin Zheng +1Multi-Agent LLM Systems Multi-Agent Systems
University of Bristol, UK · Independent Researcher
Every Component Is a Lookup: One Linear Graph for Interaction, Composition and Attribution
May 22, 2026Po-Kai Chen, Aske Plaat, Niki van SteinTransformer Interpretability Token-Level Credit Assignment
Leiden University
Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair
May 8, 2026Jia Li, Yuxin Su, Ting Peng +3RL for Code Generation Reward Shaping
The Chinese University of Hong Kong · Sun Yat-sen University · Tencent
EXPO-SQL: Execution-based Clause-level Policy Optimization for Text-to-SQL
Apr 29, 2026Jaehoon Lee, CheolWon Na, Suyoung Bae +4Reward Shaping Text-to-SQL
College of Computing and Informatics Sungkyunkwan University, South Korea
Stabilizing Efficient Reasoning with Step-Level Advantage Selection
Apr 27, 2026Han Wang, Xiaodong Yu, Jialian Wu +4RL for Language Model Reasoning Efficient Language Model Reasoning
UNC Chapel Hill · Advanced Micro Devices, Inc.
Hidden States Know Where Reasoning Diverges: Credit Assignment via Span-Level Wasserstein Distance
Apr 25, 2026Xinzhu Chen, Wei He, Huichuan Fan +7Token-Level Credit Assignment Group Relative Policy Optimization
Beijing University of Posts and Telecommunications · Meituan · Tianjin University +3
Reducing Credit Assignment Variance via Counterfactual Reasoning Paths
Apr 20, 2026Fei Ding, Yongkang Zhang, Youwei Wang +1RL for Language Model Reasoning Credit Assignment in RL
Alibaba Group · Tsinghua University

Oct 1, 2026, cs.CLJ/K move · Enter open · S save

My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning

Yihua Zhu, Qianying Liu, Weixu Qiao, Xuan Ren+9

Alibaba Group · Kyoto University · NII LLMC+6

Agentic RL Credit Assignment in RL Step-Level Credit Assignment in RL Credit Assignment Fine-Grained Credit Assignment RL for LLM Agents

Open paper AskPDF arXiv

Agentic reinforcement learning (RL) has emerged as a powerful approach for training large language model agents on multi-step tasks, yet reliance on terminal outcome rewards creates two credit-assignment problems, particularly in long-horizon tasks. First, same-outcome rollout groups provide no learning signal from terminal rewards. Second, terminal rewards provide only trajectory-wide feedback, making it difficult to identify which decisions caused a failure. Recent work supplements terminal rewards with finer-grained information from trajectory analysis, such as natural-language reflections on intermediate decisions and errors. However, natural-language diagnoses are difficult to use directly for credit assignment: their error claims may be unreliable, and they do not quantify how much each error should affect learning. We propose Self-Diagnosis-guided Terminal Credit Redistribution (FAULT), which turns diagnosed errors into explicit step-level credit anchored by terminal outcomes. FAULT checks diagnostic evidence and learns relative error costs from task outcomes. During training, the policy and self-diagnoser co-evolve, while error costs are updated online from recent outcomes. On ALFWorld, FAULT recovers learning signals from same-outcome groups, reaching 95% signal coverage versus 41% for GRPO and 72% for GiGPO, while better localizing credit to specific error steps. Across two model scales, FAULT delivers strong. improvements on the long-horizon ALFWorld and WebShop tasks while remaining competitive on short-horizon Search-based QA.

Momentum

Related topics

Latest papers 32