External Reward Models

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

12 new papers

A weekly snapshot of new work published in External Reward Models.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in External Reward Models.

Period ending 2026-09-07

9 new papers

A weekly snapshot of new work published in External Reward Models.

Inside this field

Focused directions

332 papers

Latest in External Reward Models

Browse all topics →
CardsList

  1. Internalizing Curriculum Judgment for LLM Reinforcement Fine-Tuning

    May 11, 2026Han Zheng, Yining Ma, Karthick Gunasekaran +4Curriculum Reinforcement LearningReinforcement Fine-Tuning

  2. Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping

    May 11, 2026Haoyuan Sun, Jing Wang, Yuxin Song +9Text-To-ImageReinforcement Learning Post-Training

  3. Equilibrium Residuals Expose Three Regimes of Matrix-Game Strategic Reasoning in Language Models

    May 11, 2026Wenhua Nie, Binhan Luo, Zijie Meng +2Imperfect-Information GamesEquilibrium

  4. Learning to Sparsify Stochastic Linear Bandits

    May 11, 2026Zhengmiao Wang, Ming Chi, Zhi-Wei Liu +2O(T^Β)$ Simultaneous RegretSparsity

  5. EchoDistill:Alignment Noisy-to-Clean Self-Distillation for Robust Audio LLMs

    May 11, 2026Liang Lin, Chunxi Luo, Kaiwen Luo +9Large Audio Language ModelsAudio

  6. ACSAC: Adaptive Chunk Size Actor-Critic with Causal Transformer Q-Network

    May 10, 2026Qian Chen, Junqiao Zhao, Hongtu Zhou +4Soft Actor-CriticSparse Rewards

  7. Functional Graphs for Predicting and Explaining Goal Failure in Sparse Goal-Conditioned RL

    May 10, 2026Shalley DashGoal-Conditioned Reinforcement LearningSparse Rewards

  8. Forge: Quality-Aware Reinforcement Learning for NP-Hard Optimization in LLMs

    May 9, 2026Xiaozhe Li, Xinyu Fang, Shengyuan Ding +5Reasoning BenchmarkReinforcement Learning With Verifiable Reward

  9. ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation

    May 9, 2026Youhe Feng, Hansen Shi, Haoyang Li +7Generalizable Robotic ManipulationsOutcome-Based Rewards

  10. Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria

    May 8, 2026Juanxi Tian, Fengyuan Liu, Jiaming Han +6RubricsExternal Reward Models

  11. Rubric-Grounded RL: Structured Judge Rewards for Generalizable Reasoning

    May 8, 2026Manish Bhattarai, Ismael Boureima, Nishath Rajiv Ranasinghe +2Rubric-Based Reinforcement LearningRubric Framework

  12. Object Hallucination-Free Reinforcement Unlearning for Vision-Language Models

    May 8, 2026Kaidi Jia, Yujie Lin, Chengyi Yang +2Vision EncodersHallucination Mitigation

  13. Learning CLI Agents with Structured Action Credit under Selective Observation

    May 8, 2026Haoyang Su, Ying WenAgentic Reinforcement-Learning FrameworkComputer-Use Agents

  14. Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair

    May 8, 2026Jia Li, Yuxin Su, Ting Peng +3Potential-Based Reward ShapingAgentic Reinforcement-Learning Framework

  15. Preference Instability in Reward Models: Detection and Mitigation via Sparse Autoencoders

    May 7, 2026Shunchang Liu, Xin Chen, Belen Martin Urcelay +1Preference LearningProcess Reward Modeling

  16. Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability

    May 7, 2026Matias G. Delgadino, Sebastien Motsch, Advait Parulekar +2Posterior SamplingDiffusion Sampling

  17. Market-Alignment Risk in Pricing Agents: Trace Diagnostics and Trace-Prior RL under Hidden Competitor State

    May 7, 2026Peiying Zhu, Sidi ChangPricesCircuit Tracing

  18. MARBLE: Multi-Aspect Reward Balance for Diffusion RL

    May 7, 2026Canyu Zhao, Hao Chen, Yunze Tong +3External Reward ModelsCosine Similarity

  19. EP-GRPO: Entropy-Progress Aligned Group Relative Policy Optimization with Implicit Process Guidance

    May 6, 2026Song Yu, Li Li, Wenwen Zhao +1Group Relative Policy OptimizationReinforcement Learning With Verifiable Reward

  20. StoryAlign: Evaluating and Training Reward Models for Story Generation

    May 6, 2026Haotian Xia, Hao Peng, Yunjia Qi +4Llm-Generated StoriesNarratives

  21. EvoLM: Self-Evolving Language Models through Co-Evolved Discriminative Rubrics

    May 5, 2026Shuyue Stella Li, Rui Xin, Teng Xiao +8Large Language Model EvaluationRubrics

  22. FINER-SQL: Boosting Small Language Models for Text-to-SQL

    May 5, 2026Thanh Dat Hoang, Thanh Trung Huynh, Matthias Weidlich +4Text-To-SqlSql

  23. Enhanced LLM Reasoning by Optimizing Reward Functions with Search-Driven Reinforcement Learning

    May 3, 2026Arash Ahmadi, Sarah Sharif, Yaser +1Large Language Model ReasoningExternal Reward Models

  24. Quality-Aware Exploration Budget Allocation for Cooperative Multi-Agent Reinforcement Learning

    May 3, 2026Dahyun Oh, Minhyuk Yoon, H. Jin KimMulti-Agent Reinforcement LearningExploration-Exploitation Dilemma

  25. Zero-Shot, Safe and Time-Efficient UAV Navigation via Potential-Based Reward Shaping, Control Lyapunov and Barrier Functions

    May 3, 2026Ashik Abrar Naeem, Mohammad Ariful HaqueAutonomous Drone NavigationUnmanned Aerial Vehicles

  26. TRIMMER: A New Paradigm for Video Summarization through Self-Supervised Reinforcement Learning

    May 3, 2026Pritam Mishra, Coloma Ballester, Dimosthenis KaratzasVideosSummarization

  27. S3S^3-R1: Learning to Retrieve and Answer Step-by-Step with Synthetic Data

    May 2, 2026Harsh Goel, Akhil Udathu, Susmija Jabbireddy +2Multi-Hop Question Answering BenchmarksSparse Rewards

  28. Themis: Training Robust Multilingual Code Reward Models for Flexible Multi-Criteria Scoring

    May 1, 2026Indraneil Paul, Goran Glavaš, Iryna GurevychProcess Reward ModelingTest-Time Scaling

  29. PrefMoE: Robust Preference Modeling with Mixture-of-Experts Reward Learning

    May 1, 2026Ziqin Yuan, Ruiqi Wang, Dezhong Zhao +2Process Reward Modeling

  30. GUI Agents with Reinforcement Learning: Toward Digital Inhabitants

    Apr 30, 2026Junan Hu, Jian Liu, Jingxiang Lai +6Graphical User Interface AgentsGraphical User Interface

  31. Leveraging Verifier-Based Reinforcement Learning in Image Editing

    Apr 30, 2026Hanzhong Guo, Jie Wu, Jie Liu +6Image EditingText-To-Image

  32. From Coarse to Fine: Benchmarking and Reward Modeling for Writing-Centric Generation Tasks

    Apr 30, 2026Qingyu Ren, Tianjun Pan, Xingzhou Chen +1Process Reward ModelingAi-Assisted Writing

  33. reward-lens: A Mechanistic Interpretability Library for Reward Models

    Apr 28, 2026Mohammed Suhail B NadafProcess Reward ModelingMechanistic Interpretability

  34. Sample-efficient Neuro-symbolic Proximal Policy Optimization

    Apr 28, 2026Simone Murari, Celeste Veronese, Daniele MeliProximal Policy OptimizationNeuro-Symbolic Framework

  35. R3^3-SQL: Ranking Reward and Resampling for Text-to-SQL

    Apr 28, 2026Hojae Han, Yeonseok Jeong, Seung-won Hwang +2Text-To-SqlSql

  36. Zero Shot Coordination for Sparse Reward Tasks with Diverse Reward Shapings

    Apr 28, 2026Keenan Powell, Peihong Yu, Pratap TokekarMulti-Agent Reinforcement LearningSparse Rewards

  37. Model-Free Inference of Investor Preferences: A Relative Entropy IRL Approach

    Apr 27, 2026Chen XuEntropy Regularized Reinforcement LearningModel-Free Reinforcement Learning

  38. Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis

    Apr 27, 2026Zhisong Qiu, Shuofei Qiao, Kewei Xu +4Reliable Medical Process-Level Reward Model Evaluation FrameworkReasoning-Aware Reward

  39. Explanation Quality Assessment as Ranking with Listwise Rewards

    Apr 27, 2026Thomas Bailleux, Tanmoy Mukherjee, Emmanuel Lonca +2RankingReasoning-Aware Reward

  40. Reward Models Are Secretly Value Functions: Temporally Coherent Reward Modeling

    Apr 24, 2026Alex NikulkovProcess Reward ModelingValue Functions

  41. Concave Statistical Utility Maximization Bandits via Influence-Function Gradients

    Apr 24, 2026Matías Carrasco, Alejandro CholaquidisEfficient Influence FunctionReward Modeling

  42. Outcome Rewards Do Not Guarantee Verifiable or Causally Important Reasoning

    Apr 23, 2026Qinan Yu, Alexa Tartaglini, Peter Hase +2Reinforcement Learning With Verifiable RewardOutcome-Based Rewards

  43. Occupancy Reward Shaping: Improving Credit Assignment for Offline Goal-Conditioned Reinforcement Learning

    Apr 22, 2026Aravind Venugopal, Jiayu Chen, Xudong Wu +3Potential-Based Reward ShapingCredit Assignment

  44. Benefits of Low-Cost Bio-Inspiration in the Age of Overparametrization

    Apr 22, 2026Kevin Godin-Dubois, Anil Yaman, Anna V. KononovaBio-Inspired FrameworkSoft Actor-Critic

  45. EVPO: Explained Variance Policy Optimization for Adaptive Critic Utilization in LLM Post-Training

    Apr 21, 2026Chengjun Pan, Shichun Liu, Jiahang Lin +10Multi-Objective Policy OptimizationSparse Rewards

  46. Policy Gradient Primal-Dual Method for Safe Reinforcement Learning from Human Feedback

    Apr 21, 2026Qiang Liu, Adrienne Kline, Ermin WeiReinforcement Learning From Human FeedbackDeep Reinforcement Learning

  47. Self-Improving Tabular Language Models via Iterative Reward-Guided Post-Training

    Apr 21, 2026Yunbo Long, Tejumade Afonja, Guangya Hao +2Process Reward ModelingLLM Post-Training Methods

  48. Curiosity-Critic: Cumulative Prediction Error Improvement as a Tractable Intrinsic Reward for World Model Training

    Apr 20, 2026Vin Bhaskara, Haicheng WangReward-Prediction ErrorExternal Reward Models

  49. PARM: Pipeline-Adapted Reward Model

    Apr 20, 2026Xingyu Fan, Wei Shao, Jiacheng Liu +2Process Reward ModelingLarge Language Model Pipelines

  50. Reducing Credit Assignment Variance via Counterfactual Reasoning Paths

    Apr 20, 2026Fei Ding, Yongkang Zhang, Youwei Wang +1Credit AssignmentSparse Rewards

  51. Towards Disentangled Preference Optimization Dynamics: Suppress the Loser, Preserve the Winner

    Apr 20, 2026Wei Chen, Yubing Wu, Junmei Yang +5Process Reward ModelingIncentives

  52. Understanding Human Actions through the Lens of Executable Models

    Apr 20, 2026Rimvydas Rubavicius, Manisha Dubey, N. Siddharth +1Executable Robot BehaviorHuman Oversight

  53. CodePivot: Bootstrapping Multilingual Transpilation in LLMs via Reinforcement Learning without Parallel Corpora

    Apr 20, 2026Shangyu Li, Juyong Jiang, Meibo Ren +7Code GenerationText Corpora

  54. Process Reward Models Meet Planning: Generating Precise and Scalable Datasets for Step-Level Rewards

    Apr 20, 2026Raffaele Pisano, Roberto NavigliTable Reasoning DatasetsProcess Reward Modeling

  55. HealthCraft: A Reinforcement Learning Safety Environment for Emergency Medicine

    Apr 18, 2026Brandon DentLarge Language Model SafetyEmergency Evacuations

  56. AgentV-RL: Scaling Reward Modeling with Agentic Verifier

    Apr 17, 2026Jiazheng Zhang, Ziche Fu, Zhiheng Xi +13Agentic ReasoningLarge Language Model Reasoning

  57. S-GRPO: Unified Post-Training for Large Vision-Language Models

    Apr 17, 2026Yuming Yan, Kai Tang, Sihong Chen +4Vision-Language Model AdaptationLarge Vision Language Models

  58. Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)

    Apr 17, 2026Hürkan Şahin, Van Huyen Dang, Erdi Sayar +2Potential-Based Reward ShapingExternal Reward Models

  59. Reward Weighted Classifier-Free Guidance as Policy Improvement in Autoregressive Models

    Apr 16, 2026Alexander Peysakhovich, William BermanExternal Reward ModelsAutoregressive Model

  60. Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models

    Apr 16, 2026Yifu Chen, Shengpeng Ji, Zhengqing Liu +6Process Reward ModelingTurn-Taking