External Reward Models

Ask about this topic

Recent momentum

-36%

7 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in External Reward Models

Neighbouring directions

Process Reward ModelingSparse RewardsReward ModelingPotential-Based Reward ShapingOutcome-Based RewardsReasoning-Aware RewardShared Rewards

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

5 new papers

A weekly snapshot of new work published in External Reward Models.

80 papers

Latest in External Reward Models

Browse all topics →
CardsList

  1. CellRFT: Reinforcement Fine-Tuning for Single-Cell Perturbation Modeling

    Sep 17, 2026Jie Yan, Li Liu, Hanze Guo +7Single-Cell Perturbation PredictionReinforcement Fine-Tuning

  2. Intrinsic Robot Rewarding: Reusing VLA Representations for Autonomous Evaluation and Policy Improvement

    Sep 15, 2026Tobias Schaffer, Mohab Elkhayat, Daniela Nicklas +2External Reward ModelsVision-Language-Action Models

  3. Learning to Coach for Experiential Learning

    Sep 14, 2026Guanheng Chen, Tianzhu Ye, Li Dong +3Experience-Driven LearningCurriculum Reinforcement Learning

  4. Specifying Reward Functions for RL Without Environment Sampling

    Sep 14, 2026Stephane Hatgis-Kessell, W. Bradley Knox, Emma BrunskillExternal Reward Models

  5. Strong and Compact Policies for Submodular Markov Decision Processes via LP-Based Submodular Orienteering

    Sep 14, 2026Lars Rohwedder, Rico ZenklusenMarkov Decision ProcessesSubmodular Maximization

  6. Why Sample What You Can Enumerate? Exact Policy Optimization for Genomic Tool Selection

    Sep 9, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2Group Relative Policy OptimizationExternal Reward Models

  7. Learning to Zoom Efficiently with a Contrastive Curriculum

    Sep 2, 2026Falko Helm, Iryna GurevychCurriculumExternal Reward Models

  8. Towards Socially Compliant Navigation in Deep Reinforcement Learning via Proxemics-Based Reward Modeling

    Aug 13, 2026Takieddine Soualhi, Jacques Saraydaryan, Laetitia MatignonSocial Robot NavigationNavigation

  9. A Framework for Designing Reward Functions: From Objectives to Features to Human-Aligned Reward Functions

    Aug 12, 2026Di Yang Shi, W. Bradley KnoxExternal Reward ModelsObjectives

  10. Multiscale Reward Hedging from Correct Demonstrations

    Aug 7, 2026Pahan DewasurendraO(T^Β)$ Simultaneous RegretExternal Reward Models

  11. PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Adaptive SamplingExternal Reward Models

  12. Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning

    Aug 5, 2026Jai Malegaonkar, Rohan Patil, Henrik I. ChristensenSparse RewardsExternal Reward Models

  13. Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding

    Aug 4, 2026Xiuyuan Zhu, Ke Lu, Kun Dong +6Explicit Visual GroundingVisual Tokens

  14. Optimising for Flourishing: Flourishing Metrics and Return on Flourishing as Success Criteria for Artificial Intelligence and Post-AGI Economic Systems

    Jul 31, 2026Keyun Ruan, Jonathan D. Teubner, John M. BremenArtificial Intelligence SystemsEconomies

  15. SERPO: Self-Evolving Rubric Policy Optimization for Open-Ended Test-Time Reinforcement Learning

    Jul 29, 2026Jianze Wang, Kunwang Zheng, Ying Liu +5Open-Ended ResponsesExternal Reward Models

  16. Top-kk Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selection

    Jul 28, 2026Nicolas Gutowski, Fabien Chhel, Alexandre Letard +1Multi-Armed BanditsPareto Frontier

  17. ODYSSE: Episode-wise Policy Optimization for Personalized Agentic Reasoning

    Jul 28, 2026Jiaqi Zhang, Tong Chen, Junliang Yu +2Agentic ReasoningMulti-Objective Policy Optimization

  18. Structure-aware Relative Policy Optimization for Ranking

    Jul 28, 2026Yiteng Tu, Weihang Su, Zitao Su +3RankingExternal Reward Models

  19. Principled Direction-Free Intrinsic Motivation through Model-Free Epistemic Free-Energy Estimators

    Jul 18, 2026Alireza Furutanpey, Schahram DustdarIntrinsic MotivationExternal Reward Models

  20. Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning

    Jul 15, 2026Dingsu Wang, Filip Ryzner, Kelly He +12Recommender SystemsAnalytics

  21. Learning Safe Agent Behaviour from Human Preferences and Justifications via World Models

    Jul 14, 2026Ilias Kazantzidis, Timothy J. Norman, Yali Du +1Simulation-Based Reinforcement LearningExternal Reward Models

  22. Generalizing Preference-based Reinforcement Learning: a Rationality Model for Incomparability

    Jul 13, 2026Simone Drago, Marco Mussi, Leonardo Bianconi +1Entropy Regularized Reinforcement LearningExternal Reward Models

  23. Efficient Online Proportional Sampling with Applications to Smoothed Online Learning

    Jul 13, 2026Amirmahdi Mirfakhar, Maria-Florina Balcan, Hedyeh BeyhaghiLearning-Augmented AlgorithmsOptimal Sample Complexity

  24. Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing

    Jul 10, 2026Ajay Narayanan Sridhar, Ronak Singh, Mehrdad Mahdavi +1Large Language Model RoutingMulti-Armed Bandits

  25. Improving LLM-Generated Process Model Quality Through Reinforcement Learning: The Role of Reward Function Design

    Jul 7, 2026Alexander Rombach, Chantale Lauer, Nijat MehdiyevReliable Medical Process-Level Reward Model Evaluation FrameworkExternal Reward Models

  26. Regime-Conditional Stabilisation of LLM-Augmented Cooperative Multi-Agent Reinforcement Learning

    Jul 5, 2026Faid Keddouri, Sohaib Houhou, Aissa Boulmerka +1Potential-Based Reward ShapingMulti-Agent Reinforcement Learning

  27. Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Grounding

    Jul 5, 2026Zihan Zhang, Xize Cheng, Wenhao Yan +5Large Audio Language ModelsDense Temporal Annotation

  28. Optimizing Visual Generative Models via Distribution-wise Rewards

    Jul 2, 2026Ruihang Li, Mengde Xu, Shuyang Gu +4Generative ModelsExternal Reward Models

  29. LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression

    Jul 2, 2026Bowen Yuan, Zijian Wang, Yadan Luo +2Large Vision Language ModelsLens

  30. Simulation Based Reward Function Validation for Multi-Agent On Orbit Inspection

    Jul 1, 2026Patrick Quinn, Bala Prenith Reddy Gopu, George M. Nehma +1Multi-Agent Reinforcement LearningSpacecraft

  31. VLM-AR3L: Vision-Language Models for Absolute and Relative Rewards in Reinforcement Learning

    Jul 1, 2026Kuan-Chen Chen, Winston Chen, Wei-Fang Sun +1External Reward Models

  32. UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

    Jun 30, 2026Yaozhi Zheng, Yilei Jiang, Manyuan Zhang +5Visual GenerationCode Generation

  33. Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

    Jun 25, 2026Ritesh Thawkar, Shravan Venkatraman, Omkar Thawakar +5Remote Sensing Image Change CaptioningSelf-Consistency

  34. Inverse Reinforcement Learning for Interpretable Keystroke Biomarkers in Parkinson's Disease

    Jun 24, 2026Navin BondadeParkinsonPublic Neuroqwerty

  35. Reinforcement Learning for Computer-Use Agents with Autonomous Evaluation

    Jun 23, 2026Marta Sumyk, Oleksandr KosovanGraphical User Interface AgentsComputer-Use Agents

  36. CFPO: Counterfactual Policy Optimization for Multimodal Reasoning

    Jun 22, 2026Zhangyuan Yu, Wanran Sun, Guangjing Yang +2Multimodal ReasoningLarge Vision Language Models

  37. Scalable Multi-Task Data Generation via Reinforcement Learning for Language-Conditioned Bimanual Dexterous Manipulation

    Jun 21, 2026Zechu Li, Yufeng Jin, Puze Liu +2Bimanual ManipulationDexterous Manipulation

  38. Improving Text-to-Music Generation with Human Preference Rewards

    Jun 19, 2026Yonghyun Kim, Junwon Lee, Haiwen Xia +2Music GenerationTuning

  39. Post-Training Speech Enhancement Language Models with Perceptual Rewards

    Jun 19, 2026Frédéric Berdoz, Luca A. Lanzendörfer, Antonis Asonitis +1Speech EnhancementEnhancement

  40. Reward-free Pretraining for Reinforcement Learning via Occupancy Coverage Maximization

    Jun 19, 2026Marco Pratticò, Pietro Novelli, Massimiliano Pontil +1Sparse RewardsExternal Reward Models

  41. When Do Intrinsic Rewards Work for Code Reasoning? A Comprehensive Study

    Jun 18, 2026Xiaolong Jin, Xuandong Zhao, Wenbo Guo +2Code GenerationReinforcement Learning With Verifiable Reward

  42. The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL

    Jun 17, 2026Nicolas Beltran-Velez, Felix Friedrich, Zhang Xiaofeng +4Training-Free Reward AlignmentHierarchical Flow Matching

  43. MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning

    Jun 16, 2026Wanshi Xu, Haokun Zhao, Haidong Yuan +2Mathematical ReasoningFine-Grained Perception

  44. Video-Based Optimal Transport for Feedback-Efficient Offline Preference-Based Reinforcement Learning

    Jun 15, 2026Tung M. Luu, Hwanhee Kim, Younghwan Lee +1Reinforcement Learning From Human FeedbackExternal Reward Models

  45. PersonaDrive: Human-Style Retrieval-Augmented VLA Agents for Closed-Loop Driving Simulation

    Jun 10, 2026Mahmoud Srewa, Praneetsai Iddamsetty, Mohammad Abdullah Al Faruque +1Autonomous Driving SimulationDrives

  46. A Unifying Lens on Reward Uncertainty in RLHF

    Jun 8, 2026Ely Hahami, Yoel Zimmermann, Ray Zhou +1Reinforcement Learning From Human FeedbackExternal Reward Models

  47. RREDCoT: Segment-Level Reward Redistribution for Reasoning Models

    Jun 4, 2026Mykyta Ielanskyi, Kajetan Schweighofer, Lukas Aichberger +1Large Reasoning ModelsCredit Assignment

  48. Trading Human Curation for Synthetic Augmentation in RLVR

    Jun 2, 2026Akshansh, Leonardo Rosa Rodrigues, Michael Korostelev +2Reinforcement Learning With Verifiable RewardSearch-Augmented Reasoning

  49. Before the Model Learns the Bug:Fuzzing RLVR Verifiers

    May 31, 2026Jaideep RayReinforcement Learning With Verifiable RewardVerifiable Rewards

  50. Sample-Efficient Post-Training for LEGO Spatial-Physics Reasoning

    May 29, 2026Yuhuan Yuan, Zhouliang Yu, Minghao Liu +2Building BlocksSpatial Reasoning

  51. Beyond Trajectory Rewards: Step-level Credit Assignment for Agentic Search via Graph Modeling

    May 28, 2026Yuchen Liu, Yingjie Feng, Lixiong Qin +5Credit AssignmentTrajectory-Level Credit

  52. Momentum Based Reward Design for Low Emission Traffic Signal Control

    May 28, 2026Chinmay Mundane, Amith Manoharan, Arun Kumar SinghAdaptive Traffic Signal ControlDeep Reinforcement Learning

  53. OccuReward: LLM-Guided Occupant-Centric Reward Shaping for Demographic Equity in Grid-Interactive Buildings

    May 27, 2026Shadmehr Zaregarizi, Khashayar YavariExternal Reward ModelsDemographics

  54. Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR

    May 19, 2026Utkarsh Tyagi, Xingang Guo, MohammadHossein Rezaei +5Rubric-Based Reinforcement LearningRubric Framework

  55. A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditions

    May 18, 2026Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy +1Quadrotor ControlIterative Reinforcement Learning

  56. Diff-Instruct with Diffused Reward: Towards Principled One-step Generator RL

    May 18, 2026Junyi Wu, Weijian Luo, Haoyang Zheng +2Text-To-Image Diffusion ModelsText-To-Image

  57. PAIR: Prefix-Aware Internal Reward Model for Multi-Turn Agent Optimization

    May 18, 2026Wonjoong Kim, Yeonjun In, Sangwu Park +2Group Relative Policy OptimizationExternal Reward Models

  58. Optimized Three-Dimensional Photovoltaic Structures with LLM guided Tree Search

    May 15, 2026Michael P. Brenner, Lizzie Dorfman, John C. PlattPhotovoltaicTree Search

  59. Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping

    May 11, 2026Haoyuan Sun, Jing Wang, Yuxin Song +9Text-To-ImageReinforcement Learning Post-Training

  60. Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria

    May 8, 2026Juanxi Tian, Fengyuan Liu, Jiaming Han +6RubricsExternal Reward Models