Reinforcement Learning From Human Feedback

Ask about this topic

Recent momentum

+20%

6 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Reinforcement Learning From Human Feedback.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Reinforcement Learning From Human Feedback.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Reinforcement Learning From Human Feedback.

80 papers

Latest in Reinforcement Learning From Human Feedback

Browse all topics →
CardsList

  1. Towards Interaction Regulation from Human Feedback via Free Energy Minimization

    Sep 16, 2026Maria Paula Diaz Monfort, Cinzia Tomaselli, Michael Richardson +1Human-Robot InteractionControl System Operator Learning

  2. Distortion of AI Alignment Revisited: RLHF is a Decent Utilitarian Aligner

    Sep 14, 2026Kazusato Oko, Annie Ulichney, Nika Haghtalab +1Reinforcement Learning From Human FeedbackArtificial Intelligence Alignment

  3. Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models

    Sep 8, 2026Jing Liu, Marianne Schweitzer, Abdellah FourtassiGrammaticalityFeedback Learning

  4. Risk-Conditioned Fine-Tuning of Large Language Models

    Sep 8, 2026Zixuan Liu, Fangzheng Wu, Brian Summa +1Large Language Model SafetyReinforcement Fine-Tuning

  5. Subspace Inference Enables Efficient Active Reward Learning from Preferences

    Sep 3, 2026Yutai Zhou, Erdem BıyıkReinforcement Learning From Human FeedbackPreference Learning

  6. The Rise of Verbal Reinforcement Learning

    Sep 1, 2026Kshitij Tayal, Arun Sharma, Genta Indra Winata +2Reinforcement Learning With Verifiable RewardReinforcement Learning From Human Feedback

  7. Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue

    Aug 11, 2026Yi Wei, Shuo Jiang, Huaixia Dou +5EmpathyReinforcement Learning From Human Feedback

  8. Procedural Fairness Failures in RLHF from Preference Averaging

    Aug 10, 2026M P V S Gopinadh, Karthik Kamuju, Kummari Avinash +2Reinforcement Learning From Human Feedback

  9. EvoHIL: Self-Evolving Reward and Flow-Matched Policy Optimization for Robust Human-in-the-Loop Reinforcement Learning

    Aug 4, 2026Shuoqin Zhang, Tongtong Cheng, Xiru Gao +7Human-In-The-LoopReinforcement Learning From Human Feedback

  10. Personalizing Large Language Model Agents with Small Policy Models

    Jul 31, 2026Dian Jin, Zhi Zhang, Huichao Li +3Large Language Model AgentsAgentic Reinforcement-Learning Framework

  11. Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

    Jul 28, 2026Yunpeng ChuReinforcement Learning From Human FeedbackPotential-Based Reward Shaping

  12. How Fast Can Reward Models Score? A Systems Study of C++ and PyTorch Inference Runtimes for RLHF

    Jul 22, 2026Venkata Naga Sai Vishnu Rohit Pulipaka, Anish Katta, Deva Rohit Reddy PeddireddyPytorchReinforcement Learning From Human Feedback

  13. RENEW: Towards Learning World Models and Repairing Model Exploitation from Preferences

    Jul 15, 2026Logan Mondal Bhamidipaty, Mykel Kochenderfer, Subramanian RamamoorthyOffline Reinforcement LearningReinforcement Learning From Human Feedback

  14. Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF

    Jul 8, 2026Eric Zhu, Abhinav Shrivastava, Soumik MukhopadhyayReinforcement Learning From Human FeedbackReward Gradients

  15. Human-Machine Collaboration on Generative Meta-Learning: Model and Algorithm

    Jul 1, 2026Midhun Parakkal Unni, Samuel KaskiMeta-LearningReinforcement Learning From Human Feedback

  16. Reinforcement Learning with Metacognitive Feedback Elicits Faithful Uncertainty Expression in LLMs

    Jun 30, 2026Gabrielle Kaili-May Liu, Avi Caciularu, Gal Yona +2MetacognitionLarge Language Model Uncertainty

  17. What Drives Interactive Improvement from Feedback?

    Jun 29, 2026Bartłomiej Cupiał, Jan Łojek, Mikołaj Garstecki +3Feedback LearningFeedback Loop

  18. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement Learning From Human FeedbackCritic-Free Reinforcement Learning

  19. Retroactive Advantage Correction: Closed-Form V-Trace Bias Correction for Delay-Aware RLHF

    Jun 25, 2026Arnav RajReinforcement Learning From Human FeedbackDeep Reinforcement Learning

  20. PEBS: Per-rater Empirical-Bayes Shrinkage for RLHF Reward-Model Calibration

    Jun 25, 2026Arnav RajReinforcement Learning From Human Feedback

  21. Designing Reward Signals for Portable Query Generation: A Case Study in Industrial Semantic Job Search

    Jun 25, 2026Ping Liu, Qianqi Shen, Jianqiang Shen +11Reinforcement Learning From Human FeedbackCase Study

  22. Themis: An explainable AI-enabled framework for Reinforcement Learning with Human Feedback

    Jun 23, 2026Andreas Chouliaras, Luke Connolly, Dimitris ChatzpoulosReinforcement Learning From Human FeedbackDeep Reinforcement Learning

  23. Uncertainty-Aware Reward Modeling for Stable RLHF

    Jun 18, 2026Licheng Pan, Haocheng Yang, Haoxuan Li +7Reinforcement Learning From Human FeedbackGroup Relative Policy Optimization

  24. Video-Based Optimal Transport for Feedback-Efficient Offline Preference-Based Reinforcement Learning

    Jun 15, 2026Tung M. Luu, Hwanhee Kim, Younghwan Lee +1Reinforcement Learning From Human FeedbackExternal Reward Models

  25. Hidden Consensus:Preference-Validity Compression in Human Feedback

    Jun 9, 2026Dorcas Chia Ern Chua, Karen Myn Hui Lee, Jia Yue Tan +9Preference AlignmentReinforcement Learning From Human Feedback

  26. Representation-Aware Advantage Estimation: Your Reward Model Provides More Than A Scalar Output

    Jun 9, 2026Guozheng Li, Xiyan Fu, Yiwen GuoReinforcement Learning From Human FeedbackDeep Reinforcement Learning

  27. The Neutral Mask: How Alignment Training Provides Shallow Alignment while Leaving Partisan Structure Intact in a Large Language Model

    Jun 8, 2026Wendy K. TamLarge Language Model AlignmentReinforcement Learning From Human Feedback

  28. A Regret Minimization Framework on Preference Learning in Large Language Models

    Jun 8, 2026Suhwan Kim, Taehyun Cho, Geon-Hyeong Kim +4Reinforcement Learning From Human FeedbackPreference Learning

  29. A Unifying Lens on Reward Uncertainty in RLHF

    Jun 8, 2026Ely Hahami, Yoel Zimmermann, Ray Zhou +1Reinforcement Learning From Human FeedbackExternal Reward Models

  30. MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU

    Jun 3, 2026Kun Cheng, Songshuo Lu, Sicong Liao +7Graphics Processing Unit KernelsLarge Models

  31. BiasGRPO: Stabilizing Bias Mitigation in High-Variance Reward Landscapes via Group-Relative Policy Optimization

    Jun 3, 2026Saket Reddy, Ke Yang, ChengXiang ZhaiGroup Relative Policy OptimizationReinforcement Learning From Human Feedback

  32. EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

    Jun 2, 2026Guilin Zhang, Chuanyi Sun, Kai Zhao +3Reinforcement Learning From Human FeedbackOptimal Scheduling

  33. Preference-Calibrated Human-in-the-Loop Reinforcement Learning for Robotic Manipulation

    Jun 2, 2026Zeyi Liu, Guangyao Liu, Yinuo Qu +6Reinforcement Learning From Human FeedbackHuman-In-The-Loop

  34. When RLHF Fails: A Mechanistic Taxonomy of Reward Hacking, Collapse, and Evaluator Gaming

    Jun 2, 2026Zelalem Abahana, David Evans, Satish Mahadevan Srinivasan +1Reinforcement Learning From Human FeedbackCollapse

  35. Efficient Exploration for Iterative Nash Preference Optimization

    May 31, 2026Tianlong Nan, Xiaopeng Li, Christian Kroer +1Reinforcement Learning From Human FeedbackExploration-Exploitation Dilemma

  36. From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning

    May 31, 2026Jun-Jie Yang, Chia-Heng Hsu, Kui-Yuan Chen +1Offline Reinforcement LearningReinforcement Learning From Human Feedback

  37. The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement

    May 29, 2026Xiaobo Wang, Tong Wu, Min Tang +3Reinforcement Learning From Human FeedbackOn-Policy

  38. Calibrated Preference Learning: The Case of Label Ranking

    May 28, 2026Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann +2Late-Stage RankerMulticalibration and Calibration

  39. In-Context Reward Adaptation for Robust Preference Modeling

    May 28, 2026Zhenyu Sun, Zheng Xu, Ermin WeiReinforcement Learning From Human FeedbackArtificial Intelligence Alignment

  40. Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases

    May 26, 2026Dongyoon Hahm, Dylan Hadfield-Menell, Kimin LeeLarge Language Model AlignmentReinforcement Learning From Human Feedback

  41. Reinforcement Learning from Denoising Feedback

    May 25, 2026Qi He, Huan Chen, Ya Guo +3Diffusion Language ModelsReinforcement Learning From Human Feedback

  42. RL with Learnable Textual Feedback: A Bilevel Approach

    May 23, 2026Utsav Singh, Sidhaarth Sredharan, Souradip Chakraborty +1Reinforcement Learning From Human FeedbackLarge Language Model Reasoning

  43. Learning Kernel-Based MDPs from Episodic Preferential Feedback

    May 22, 2026Nikola Pavlovic, Sattar Vakili, Qing ZhaoReinforcement Learning From Human FeedbackEntropy Regularized Reinforcement Learning

  44. Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning

    May 22, 2026Sijia Li, Xiaoyu Tan, Qixing Wang +7Human-In-The-LoopClinical Decision Support

  45. Conditional Equivalence of DPO and RLHF: Implicit Assumption, Failure Modes, and Provable Alignment

    May 20, 2026Zhiqin Yang, Yonggang Zhang, Wei Xue +3Direct Preference OptimizationReinforcement Learning From Human Feedback

  46. Diff-Instruct with Diffused Reward: Towards Principled One-step Generator RL

    May 18, 2026Junyi Wu, Weijian Luo, Haoyang Zheng +2Text-To-Image Diffusion ModelsText-To-Image

  47. ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks

    May 17, 2026Tianxiang Xu, Xiaoyan Zhu, Xin Lai +1Reinforcement Learning From Human FeedbackSupervised Fine-Tuning

  48. Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment

    May 17, 2026Yucong Huang, Xiucheng Li, Kaiqi Zhao +1Large Language Model AlignmentReinforcement Learning From Human Feedback

  49. OHP-RL: Online Human Preference as Guidance in Reinforcement Learning for Robot Manipulation

    May 15, 2026Yunyang Mo, Jian Li, Qiwei Wu +2Reinforcement Learning From Human FeedbackMulti-Objective Policy Optimization

  50. Distributed Zeroth-Order Policy Gradient for Networked Multi-agent Reinforcement Learning from Human Feedback

    May 15, 2026Pengcheng Dai, He Wang, Dongming Wang +2Multi-Agent Reinforcement LearningReinforcement Learning From Human Feedback

  51. Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancy

    May 13, 2026Adarsh Kumarappan, Ananya MujooSycophancyReinforcement Learning From Human Feedback

  52. When Policy Entropy Constraint Fails: Preserving Diversity in Flow-based RLHF via Perceptual Entropy

    May 12, 2026Xiaofeng Tan, Jun Liu, Bin-Bin Gao +5DiversityReinforcement Learning From Human Feedback

  53. SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs

    May 12, 2026Xiaoyuan Li, Moxin Li, Keqin Bao +4Skill EvolutionAgentic Reinforcement-Learning Framework

  54. Learning the Preferences of a Learning Agent

    May 9, 2026Karim Abdel Sadek, Mark Bedaywi, Rhys Gould +1Preference LearningEntropy Regularized Reinforcement Learning

  55. ff-Divergence Regularized RLHF: Two Tales of Sampling and Unified Analyses

    May 7, 2026Di Wu, Chengshuai Shi, Jing Yang +1Bregman DivergencesReinforcement Learning From Human Feedback

  56. Mitigating Cognitive Bias in RLHF by Altering Rationality

    May 7, 2026Tiffany Horter, Andrew Markham, Niki Trigoni +1Reinforcement Learning From Human FeedbackRationality

  57. RVPO: Risk-Sensitive Alignment via Variance Regularization

    May 7, 2026Ivan Montero, Tomasz Jurczyk, Bhuwan DhingraReinforcement Learning From Human FeedbackRegularization Techniques

  58. Multi-Dimensional Behavioral Evaluation of Agentic Stock Prediction Systems Using Large Language Model Judges with Closed-Loop Reinforcement Learning Feedback

    May 7, 2026Mohammad Al Ridhawi, Mahtab Haj Ali, Hussein Al OsmanAgentic EvaluationsAgentic Systems

  59. Data-dependent Exploration for Online Reinforcement Learning from Human Feedback

    May 6, 2026Zhen-Yu Zhang, Yuting Tang, Jiandong Zhang +2Reinforcement Learning From Human FeedbackExploration-Exploitation Dilemma

  60. Explaining and Preventing Alignment Collapse in Iterative RLHF

    May 5, 2026Etienne Gauthier, Francis Bach, Michael I. JordanReinforcement Learning From Human FeedbackMulti-Objective Policy Optimization