RL from Human Feedback

RL: Reinforcement Learning

Ask about this topic

Momentum

5 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 84

All topics
CardsList

  1. A Scoping Review and Experimental Study on Reinforcement Learning from Human Feedback for Human-Robot Collaboration

    Oct 7, 2026Alexandra Coroiu, Andrea Vogt, Viktor Werbilo +3RL from Human FeedbackHuman-Robot Collaboration

    DLR Institute for AI Safety and Security, Wilhelm-Runge-Straße 10, 89081, Ulm, Germany · DLR Institute for AI Safety and Security, Rathausallee 12, 53757, Sankt Augustin, Germany

  2. Constraint Tree Exploration for Learning from Language Feedback

    Oct 6, 2026Shaoang Li, Daniel R. Jiang, Jian LiRL ExplorationRL from Human Feedback

    Stony Brook University · Meta Platforms

  3. EnGRICH: Enhancing Generative Reward Modeling with Critiques from Humans

    Oct 4, 2026Xuancheng Li, Beining Wang, Haitao Li +7Reward ModelingProcess Reward Models

    Department of Computer Science and Technology, Tsinghua University, Beijing, China · Tencent, Beijing, China

  4. Robust Risk-Sensitive Reinforcement Learning from Corrupted Human Feedback

    Sep 30, 2026Xinyi Ni, Lifeng LaiRisk-Sensitive RLRobust RL

    Department of Electrical and Computer Engineering, University of California, Davis, CA 95616, USA

  5. ReF-HIL: Shaping the Critic around Human Action Neighborhoods for Efficient Human-in-the-Loop Reinforcement Learning

    Sep 29, 2026Shaoyin Luo, Song Wang, Shibo Xia +5RL for RoboticsReward Shaping

    Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China

  6. Diffusion Reward Models

    Sep 27, 2026Xiangyang Wang, Bingxiang He, Zeyuan Liu +13Reward ModelingMultimodal Reward Modeling

    Tsinghua University · University of Illinois Urbana-Champaign

  7. Distortion of AI Alignment Revisited: RLHF is a Decent Utilitarian Aligner

    Sep 14, 2026Kazusato Oko, Annie Ulichney, Nika Haghtalab +1LLM AlignmentPreference Alignment

  8. Subspace Inference Enables Efficient Active Reward Learning from Preferences

    Sep 3, 2026Yutai Zhou, Erdem BıyıkBayesian RLPreference Learning

    Thomas Lord Department of Computer Science University of Southern California, Los Angeles, USA

  9. User Feedback Provides a Unique Signal that LLMs Can not Detect

    Sep 2, 2026Shachar Don-Yehiya, Leshem Choshen, Omri AbendLLM EvaluationRL from Human Feedback

    The Hebrew University of Jerusalem · IBM Research · MIT +1

  10. From Answers to Policies: Efficient In-Context Learning System through Emulating Expert Investigation

    Aug 17, 2026Minh-Ha Nguyen, Ngoc-Ngo Quang Tran, Thuy Dung Nguyen +1In-Context LearningIn-Context RL

    Department of Epidemiology, Vanderbilt University, Nashville, TN, USA · Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA · Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, USA +1

  11. Learning from Online User Feedback for Shopping Agents

    Aug 12, 2026Haobo Zhang, Kelong Mao, Sulong Xu +2Large Language Model-Based RecommendationUser Preference Modeling

    Gaoling School of Artificial Intelligence, Renmin University of China

  12. Procedural Fairness Failures in RLHF from Preference Averaging

    Aug 10, 2026M P V S Gopinadh, Karthik Kamuju, Kummari Avinash +2Reward ModelingAlgorithmic Fairness

    Vishnu Institute of Technology

  13. LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback

    Jul 31, 2026Manith Adikari, Bei Peng, Samuele Vinanzi +1Multi-Objective Reinforcement LearningReinforcement Learning

    Department of Computer Science, University of Manchester · Centre for Robotics & AI, University of Manchester · School of Computer Science, University of Sheffield +1

  14. Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

    Jul 28, 2026Yunpeng ChuLLM AlignmentReward Shaping

    Stony Brook University

  15. An offline approach to fNIRS-guided reinforcement learning for robot behavior

    Jul 15, 2026Julia Santaniello, Madelaine Brower, Benson Jiang +3Reinforcement LearningRobot Learning

    Tufts University, School of Engineering

  16. RENEW: Towards Learning World Models and Repairing Model Exploitation from Preferences

    Jul 15, 2026Logan Mondal Bhamidipaty, Mykel Kochenderfer, Subramanian RamamoorthyWorld Model LearningOffline RL

    University of Edinburgh · 2Stanford University

  17. Multi-Modal, Multi-Environment Machine Teaching for Robust Reward Learning

    Jul 9, 2026Ali Larian, Qian Lin, Chang Zong Wu +1Reinforcement LearningHuman-in-the-Loop AI

    Kahlert School of Computing, University of Utah.

  18. Attention Limited Reward Learning

    Jul 6, 2026Wenqian XingPairwise Preference LearningReward Modeling

    Management Science and Engineering Department, Stanford University

  19. Human-Centric Reflective Architecture for Human-AI Collaborative Decision-Making

    Jul 3, 2026Andreas Kouridakis, Dimitrios Patiniotis Spyropoulos, George VourosHuman Preference ModelingHuman-in-the-Loop AI

    University of Piraeus Piraeus, Greece

  20. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement LearningRL for Language Model Reasoning

    Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea.

  21. Qwen-Image-2.0-RL Technical Report

    Jun 25, 2026Yixian Xu, Kaiyuan Gao, Yuxiang Chen +25Reward ModelingRL for Diffusion Models

    Equal contribution. · Corresponding author.

  22. Retroactive Advantage Correction: Closed-Form V-Trace Bias Correction for Delay-Aware RLHF

    Jun 25, 2026Arnav RajAsynchronous RLReinforcement Learning

    Department of Computer Science and Engineering, Indian Institute of Technology Delhi, New Delhi, India.

  23. PEBS: Per-rater Empirical-Bayes Shrinkage for RLHF Reward-Model Calibration

    Jun 25, 2026Arnav RajReward ModelingPost-Hoc Calibration

    Department of Computer Science and Engineering, Indian Institute of Technology Delhi, New Delhi, India.

  24. Sculpting NeRF Geometry: Human-Preference Fine-Tuning of a 3D-Aware Face GAN

    Jun 25, 2026Archer Moore, Mingming Gong, Liam Hodgkinson3D Shape GenerationRL for Generative Models

    School of Mathematics and Statistics, The University of Melbourne, Parkville, VIC 3010, Australia

  25. Themis: An explainable AI-enabled framework for Reinforcement Learning with Human Feedback

    Jun 23, 2026Andreas Chouliaras, Luke Connolly, Dimitris ChatzpoulosReward ModelingHuman-in-the-Loop AI

    School of Computer Science, University College Dublin, Belfield, Dublin 4, Ireland

  26. AI Alignment From Social Choice Perspectives

    Jun 19, 2026Daniel Halpern, Evi Micha, Ariel D. Procaccia +3LLM AlignmentAI Alignment

    Google Research · University of Southern California · Harvard University

  27. Uncertainty-Aware Reward Modeling for Stable RLHF

    Jun 18, 2026Licheng Pan, Haocheng Yang, Haoxuan Li +7Reward ModelingReward Hacking

    Zhejiang University · Xiaohongshu Inc · National University of Singapore +1

  28. Generating Natural and Expressive Robot Gestures through Iterative Reinforcement Learning with Human Feedback using LLMs

    Jun 17, 2026Chris Lee, Flora Salim, Benjamin Tag +1Language Model-Based ControlHuman Motion Generation

    School of Computer Science and Engineering, University of New South Wales, Sydney, Australia · Universidad Central de Chile, Santiago, Chile

  29. ROVE: Unlocking Human Interventions for Humanoid Manipulation via Reinforcement Learning

    Jun 15, 2026Wei Xiao, Weiliang Tang, Yuying Ge +4RL for RoboticsRobotic Manipulation

    1XPENG Robotics · 2Fudan University · 3The Chinese University of Hong Kong +1

  30. Hidden Consensus:Preference-Validity Compression in Human Feedback

    Jun 9, 2026Dorcas Chia Ern Chua, Karen Myn Hui Lee, Jia Yue Tan +9Human Preference ModelingPreference Alignment

    1YTL AI Labs · 2Universiti Malaya

  31. Representation-Aware Advantage Estimation: Your Reward Model Provides More Than A Scalar Output

    Jun 9, 2026Guozheng Li, Xiyan Fu, Yiwen GuoRL for Language ModelsSample-Efficient RL

    Southeast University · Nanyang Technological University · Independent Researcher

  32. A Regret Minimization Framework on Preference Learning in Large Language Models

    Jun 8, 2026Suhwan Kim, Taehyun Cho, Geon-Hyeong Kim +4Regret Minimization in RLLLM Alignment

    Seoul National University, Seoul, South Korea · LG AI Research, Seoul, South Korea · UNIST, Ulsan, South Korea +1

  33. A Unifying Lens on Reward Uncertainty in RLHF

    Jun 8, 2026Ely Hahami, Yoel Zimmermann, Ray Zhou +1Reward ModelingKL-Regularized RL

    Harvard College, Harvard University, Cambridge, MA, USA · John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA

  34. Multilingual Sentiment Aware Text Summarization A Reinforcement Learning Approach for Consistency Maintenance

    Jun 8, 2026Mikhail Krasitskii, Alexander Gelbukh, Olga Kolesnikova +1LLM AlignmentText Summarization

    Instituto Politécnico Nacional (IPN), Centro de Investigación en Computación (CIC), Mexico City, Mexico

  35. Variational Proximal Policy Optimization

    Jun 6, 2026Ousmane Amadou DiaRL for Language Model ReasoningProximal Policy Optimization

  36. EvalStop: Using World Feedback to Detect and Correct Reward Overoptimization in Multi-Tenant RLHF Platforms

    Jun 2, 2026Guilin Zhang, Chuanyi Sun, Kai Zhao +3Early StoppingReinforcement Learning

    Workday AI Research · The George Washington University, Washington, DC, USA.

  37. When RLHF Fails: A Mechanistic Taxonomy of Reward Hacking, Collapse, and Evaluator Gaming

    Jun 2, 2026Zelalem Abahana, David Evans, Satish Mahadevan Srinivasan +1Reward HackingLLM Evaluation

    College of Engineering, The Pennsylvania State University, University Park, PA, USA · Department of Computer Science, University of Virginia, Charlottesville, VA, USA · 3Penn State Great Valley, The Pennsylvania State University, Malvern, PA, USA +1

  38. Efficient Exploration for Iterative Nash Preference Optimization

    May 31, 2026Tianlong Nan, Xiaopeng Li, Christian Kroer +1Nash EquilibriumLLM Alignment

    Columbia University⋄ · The Chinese University of Hong Kong, Shenzhen†

  39. The Representation-Rationalizability Tradeoff in Reward Learning

    May 29, 2026Jing Dong, Yaoliang Yu, Pascal PourpartPairwise Preference LearningReward Modeling

    Vector Institute · University of Waterloo & Vector Institute

  40. In-Context Reward Adaptation for Robust Preference Modeling

    May 28, 2026Zhenyu Sun, Zheng Xu, Ermin WeiHuman Preference ModelingIn-Context Learning

    Northwestern University · Meta Superintelligence Labs

  41. Training Stratigraphy: Persistent Behavioral Artifacts in Large Language Models Observed Through Longitudinal AI-Human Interaction

    May 27, 2026Chen Ying Claude, Zhihan LuoLLM AuditingHuman-in-the-Loop AI

    *Anthropic · †Independent Researcher

  42. Alignment Tampering: How Reinforcement Learning from Human Feedback Is Exploited to Optimize Misaligned Biases

    May 26, 2026Dongyoon Hahm, Dylan Hadfield-Menell, Kimin LeeLLM AlignmentData Poisoning Attacks

    1KAIST · 2MIT

  43. Learning Kernel-Based MDPs from Episodic Preferential Feedback

    May 22, 2026Nikola Pavlovic, Sattar Vakili, Qing ZhaoPairwise Preference LearningRegret Minimization in RL

    Cornell University · MediaTek Research

  44. Echo: Learning from Experience Data via User-Driven Refinement

    May 21, 2026Hande Dong, Xiaoyun Liang, Jiarui Yu +15Continual Learning for LLM AgentsLLM Agent Self-Improvement

    Tencent, CodeBuddy

  45. Implicit Safety Alignment from Crowd Preferences

    May 20, 2026Qian Lin, Daniel S. BrownSafe RLPreference-Based RL

    Kahlert School of Computing, University of Utah

  46. Conditional Equivalence of DPO and RLHF: Implicit Assumption, Failure Modes, and Provable Alignment

    May 20, 2026Zhiqin Yang, Yonggang Zhang, Wei Xue +3LLM AlignmentDirect Preference Optimization

    1The Hong Kong University of Science and Technology · 2LIGHTSPEED · 3Hong Kong Baptist University.

  47. Reinforcing Human Behavior Simulation via Verbal Feedback

    May 19, 2026Weiwei Sun, Xuhui Zhou, Jiarui Liu +13RL for Language ModelsHuman Behavior Simulation

    1Carnegie Mellon University · 2Microsoft

  48. ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks

    May 17, 2026Tianxiang Xu, Xiaoyan Zhu, Xin Lai +1Reward ModelingReinforcement Learning

    School of Computer Science and Technology, Xi’an Jiaotong University

  49. Distributed Zeroth-Order Policy Gradient for Networked Multi-agent Reinforcement Learning from Human Feedback

    May 15, 2026Pengcheng Dai, He Wang, Dongming Wang +2Policy GradientDecentralized MARL

    Singapore University of Technology and Design, Singapore 487372, Singapore · Southeast University, Nanjing 211189, China · University of California, Riverside, CA 92521, USA +2

  50. GRLO: Towards Generalizable Reinforcement Learning in Open-Ended Environments from Zero

    May 14, 2026Shangjian Yin, Yu Fu, Yue Dong +1Reinforcement LearningRL for Language Model Reasoning

    University of California, Riverside

  51. Semantic Reward Collapse and the Preservation of Epistemic Integrity in Adaptive AI Systems

    May 12, 2026William ParrisReward ModelingReward Hacking

    BDB Labs / BagelTech · San Diego, California, USA

  52. When Policy Entropy Constraint Fails: Preserving Diversity in Flow-based RLHF via Perceptual Entropy

    May 12, 2026Xiaofeng Tan, Jun Liu, Bin-Bin Gao +5Flow MatchingGenerative Modeling

    Southeast University · Tencent Youtu Lab · Southern University of Science and Technology

  53. ff-Divergence Regularized RLHF: Two Tales of Sampling and Unified Analyses

    May 7, 2026Di Wu, Chengshuai Shi, Jing Yang +1RL for Language ModelsRL from Human Feedback

    Department of Electrical and Computer Engineering, University of Virginia, Virginia, United States · Princeton Language and Intelligence, Princeton University, New Jersey, United States

  54. Mitigating Cognitive Bias in RLHF by Altering Rationality

    May 7, 2026Tiffany Horter, Andrew Markham, Niki Trigoni +1Human Preference ModelingRL from Human Feedback

    University of Oxford · Brown University

  55. Optimal Transport for LLM Reward Modeling from Noisy Preference

    May 7, 2026Licheng Pan, Haochen Yang, Haoxuan Li +8Reward ModelingNoisy-Label Learning

    Zhejiang University · Xiaohongshu Inc · National University of Singapore +2

  56. Data-dependent Exploration for Online Reinforcement Learning from Human Feedback

    May 6, 2026Zhen-Yu Zhang, Yuting Tang, Jiandong Zhang +2RL ExplorationSample-Efficient RL

    Center for Advanced Intelligence Project, RIKEN · Graduate School of Frontier Sciences, The University of Tokyo · Northeastern University +1

  57. Explaining and Preventing Alignment Collapse in Iterative RLHF

    May 5, 2026Etienne Gauthier, Francis Bach, Michael I. JordanReward HackingPolicy Gradient

    Inria, Ecole Normale Sup´erieure, PSL Research University · Ecole Normale Sup´erieure, PSL Research University · PSL Research University +1

  58. Efficient Preference Poisoning Attack on Offline RLHF

    May 4, 2026Chenye Yang, Weiyu Xu, Lifeng LaiDirect Preference OptimizationData Poisoning Attacks

    Department of Electrical and Computer Engineering, University of California, Davis, Davis, CA, USA · Department of Electrical and Computer Engineering, University of Iowa, Iowa City, IA, USA.

  59. PERSA: Reinforcement Learning for Professor-Style Personalized Feedback with LLMs

    May 1, 2026Ravi Ranjan, Utkarsh Grover, Xiaomin Lin +1Automated Code ReviewRL from Human Feedback

    Florida International University (FIU), Miami, USA

  60. Wasserstein Distributionally Robust Regret Optimization for Reinforcement Learning from Human Feedback

    Apr 30, 2026Yikai Wang, Shang Liu, Jose BlanchetRegret Minimization in RLReinforcement Learning

    Department of Statistics and Operations Research, University of North Carolina · Imperial Business School, Imperial College London · Department of Management Science and Engineering, Stanford University