LLM-Guided RL

RL: Reinforcement Learning

Overview

This field studies how large language models can help reinforcement-learning agents learn useful behavior, and how reinforcement learning can improve language models’ reasoning and tool use. Common approaches use models to propose or refine rewards, provide selective hints or curricula, generate plans and reusable skills, or supply semantic knowledge that is distilled into policies. Work spans sparse-reward robotics and game environments, multi-agent coordination, autonomous driving, and language-model reasoning tasks. A central challenge is making guidance reliable and transferable: changing or inaccurate rewards can destabilize learning, and gains against model-based judges may reflect reward hacking rather than better real-world behavior.

Latest papers

CardsList

156 papers17 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

  1. Jev-as-a-Reward: Validating Probabilistic Safety Judges for Reinforcement Learning

    Nov 16, 2026Eunkyeong Lee, Junhyung Moon, Seunggwan Hong +1AI Safety EvaluationLLM-as-a-Judge

  2. Actor, Judge, or Teacher? Understanding Decision Models in Long-Horizon Agents

    Nov 12, 2026Haochen Liu, Qianhao Zhu, Zixuan Wang +7LLM Decision-MakingLLM-Guided RL

  3. LLM-Enhanced Deep Reinforcement Learning with Human-in-the-Loop Calibration for Real-Time Optimal Power Flow

    Nov 11, 2026Jiayang Tu, Bozhen Jiang, Bojun Du +3Optimal Power FlowLLM-Guided RL

  4. AutoScaffold: AI-Guided Scaffolding for Reinforcement Learning of Language Models

    Nov 10, 2026Zijian Zhang, Rizhen Hu, Jiangweizhi Peng +4RL for Language ModelsLLM-Guided RL

  5. RM-VLM: From Natural-Language Task Descriptions to Vision-Grounded Reward Machines

    Nov 5, 2026Roko Parac, Christos Ziakas, Leo Ardon +1Reward MachinesReinforcement Learning

  6. The Blindfolded Controller: Decision Model-Guided Training for Reinforcement Learning

    Nov 5, 2026Muhammad Ibrahim Khan, Aniket Dixit, Faizan Ahmed +1Reinforcement LearningSparse-Reward RL

  7. LLMs as MDP Designers: A Dependency-Aware Agentic Framework for Automated Robot Policy Generation

    Nov 3, 2026Hong Je-Gal, Jinwoo Kim, Chanbin Yi +1LLM-Guided RLRobotic RL

  8. Decision Transformer with Task-Aware Representations for Offline Meta-Reinforcement Learning

    Nov 2, 2026Xinbo Zhao, Yuhang Liu, Xin Zhang +3Meta-Reinforcement LearningOffline RL

  9. SGR-OPSD: Learning from Subgoal Plans with Graph-Regularized Credit Assignment for Agentic Reinforcement Learning

    Nov 2, 2026Shu Liu, Yang Chong, WenShi Chen +1Reinforcement LearningRL for LLM Agents

  10. PIVOT: Progressive Intervention via Online Teacher Correction

    Oct 29, 2026Zhihao Yang, Boyuan Zheng, Puhui Tan +7RL for Language Model ReasoningLLM-Guided RL

  11. Learning to Reason from Reference Samples Alone: Reinforced Adversarial Learning for Modern LLM Post-Training

    Oct 28, 2026Albert Bou, Javier Valdes-Aleman, Jon M. Laurent +4RL for Language Model ReasoningLLM Post-Training

  12. GARDEN: Generalist Autonomous Reward Design Through Evidence Navigation for Cooperative Multi-Agent Reinforcement Learning

    Oct 27, 2026Dogan UrgunReward Design for RLCooperative MARL

  13. R2E:R^2E: A Role-driven Reward Evolutionary Framework for Automated Reward Function Design

    Oct 23, 2026Shouhao Chang, Xuan Liu, Hongye Zhu +2Reward Design for RLLLM-Guided RL

  14. MOER: Mix-Policy Optimization under Expert Prefix Guidance with Selective Rollback

    Oct 22, 2026Xuyang Zhong, Jiuding Yang, Yiwen Guo +1RL for Language Model ReasoningPolicy Optimization

  15. RANGER: Retrieval Agent for Navigating Graphs with Semantic Evaluation Rewards

    Oct 20, 2026Artem Mikhaylov, Pavel Konoplev, Nikolay Efanov +2Knowledge Graph Question AnsweringLLM-Guided RL

  16. HarnessRL: Co-Evolving Policies with a Just-in-Time Training Harness for Open-Ended RL

    Oct 19, 2026Xiaoqiang Wang, Ting-En Lin, Yuchuan Wu +7Rubric-Based RLReward Design for RL

  17. ClinSDT: LLM-Encoded Clinical Semantic Guidance for Sepsis Treatment via Decision Transformer

    Oct 18, 2026Yanyan Wu, Guanyu Zhu, Changbin Zhao +7HealthcareClinical Decision-Making

  18. Progress Reward Model for Reinforcement Learning via Large Language Models

    Oct 15, 2026Xiuhui Zhang, Ning Gao, Xingyu Jiang +4Reward Design for RLLLM-Guided RL

  19. Can Jev be Your Q or Policy in Reinforcement Learning?

    Oct 8, 2026Yi Ma, Tianpei Yang, Yaodong Yang +2LLM-Guided RLSample-Efficient RL

  20. Ask the Expert: LLM-Guided Reinforcement Learning for Autonomous Cyber Defense

    Oct 7, 2026Fernando Martinez, Abhishek Satyam, Tao Li +3Autonomous Cyber DefenseLLM-Guided RL

  21. Rationale-Guided Policy Optimization: Learning to Reason with Adaptive Rationale Scaffolding

    Oct 5, 2026Hoang Phan, Minh Pham, Chau Pham +3RL for Language Model ReasoningLLM-Guided RL

  22. An LLM-in-the-loop RL Framework for Bioinformatics Feature Selection

    Oct 4, 2026Xinyuan Wang, Deepti Agrawal, Yanjie FuReinforcement LearningLLM-Guided RL

  23. Anticipating the Consequences of Curriculum Decisions with Large Language Models

    Oct 3, 2026Octavio Pappalardo, Nathan Herr, Tim RocktäschelCurriculum LearningCurriculum RL

  24. LocusRL: Diagnosing LLM Reward and Policy Interventions in Competitive Games

    Oct 3, 2026Chengyu Luan, Bo Xin, Songyan Guo +4RL for Game AIReinforcement Learning

  25. A Bird's-Eye View of Iterative Reward Design

    Oct 3, 2026Logan Mondal Bhamidipaty, Lauren Robson, Linda Petrini +2Reward Design for RLLLM-Guided RL