Curriculum RL

RL: Reinforcement Learning

Overview

Curriculum reinforcement learning studies how to arrange or adapt training experiences so an agent can master tasks that are difficult to learn all at once. Methods include staged task schedules, self-paced sampling based on success or learning progress, and adaptive curricula that generate challenges through teachers or adversarial self-play; some also scaffold exploration or change reward objectives over time. These approaches are used both in language-model post-training for reasoning, coding, and tool use, and in robotics and control, with evaluations ranging from math and agent benchmarks to manipulation, locomotion, and navigation tasks. A central challenge is choosing examples that are hard enough to teach something but still learnable, while ensuring progress transfers across tasks rather than overfitting to a narrow curriculum.

Latest papers

CardsList

132 papers16 papers in the last four weeks, down 11% on the four weeks before. 0.1% of all new papers.

  1. Let Execution Do the Teaching

    Nov 15, 2026Abhishek Mishra, Sandeep Srinivasa, Arko Chattopadhyay +2Execution-Guided Code GenerationRL for Code Generation

  2. Temporal Behavior Trees for Reinforcement Learning: Specifications as Rewards, Curricula, and Diagnostics

    Nov 10, 2026Vladimir Krsmanovic, Bernd FinkbeinerReinforcement LearningFormal Methods for RL

  3. Training Stability under Adaptive Curricula

    Nov 5, 2026Johan Obando-Ceron, Walter Mayor, Michael Dennis +2Curriculum RLRL Stability

  4. Rubric Curriculum RL: Exploiting the Generation-Verification Gap in Non-Verifiable Domains

    Nov 4, 2026Sumeet Ramesh Motwani, Tejas Krishnan, Alistair Letcher +10RL for Language ModelsRL for Generative Models

  5. FADE: Factored Ability--Difficulty Filtering for Online RLVR Scheduling

    Nov 2, 2026Tomas Duncun, Jonah Ellison, Mateo Ruiz +2Reinforcement Learning with Verifiable RewardsCurriculum RL

  6. Is It the Curriculum or Just the Easy Start? Benchmarking Unsupervised Environment Design on Quadrupeds

    Oct 29, 2026Jakub Gilewicz, Dominik Galus, Piotr WojdasRobot LearningCurriculum RL

  7. When Does Closed-Loop Curriculum Adaptation Help GRPO? An Analysis on Countdown

    Oct 28, 2026Yuv Raj Pant, Moshiur Rahman Tonmoy, Kaiqun FuRL for Language Model ReasoningCurriculum RL

  8. Discovering Jailbreaks via Curriculum of Models

    Oct 28, 2026Michał Burzyński, Noah T. Rossi, Shomit Basu +1LLM SecurityLLM Jailbreak Attacks

  9. Curriculum-Based Deep Reinforcement Learning for Robust Autonomous Rocket Landing under Atmospheric Uncertainty

    Oct 28, 2026Atin Chowdhury, Piyush JoshiReinforcement LearningRobust RL

  10. Curriculum-Driven Deep Reinforcement Learning for Autonomous Far-Range Rocket Landing

    Oct 24, 2026Atin Chowdhury, Piyush JoshiRL ControlCurriculum RL

  11. Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima

    Oct 22, 2026John J. Vastola, Ann Huang, Satpreet H. Singh +2Curriculum RLReinforcement Learning

  12. AtomicRL: Atomic Reinforcement Learning for Long-Horizon Robotic Manipulation

    Oct 21, 2026Likui Zhang, Zhe Zhu, Zhihao Zhan +7RL for RoboticsLong-Horizon Robotic Manipulation

  13. BIRD-RL: Scaling Agentic Reinforcement Learning over Stateful Data-Centric Environments

    Oct 21, 2026Ge Qu, Jinyang Li, Xiaohan Xu +6Agentic RLRL for LLM Agents

  14. HarnessRL: Co-Evolving Policies with a Just-in-Time Training Harness for Open-Ended RL

    Oct 19, 2026Xiaoqiang Wang, Ting-En Lin, Yuchuan Wu +7Rubric-Based RLReward Design for RL

  15. Predictive Bandit Curriculum Reinforcement Learning via Gradient-Based Sample Group Discovery

    Oct 19, 2026Liang Xu, Shufan Shen, Zhongni Hou +5Curriculum RLCurriculum Learning

  16. Follow the Mixed Groups: Ridge-Tracking Gaussian Sampling for Zero-Variance Web Rollouts

    Oct 18, 2026Tomas Duncun, Jonah Ellison, Owen Pell +4Adaptive SamplingSample-Efficient RL

  17. FCTS: Failure-Guided Curriculum Tree Search Over Generated Terrain for Legged Parkour

    Oct 15, 2026Narayanan Palghat Parameswaran, Dong-Ki Kim, Jay Patrikar +4Robotic ParkourLegged Robotics

  18. Where to Start, How to Move: Analyzing Curricula under GRPO for Long-Horizon LLM Agents

    Oct 14, 2026Minchan Kim, Sungho Bae, Youngjin Kim +1Long-Horizon LLM AgentsCurriculum RL

  19. CodeLift: Your Test Suite Is Secretly a Dense SWE Curriculum

    Oct 12, 2026Junjielong Xu, Huachao Zhu, Alyssa Wu +2RL for Code GenerationSoftware Engineering Agents

  20. Anchor-and-Harvest Curriculum: A Fully Unmasked Non-LLM Curriculum for Craftax

    Oct 11, 2026Jiayu Zhu, Luyuan Li, Yuyuan Shi +1Curriculum RLCurriculum Learning

  21. A Step Harder, Not a Step Too Far: The Benefits and Limits of Curriculum Difficulty Progression in GRPO

    Oct 9, 2026Ronghan Li, Fei Chen, Mingyu LuCurriculum RLCurriculum Learning

  22. AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

    Oct 9, 2026Sida Li, Yuanxin Liu, Linli Yao +4VLM ReasoningRL for VLMs

  23. Lamarck's Driving School: Discovering Autonomous Driving Training Strategies through Evolutionary Competition

    Oct 8, 2026Yichun Ye, He Zhang, Ye Tian +1Curriculum RLAutonomous Driving Scenario Generation

  24. Self-Evolve With a Reference:Anchored Training of Tool-Integrated Agents

    Oct 7, 2026Wenjie Liao, Liangjie Zhao, Zehong CaoLLM Agent Self-ImprovementSelf-Evolving Agents

  25. Anticipating the Consequences of Curriculum Decisions with Large Language Models

    Oct 3, 2026Octavio Pappalardo, Nathan Herr, Tim RocktäschelCurriculum LearningCurriculum RL

  26. Bidirectional Voronoi-biased Exploration Curriculum for Reinforcement Learning

    Oct 2, 2026Juri Pfammatter, Kaixian Qu, Clemens Schwarke +2Curriculum RLRL Exploration

  27. Prompts Live on an Arc: Gaussian Curricula in Fisher--Rao Coordinates for Rollout-Efficient GRPO

    Sep 29, 2026Mei Okonkwo, Pixel Nomand, Julian Berg +5Prompt Selection for RLGroup Relative Policy Optimization