Generalization in RL

RL: Reinforcement Learning

Overview

The field asks whether an agent can act effectively when goals, layouts, visual inputs, dynamics, or collaborators differ from training, a requirement for reliable deployment. Common approaches include domain randomization and exploration for broader state coverage, invariant or task-conditioned representations, meta-learning, curricula, reusable skills, and Bayesian or model-based transfer. Researchers evaluate these methods in settings such as Procgen, MuJoCo, MetaWorld, DeepMind Control, robotics, and language-based agents, using held-out tasks, environments, and visual or dynamics shifts. A central tension is that diversity and regularization can improve transfer but hinder learning or retention, while benchmark design and metrics can make apparent generalization gains hard to interpret.

Latest papers

CardsList

97 papers10 papers in the last four weeks, down 47% on the four weeks before. 0.1% of all new papers.

  1. Stack more levels: how to get general and human-like Mario playing

    Nov 12, 2026Shinichi Arimura, Yuchen Li, Julian TogeliusGame-Playing AgentsRL for Game AI

  2. Meta-Reinforcement Learning with Zero-Shot Reinforcement Learning

    Nov 7, 2026Jake Grigsby, Siddhant Agarwal, Yu Lei +2Meta-Reinforcement LearningZero-Shot RL

  3. Harness-S: Learning from Sibling Harnesses for Generalizable Agent Training

    Nov 3, 2026Kangning Zhang, Wenxiang Jiao, Bowen Fang +8Agent Harness OptimizationAgent Harness Self-Evolution

  4. Before We Adapt: The Zero-Shot Generalization Bottleneck in Continual World Models

    Oct 29, 2026Amir Mesbah, Di WuContinual RLWorld Model Learning

  5. Harness Scaling for Generalizable Agentic Reinforcement Learning

    Oct 21, 2026Fei Bai, Huatong Song, Chuan Hao +5Agentic RLLLM Agent Harnesses

  6. Reframing Object-Centric Reinforcement Learning: From Absolute to Relative Representations

    Oct 20, 2026Cedric Derstroff, Jannis Blüml, Janosch Moos +4Object-Centric RLReinforcement Learning

  7. Co-Evolving Policy and Reward for Code Generation: A Mechanistic Study of Single-Adapter Drift

    Oct 19, 2026Amarsaikhan Batjargal, Noriko TomuroRL for Code GenerationReinforcement Learning

  8. Robust Reinforcement Learning for Dynamic Treatment Regimes under Model and Measurement Uncertainty

    Oct 15, 2026Chengze Xie, Xuan Wang, Ying Ding +2Robust RLSequential Decision Making

  9. What Happens to the Goal? Distinct Failures of Policy Alignment in Goal Misgeneralization

    Oct 14, 2026Julia Barth, Armin Sommer, Kunvar Thaman +1AI AlignmentGeneralization in RL

  10. Imagining Goals with Geometric Horizon Models for Policy Generalization

    Oct 13, 2026Daniel Lawson, Dhruv Sreenivas, Adriana Hugessen +2Robot Policy GeneralizationGeneralization in RL

  11. An Informational Curse of Horizon in Goal-Conditioned Policy Learning

    Oct 7, 2026John L. Zhou, Yuxuan Dong, Jonathan C. KaoGoal-Conditioned RLGeneralization in RL

  12. Considering Context: When World Models Need Context Encoders

    Oct 5, 2026Oleg Smirnov, Sofiane Ennadir, John Pertoft +2Reinforcement LearningWorld Model Learning

  13. How RL Reshapes LLM Reasoning: Transferability, Coverage, and Scaling Laws

    Oct 3, 2026Ziheng Cheng, Yixiao Huang, Hanlin Zhu +1RL for Language Model ReasoningReinforcement Learning

  14. Mastering Atari 2600 Games with Discovered Options

    Oct 2, 2026Erik M. Lintunen, Marlos C. MachadoRL for Game AIHierarchical RL

  15. VIGOR: Zero-Shot Visual Generalization via Latent-Space Consistency in Model-Based Reinforcement Learning

    Oct 2, 2026Mingyu Park, Samyeul Noh, Hyun Myung +1Latent-Space RegularizationGeneralization in RL

  16. Reward as Observation: Learning Reward-Based Policies for Rapid Adaptation

    Sep 30, 2026Morgan Byrd, Jacob Blevins, Maks Sorokin +2Generalization in RLRobot Policy Adaptation

  17. Learning Transferable Skills using Goal-Conditioned Bisimulation

    Sep 30, 2026Mohammad Amin Abbasfar, Farbod Azimmohseni, Mohammad Hossein RohbanAgent Skill LearningTrajectory Representation Learning

  18. EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making

    Sep 29, 2026Yuhan Guo, Jinming Liu, Liang Xu +8LLM Agent TrainingGeneralization in RL

  19. On-Policy Parameter Update Direction Underlies Generalization in LLM Post-Training

    Sep 29, 2026Shufan Shen, Zhongni Hou, Junshu Sun +5LLM Post-TrainingFine-Tuning

  20. X-Tree: Tokenizing Reusable Experience for Efficient Agent Generalization

    Sep 26, 2026Sitao Cheng, Xunjian Yin, Zhiyuan Sun +4LLM Agent Skill LearningRL for LLM Agents

  21. Robust Successor Features

    Sep 25, 2026Erik Nikulski, Yamen Habib, Vicenç Gomez +3Reinforcement LearningGeneralization in RL

  22. Curriculum Learning with GNN-based Reinforcement Learning for Job Shop Scheduling

    Sep 23, 2026Jayakrishnan K. Vasudevan, Jonathan Hoss, Noah KlarmannReinforcement LearningCurriculum RL

  23. Categorical Internalisation of Environmental Groupoids for Generalisable POMDP Solving

    Sep 23, 2026Ben Opperman, Eduardo Alonso, Esther MondragónReinforcement LearningGeneralization in RL

  24. Deep Reinforcement Learning on Item-Compatibility Graphs for One-Dimensional Bin Packing

    Sep 21, 2026M. Aslı AydınCombinatorial OptimizationRL for Combinatorial Optimization