Sample-Efficient RL

RL: Reinforcement Learning

Overview

Sample-efficient reinforcement learning aims to reduce the experience needed to learn useful policies, especially when interaction is slow, costly, or risky. Common approaches improve exploration with optimism or uncertainty estimates, reuse data through replay and demonstrations, learn models for planning, or exploit structure such as hierarchy, symmetry, and known dynamics. These methods are studied in settings from tabular and robust decision processes to MuJoCo and Atari control, robotics, and language-model training with verifiable rewards. The field balances empirical gains and PAC or regret guarantees against challenges such as stale replay, model error, limited data coverage, and differences between sample counts and wall-clock cost.

Latest papers

CardsList

269 papers19 papers in the last four weeks, down 39% on the four weeks before. 0.1% of all new papers.

  1. Warm Starting Neural Dynamics Models From Few Jacobian Samples

    Nov 16, 2026Maxime Rochkoulets, Joppe De Jonghe, Mariya IshtevaModel-Based RLSample-Efficient RL

  2. Heteroscedastic Gaussian Process Q-learning for Sample Efficient Experimentation

    Nov 16, 2026Maximilian Bloor, Max Mowbray, Calvin Tsay +1RL ControlQ-Learning

  3. Sample-Efficient Ensemble Reinforcement Learning at Scale

    Nov 15, 2026Yoav Feigenbaum, Dmitrii Krylov, Roy FoxReinforcement LearningSample-Efficient RL

  4. Bellman Residual Bracketing: Resolving the Sample Complexity of Discounted and Average-Reward RL

    Nov 14, 2026Matthew Zurek, Yudong ChenReinforcement LearningSample-Efficient RL

  5. Latent Imagination for Parameterized Action Spaces

    Nov 11, 2026Atahan Cilan, İhsan Mert Muhacıroğlu, Ümit Can BekarReinforcement LearningHybrid Action Space RL

  6. FOE-Dreamer: Deployment-Efficient Learning of Cyber Defense Policies in Operational Networks

    Nov 11, 2026Yinuo Du, Christopher KiekintveldAutonomous Cyber DefenseSample-Efficient RL

  7. Are Dense Rewards Worth Their Tokens in GRPO?

    Nov 10, 2026Vikash Singh, Weicong Chen, Debargha Ganguly +16RL for Language ModelsDense Reward RL

  8. ExRL: Sample-Efficient Online Adaptation of Long-Chunk Policies via Execution Length Control

    Nov 10, 2026Xu Luo, Jiaying Yang, Hao Wu +5Robot Policy AdaptationSample-Efficient RL

  9. Value Forcing: Aligning Return Distributions at All Noise Levels

    Nov 1, 2026Chongyi Zheng, Zhiyuan Zhou, Qiyang Li +2Value Function EstimationSample-Efficient RL

  10. Improved Sample Complexity Analysis For First Order Bilevel Reinforcement Learning

    Nov 1, 2026Mudit Gaur, Naman Saxena, Vaneet AggarwalReinforcement LearningSample-Efficient RL

  11. Statistical Foundations of Reinforcement Learning: A Non-Asymptotic Perspective

    Oct 30, 2026Yuxin Chen, Yuejie Chi, Jianqing Fan +3Sample-Efficient RLModel-Based RL

  12. Safe Multi-Objective Reinforcement Learning: Zero Constraint Violation and Primal-Averaging Convergence

    Oct 29, 2026Chenxi Li, Yao Shu, Siyang Gao +2Multi-Objective Reinforcement LearningReinforcement Learning

  13. Provably Efficient Q-learning for Robust Reinforcement Learning

    Oct 26, 2026Yuchen Jiao, Gen LiRobust RLDistributionally Robust RL

  14. SAFTER: Safety-Aware Filtering Through Explicit Recoverability for Robust Reinforcement Learning under Distribution Shift

    Oct 21, 2026Benedictus C. G. Cinun, Bin HuSafe RLReinforcement Learning

  15. Ask to Learn: Query-Based Collaborative Reinforcement Learning

    Oct 20, 2026Kaicheng Zhang, Hongqian Niu, Laixi Shi +3Reinforcement LearningSample-Efficient RL

  16. Adaptive Decoding Methods for Token-Efficient Reinforcement Learning

    Oct 19, 2026Zhaonan Li, Zelei Cheng, Amritansh Mishra +5Sample-Efficient RLReinforcement Learning with Verifiable Rewards

  17. Follow the Mixed Groups: Ridge-Tracking Gaussian Sampling for Zero-Variance Web Rollouts

    Oct 18, 2026Tomas Duncun, Jonah Ellison, Owen Pell +4Adaptive SamplingSample-Efficient RL

  18. Sample-Efficient Reinforcement Learning with General Utilities via Neural Dual Critics

    Oct 17, 2026Ankur Naskar, Vaneet AggarwalReinforcement LearningSample-Efficient RL

  19. Sample-Efficient Reinforcement Learning for Policy Improvement via Flow-Reversed Action Anchors

    Oct 16, 2026Carl Qi, Weijun Dong, Xiaojie Wang +8Robot Policy LearningRobotic RL

  20. Co-Evolving Acting and Forecasting for Language Agents

    Oct 14, 2026Haofei Yu, Yixing Chen, Yining Zhao +6RL for LLM AgentsAgentic RL

  21. Fast Rates for Offline Q-Learning with KL Regularization

    Oct 13, 2026Yize Hao, Guangxin Jiang, Shuang QiuOffline RLQ-Learning

  22. Bridging Risk Approximation Gaps in Model Predictive Task Sampling via In-Context Modeling

    Oct 10, 2026Jiarong Wen, Qi Tao, Kaiyu Zhang +5Sample-Efficient RLRL Post-Training

  23. Variance-Reduced Policy Gradient is Nearly Minimax-Optimal

    Oct 9, 2026Leonardo Cesani, Matteo Papini, Marcello RestelliPolicy GradientPolicy Gradient Methods