Experience Replay

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 28

All topics

EVISKILL: Grounding Skill Evolution in Replayable Evidence
Oct 4, 2026Yan Zhou, Yili Wang, Yiwei Dai +2Continual Learning for LLM Agents Experience Replay
School of Artificial Intelligence, Jilin University, Changchun, China
Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?
Oct 1, 2026Alessandro Montenegro, Riccardo Venturelli, Marco Mussi +2Experience Replay Proximal Policy Optimization
Politecnico di Milano, Milan, Italy · Università degli Studi di Milano, Milan, Italy
ER-JEPA: Experience Replay Improves Joint-Embedding Predictive Learning in Language Models
Sep 29, 2026Jingnan Pu, Zi-En Fan, Feng LianMemory-Augmented Language Models Joint-Embedding Predictive Architecture
School of Automation Science and Technology, Xi’an Jiaotong University No. 28, West Xianning Road, Xi’an, Shaanxi 710049, China
ReplayLens: Auditing Agents' Use of Outcomes
Sep 28, 2026Dong Xu, Zhangfan Yang, Jiantao Wu +5AI Agent Auditing LLM Agent Memory
School of Artificial Intelligence, Shenzhen University · EasternDawn · School of Computer Science, University of Nottingham Ningbo
Reliable Replay through Spatial Coherence in Online Continual Learning
Sep 27, 2026Haixiang Sun, Jiefu Zhang, Yinghao He +4Continual Learning for LLMs Experience Replay
Purdue University West Lafayette, IN 47907, USA
CORTEX: A Verified Experience Layer for Generalist Agents
Sep 27, 2026Garapati Keerthana, Manik GuptaAI Agent Reliability Lifelong Learning Agents
Birla Institute of Technology and Science, Pilani, Hyderabad, India
On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning
Sep 22, 2026Baptiste Bonin, Caro Strickland, Audrey DurandMulti-Objective Reinforcement Learning Experience Replay
Mila (Quebec AI Institute) · Université Laval · CIFAR AI Chair
Characterizing Replay Retention Under Dynamics Shift in Model-Based Reinforcement Learning
Sep 16, 2026Everest Yang, Skye Thompson, George D. KonidarisNon-Stationary RL Continual Robot Learning
Brown University, Providence, RI, USA
Anchoring What Matters: A Dual-Level Learning Framework for Visually-Grounded Multimodal Reasoning
Sep 16, 2026Xinxin Song, Siyuan Li, Tingxiong Xiao +1Credit Assignment in RL Experience Replay
Department of Automation, Tsinghua University · Institute for Brain and Cognitive Science, Tsinghua University
Headroom-Drift Replay: A Primitive for Principled Replay Control in GRPO
Sep 3, 2026Hyun Bin Park, Du-Seong ChangRL for Language Model Reasoning Group Relative Policy Optimization
Department of Artificial Intelligence, Sogang University, Seoul, Republic of Korea
Beyond Isolation: Unlocking Reinforcement Learning Component Synergy for Sample-Efficient Continuous Control
Aug 7, 2026Qi Zhao, Guozheng Ma, Yilun Kong +9Reinforcement Learning Experience Replay
Tsinghua University · Nanyang Technological University · Mila - Quebec Artificial Intelligence Institute +1
Endpoint Replay: Compressing the Recency Buffer in Deep Reinforcement Learning
Jul 27, 2026Parham Mohammad Panahi, Armin Ashrafi, Haoyu Du +3Deep Q-Learning Experience Replay
Department of Computing Science, University of Alberta, Canada · Alberta Machine Intelligence Institute (Amii) · Canada CIFAR AI Chair
Rethinking Transfer in Continual Learning: A Replay-Based Realisation
Jul 17, 2026Yang Meng, Zhenya Liu, Zhuokai Zhao +1Continual Learning for LLMs Experience Replay
Department of Computer Science, University of Chicago
Replay What Matters: Off-Policy Replay for Efficient LLM Reinforcement Unlearning
Jun 13, 2026Zirui Pang, Chenlong Zhang, Haosheng Tan +3Experience Replay Machine Unlearning
The Hong Kong University of Science and Technology (Guangzhou) · Institute of Automation, Chinese Academy of Sciences · University of Glasgow
Focus, Align, and Sustain: Counteracting Gradient Dilution in Incremental Object Detection
Jun 13, 2026Aoting Zhang, Dongbao Yang, Chang Liu +2Class-Incremental Learning Detection Transformer
Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences · Nankai University +2
Rollout-Level Advantage-Prioritized Experience Replay for GRPO
Jun 3, 2026Gyeongtae Yoo, Sanghyeok Park, Soohyuk Jang +2RL for Language Model Reasoning Group Relative Policy Optimization
Department of Electrical and Computer Engineering, Seoul National University · Interdisciplinary Program in AI, Seoul National University · AIIS, ASRI, INMC, and ISRC, Seoul National University
Quantifying the Energy Floor: Direct Measurement and Replay Buffer Bias in SAC-Based HVAC Control on sbsim
Jun 1, 2026Bo Li, Chen ZhangExperience Replay Building Energy Management
Shanghai Jiao Tong University College of Smart Energy Shanghai, China
ParkingWorld: End-to-End Autonomous Parking Reinforcement Learning from Corrective Experience in 3DGS Simulation
May 24, 2026Zhengcheng Yu, Changze Li, Haoran Liu +1End-to-End Autonomous Driving Autonomous Parking
Tsinghua University · Shanghai Jiaotong University
When Does Non-Uniform Replay Matter in Reinforcement Learning?
May 11, 2026Michal Korniak, Mikołaj Czarnecki, Yarden As +3Experience Replay Sample-Efficient RL
1ETH Zurich · University of Warsaw · 3UC Berkeley +1
From Passive Reuse to Active Reasoning: Grounding Large Language Models for Neuro-Symbolic Experience Replay
May 10, 2026Yanan Xiao, Yixiang Tang, Zechen Feng +3Reinforcement Learning Experience Replay
1Affiliation 1 · 2Affiliation 2 · 3Affiliation 3
Experience Constrained Hierarchical Federated Reinforcement Learning for Large-scale UAV Teams in Hazardous Environments
May 4, 2026Qinwei Huang, Rui Zuo, Simon Khan +1Hierarchical Federated Learning Federated RL
EECS Syracuse University Syracuse, USA · AFRL Air Force Research Laboratory Rome, USA
Data Deletion Can Help in Adaptive RL
Apr 30, 2026Param Budhraja, Aditya Gangrade, Alex Olshevsky +1Non-Stationary RL Reinforcement Learning
Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA · Faculty of Electrical and Computer Engineering, Systems Engineering, Boston University, Boston, MA 02215, USA
E $^2$ DT: Efficient and Effective Decision Transformer with Experience-Aware Sampling for Robotic Manipulation
Apr 30, 2026Kaiyan Zhao, Borong Zhang, Yiming Wang +4Long-Horizon Robotic Manipulation Transformer
School of Computer Science, Wuhan University, Wuhan 430072, China · State Key Lab of Internet of Things for Smart City and Department of Computer Information Science, University of Macau, Macao 999078, China
Replay-buffer engineering for noise-aware quantum circuit optimization
Apr 23, 2026Akash Kundu, Sebastian FeldReinforcement Learning Experience Replay
Delft University of Technology, Delft, The Netherlands · Quantum Computing Division, QuTech, The Netherlands
Leveraging Complementary Embeddings for Replay Selection in Continual Learning with Small Buffers
Apr 9, 2026Danit Yanowsky, Daphna WeinshallExperience Replay Replay-Based Continual Learning
School of Computer Science and Engineering The Hebrew University of Jerusalem
CONTHER: Context-Aware Reinforcement Learning for Robotic Manipulation with Sparse Rewards
Mar 20, 2025Maria Makarova, Qian Liu, Dzmitry TsetserukouReinforcement Learning Experience Replay
Intelligent Space Robotics Laboratory, Center for Digital Engineering, Skolkovo Institute of Science and Technology (Skoltech), 121205 Moscow, Russia · Department of Computer Science and Technology, Dalian University of Technology, China
Efficient Diversity-based Experience Replay for Deep Reinforcement Learning
Oct 27, 2024Kaiyan Zhao, Yiming Wang, Yuyang Chen +3Experience Replay Determinantal Point Process
School of Computer Science, Wuhan University, Wuhan, China · State Key Laboratory of Internet of Things for Smart City, University of Macau, Macao, China · School of Artificial Intelligence Shenzhen Polytechnic University, China
ETHER: Aligning Emergent Communication for Hindsight Experience Replay
Jul 28, 2023Kevin Yandoka Denamganaï, Daniel Hernandez, Ozan Vardal +2Reinforcement Learning Experience Replay
Department of Computer Science University of York York, UK

Oct 4, 2026, cs.AIJ/K move · Enter open · S save

EVISKILL: Grounding Skill Evolution in Replayable Evidence

Yan Zhou, Yili Wang, Yiwei Dai, Qinggang Zhang+1

School of Artificial Intelligence, Jilin University, Changchun, China

Continual Learning for LLM Agents Experience Replay LLM Agent Skill Learning

Open paper AskPDF arXiv

Continual skill evolution enables LLM agents to accumulate and refine reusable procedural knowledge from interaction experience without updating model parameters. Its effectiveness depends on determining not only what to change, but also why a change is justified and when it should become persistent guidance. However, existing experience-driven methods can lose the behavioral evidence and task contexts supporting edits. Moreover, a global validation outcome provides an incomplete judgment of its constituent changes: locally supported corrections may be discarded with a rejected revision, while evidence may require further experience to inform useful updates. To this end, we introduce EVISKILL, an evidence-driven framework that organizes execution observations into Replayable Evidence Cards and synthesizes edits with explicit links to their supporting contexts. Targeted replay verifies these edits through re-execution and provides feedback for correction. Across epochs, EVISKILL preserves evidence and provisionally retains supported edits for further refinement, while global validation governs their incorporation into the final skill. Experiments on three interactive benchmarks across six LLM backbones demonstrate the effectiveness of this approach.

Momentum

Related topics

Latest papers 28