Replay-Based Continual Learning

Ask about this topic

Overview

Replay-based continual learning studies how models can learn from a changing stream of tasks without losing what they learned earlier. Methods store and revisit selected examples, compressed features, prototypes, or generated data, often combining replay with distillation, class balancing, or adaptive scheduling. These approaches are used in settings such as class-incremental vision, language-model fine-tuning, robotics, reinforcement learning, and federated learning. Replay is a strong practical way to balance retention and adaptation, but its benefits depend on memory limits, replay quality and timing, and the cost or privacy risks of retaining past data.

Latest papers

CardsList

134 papers20 papers in the last four weeks, up 82% on the four weeks before. 0.1% of all new papers.

  1. Class-aware Latent Attention Replay (CLAR): Class Incremental Hazard Diagnosis for Resilient AI in the Manufacturing Industrial Internet

    Oct 29, 2026Avranshu Mahanty, Ran Jin, Yingyan ZengReplay-Based Continual LearningClass-Incremental Learning

    Department of Mechanical, Materials, and Industrial Engineering, University of Cincinnati, Cincinnati, OH · Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, VA

  2. Generative Replay for Equilibrium Propagation: Toward Edge-Friendly Continual Learning in Hopfield Networks

    Oct 27, 2026Victor Cook, Gilles Sassatelli, Thierry Gil +2Replay-Based Continual LearningGenerative Replay

    LIRMM | ADAC · LIRMM · CEA-LETI

  3. CAMR: Compatibility-Aware Memory Replay for Continual Learning in Large Language Models

    Oct 27, 2026Jingpu Yang, Tianhao Li, Fengxian Ji +3Continual LearningContinual Learning for LLMs

    Beijing Zhongguancun Academy · Northeastern University · Beihang University +1

  4. ARISE: Authentic Reference-Informed Stability Enhancement for Continual Multimodal Forgery Detection

    Oct 27, 2026Yuchen Zhang, Yaxiong Wang, Yujiao Wu +6Multimodal Deepfake DetectionDeepfake Detection

    School of Software Engineering, Xi’an Jiaotong University · Xingchen AGI Lab · School of Computer and Information Engineering, Hefei University of Technology +4

  5. ChronoReplay: One Answer Interface Is Not Enough for Streaming Spatial Intelligence

    Oct 25, 2026Yihao Hu, Yitong Lin, Pan Wang +8Multimodal Spatial ReasoningStreaming Inference

    Westlake University · ZJU · USTC +4

  6. Entropic Control for Homeostatic Optimization: Pre-empting Catastrophic Forgetting via Dynamic Feedback

    Oct 25, 2026Shangxi Wu, Xiaorong Yan, Xiaojun Meng +2Catastrophic ForgettingContinual Learning for LLMs

    Beijing Jiaotong University · The Hong Kong Polytechnic University · Huawei Noah’s Ark Lab

  7. Cross-User Adaptation for sEMG Gesture Recognition via Continual Learning

    Oct 25, 2026Aran Ramakrishnan, Shubhi Mishra, Tyler Ham +2EMG-Based Gesture RecognitionContinual Learning

    Department of Electrical and Computer Engineering, University of California, Santa Cruz, CA 95064, USA

  8. CARES: Coverage-Aware Replay Exemplar Selection for Continual Learning

    Oct 23, 2026Arundhati S. Shanbhag, Brian B. Moser, Federico Raue +2Replay-Based Continual LearningExperience Replay

    University of Kaiserslautern-Landau, Germany · German Research Center for Artificial Intelligence, Germany

  9. Why Constrained Updates Still Forget: A Functional-Path Analysis of Continual SFT

    Oct 21, 2026Qingsen Ma, Dianyun Wang, Jiahong Liu +1Supervised Fine-TuningContinual Learning for LLMs

    The Chinese University of Hong Kong · Beijing University of Posts and Telecommunications

  10. Sparse Autoencoders Can Induce Local Geometry for Mitigating Catastrophic Forgetting

    Oct 15, 2026Kamil Faber, Katarzyna Filus, Łukasz PawelaCatastrophic ForgettingRegularization-Based Continual Learning

    Faculty of Computer Science, AGH University of Krakow, Krakow, Poland · Institute of Theoretical and Applied Informatics, Polish Academy of Sciences, Gliwice, Poland

  11. Continual Learning for Reliable In-Sequence Molecular Communication

    Oct 14, 2026Siddhant Setia, Junichi Suzuki, Tadashi NakanoReplay-Based Continual LearningIncremental Learning

    Department of Computer Science, University of Massachusetts, Boston, Boston, MA, 02125, USA · Graduate School of Informatics, Osaka Metropolitan University, Osaka, Japan

  12. ACCRUE: Continual Off-Policy Reinforcement Learning for Robot Foundation Models

    Oct 13, 2026Changyeon Kim, Kimin Lee, Yashraj Narang +1Continual Robot LearningOff-Policy RL

    NVIDIA · KAIST

  13. Overcoming Catastrophic Forgetting: Continual Learning for Radar Waveform Classification

    Oct 13, 2026Mohamed Rabie, Chinthana J. Panagamuwa, Konstantinos G. KyriakopoulosContinual LearningCatastrophic Forgetting

    Wolfson School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, U.K.

  14. Saliency-Guided Replay for Continual Learning in Deep Spiking Neural Networks

    Oct 13, 2026Francesco Panetta, Federico Di Valerio, Michela ProiettiStorage-Efficient Continual LearningReplay-Based Continual Learning

    Sapienza University of Rome, Italy · Goethe University Frankfurt, Germany

  15. Self-Preservation in Language Models

    Oct 8, 2026Dongkyu Cho, Rumi Chunara, Ali BehrouzContinual Learning for LLMsReplay-Based Continual Learning

    New York University · Google Research · Cornell University

  16. Decentralized collaborative continual learning: A multi-objective minimization-based technique

    Oct 7, 2026Yara Zgheib, Marc Antonini, Roula NassifDecentralized LearningReplay-Based Continual Learning

    Universit´e Cˆote d’Azur, I3S Laboratory, CNRS, France

  17. Catastrophic Forgetting in Sequential Thermal Anti-UAV Detection: The Role of Scale-Conditioned Gradient Imbalance

    Oct 6, 2026Khac Duc Giang Nguyen, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor AlsahagContinual Object DetectionReplay-Based Continual Learning

    University of Amsterdam Amsterdam, The Netherlands · Department of Computer Science and Technology, SUNY Empire State University Saratoga Springs, NY, USA

  18. What Must Replay Preserve? Separating Correctable Bias from Class Correspondence

    Oct 5, 2026BoRen Deng, Xiangyue Ma, Chenglong Li +1Class-Incremental LearningReplay-Based Continual Learning

    Beijing University of Posts and Telecommunications · Beihang University · Beijing University of Technology

  19. VIGIL: Verifier-Informed Gated Improvement Loop for Spreadsheet Question Answering

    Oct 3, 2026Kang Li, Lu He, Sandarsita GuntupalliTable QAContinual Learning for LLM Agents

    Atlassian · Carnegie Mellon University

  20. RIFAR: Reliability-Informed and Forgetting-Aware Replay for Continual Robot Learning with World-Action Models

    Oct 2, 2026Tu Lin, Zheng Lu, Zirui Song +7Continual Robot LearningReplay-Based Continual Learning

    Tsinghua University · MBZUAI · Zhejiang University

  21. Replay on Demand: An Emergent Curriculum for Balancing Adaptation and Forgetting in Continued Pretraining

    Sep 30, 2026Lukas Thede, Shengzhuang Chen, Stefan Winzeck +3Continual Learning for LLMsReplay-Based Continual Learning

    University of Tübingen, Tübingen AI Center · Helmholtz Munich · Munich Center for Machine Learning (MCML) +3

  22. Experience-Driven Continual Learning of Terrain Traversability for Quadruped Robots

    Sep 30, 2026Luca Bricarello, João Carlos Virgolino Soares, Alberto Sanchez-Delgado +2Continual Robot LearningSafe Robot Navigation

    Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia, Genoa, Italy. · Universit`a degli Studi di Genova, Genoa, Italy.

  23. ReSCENE: Server-Side Replay for Structural Mitigation of Catastrophic Forgetting in Federated Continual Learning

    Sep 30, 2026Sungmin Kang, Zhengzhong Tu, Sunwoo LeeFederated Continual LearningReplay-Based Continual Learning

    Texas A&M University · Inha University

  24. HiTS-CL: A Continual Learning Framework for Long-Horizon Temporal Knowledge Graph Extrapolation

    Sep 29, 2026Yansong Liu, Rui Liu, Yuan Zuo +6Temporal Link PredictionReplay-Based Continual Learning

    Beihang University Beijing, China · Beijing University of Posts and Telecommunications Beijing, China · Hubei Engineering University Xiaogan, Hubei, China

  25. Reliable Replay through Spatial Coherence in Online Continual Learning

    Sep 27, 2026Haixiang Sun, Jiefu Zhang, Yinghao He +4Continual Learning for LLMsExperience Replay

    Purdue University West Lafayette, IN 47907, USA

  26. Beyond Class Marginals: Bounding Rehearsal Gaps without Freezing Class Co-occurrence

    Sep 22, 2026Congren Dai, Nat Roongjirarat, Fei YeClass-Incremental LearningReplay-Based Continual Learning

    Imperial College London · King’s College London · University of Electronic Science and Technology of China

  27. ACLArena: Agent Continue Learning in Multi-stage Post-training

    Sep 21, 2026Haixin Wang, Xiaoxuan Wang, Junkai Zhang +9Continual Learning for LLM AgentsRL Post-Training

    University of California, Los Angeles · University of California, Santa Cruz

  28. DR.WILSS: Diffusion-Based Replay for Weakly Supervised Continual Semantic Segmentation

    Sep 16, 2026Leon Arthur Marx, Francesco Barbato, Matteo Caligiuri +1Class-Incremental LearningSemantic Segmentation

    Dpt. Information Engineering University of Padova Padova, Italy

  29. Characterizing Replay Retention Under Dynamics Shift in Model-Based Reinforcement Learning

    Sep 16, 2026Everest Yang, Skye Thompson, George D. KonidarisNon-Stationary RLContinual Robot Learning

    Brown University, Providence, RI, USA

  30. Continual Learning for Traversability Prediction with Uncertainty-Aware Adaptation

    Sep 15, 2026Hojin Lee, Yunho Lee, Daniel A Duecker +1Continual Robot LearningRobot Navigation

    Ulsan National Institute of Science and Technology, Ulsan, 44919, Republic of Korea · Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM), Germany