Overview

Catastrophic forgetting occurs when learning new tasks or adapting to shifting data degrades performance on earlier tasks, a central challenge for systems expected to learn over time. Common approaches include replaying examples, distilling prior outputs, regularizing important weights or gradients, and isolating updates with adapters or modular experts. Researchers study these methods in sequential vision and language benchmarks as well as foundation-model fine-tuning, multimodal systems, and robotics, measuring both new-task performance and retention. No single approach works best everywhere: stronger protection can limit adaptation, while memory, compute, and benchmark choices affect results; apparent forgetting may also reflect knowledge becoming inaccessible rather than erased.

Latest papers

CardsList

374 papers32 papers in the last four weeks, down 45% on the four weeks before. 0.2% of all new papers.

  1. Mitigating Catastrophic Forgetting with Physics-Indexed Specialist Memory: the Evolutionary Neuroplastic Agent

    Nov 16, 2026Blas Eugenio Vicco Zarate, Miguel Hernán ViccoContinual RLCatastrophic Forgetting

  2. Does Learning Order Explain Forgetting? The Lie Bracket as an Early-Warning Signal for Catastrophic Forgetting Without Old Data

    Nov 15, 2026Ephraim Kofi Ayi KwapongCatastrophic ForgettingNeural Network Training Dynamics

  3. Bring Back Language to Actions: Restoring VLM capabilities in VLA Models via Parameter Merging

    Nov 13, 2026Mohamed Salim Aissi, Olivier Sigaud, Laure Soulier +1Vision-Language-Action Modelsvision-language model merging

  4. Maximizing Capacity Utilization of LoRA Adapters for Mitigating the Learning-Forgetting Trade-off

    Nov 12, 2026Tomohiro Sawada, Kartik GoyalLow-Rank AdaptationCatastrophic Forgetting

  5. A Margin Perspective on LoRA: Robustness to Catastrophic Forgetting and Adapter Merging (MaLoRA)

    Nov 10, 2026Ziqing Xu, Hancheng Min, Lachlan Ewen MacDonald +4Low-Rank AdaptationModel Merging

  6. Audit Before You Merge: Provenance, Probing, and Continual LoRA Composition

    Nov 7, 2026Lenny Aharon, Neta Glazer, Lior AharonLanguage Model MergingCatastrophic Forgetting

  7. Continual Instruction Tuning for LLM-based Management of Continuum Resources

    Nov 6, 2026Lanpei Li, Antonino Vaccarella, Vincenzo Lomonaco +1Language Model-Based ControlInstruction Tuning

  8. ROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models

    Nov 6, 2026Lingyun Song, Ziyao Chen, Kang Pan +5Subspace-Based Continual LearningKnowledge Editing

  9. Human Motion Prediction via Continual Prior Compensation

    Nov 4, 2026Jianwei Tang, Jian-Fang Hu, Tianming Liang +4Human Motion PredictionContinual Learning

  10. Hippocampal consolidation without replay in fully fine-tuned networks

    Nov 1, 2026Keuntae Kim, Yong Suk ChoiCatastrophic ForgettingClass-Incremental Learning

  11. Mitigating Catastrophic Forgetting in Task-Free Federated Continual Forecasting via Two-Tier Replay under Concept Drift

    Oct 31, 2026Khaled Hallak, Oudom KemFederated Continual LearningTask-Free Continual Learning

  12. Saidzoda-Tajik-LFM-2.6B: Adapting a 2.6B Hybrid Model to Tajik Tool Calling, and What Continued Pretraining Takes Away

    Oct 30, 2026Tohir Saidzoda, Nekruz Maxudov, Bedil Karimov +5LLM Tool UseFine-Tuning Language Models

  13. HyperRepair: Recovering Forgotten General Capabilities of Fine-Tuned Language Models

    Oct 30, 2026Junrong Tang, Jianghui Wang, Hao Kong +2Fine-Tuning Language ModelsCatastrophic Forgetting

  14. Frozen in Time: How a Physics Foundation Model Forgets Under Sim-to-Real Adaptation

    Oct 29, 2026Haaris Mian, Miles Cranmer, Alessandro Favero +1Catastrophic ForgettingPDE Foundation Models

  15. Continual Adaptation Across Modalities: Learning and Forgetting in Unified Multimodal Models

    Oct 28, 2026Xinrui Wang, Zhihao Chen, Jia Tang +4Parameter IsolationUnified Multimodal Models

  16. Beyond Parameter Protection: Fisher-Shaped EWC for Replay-Free Continual Learning

    Oct 27, 2026Liying Wang, Simone Magistri, Joost van de WeijerElastic Weight ConsolidationRegularization-Based Continual Learning

  17. Entropic Control for Homeostatic Optimization: Pre-empting Catastrophic Forgetting via Dynamic Feedback

    Oct 25, 2026Shangxi Wu, Xiaorong Yan, Xiaojun Meng +2Catastrophic ForgettingContinual Learning for LLMs

  18. DRIVE: Fine-tuning via Data Contribution- and Diversity-aware Weighting with Prior Regularization

    Oct 23, 2026Qing Liu, Xinrui Chen, Yi Du +2Fine-TuningInstance Reweighting

  19. Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-Reweighting

    Oct 23, 2026Jiazheng Li, Huaqing Zhang, Jing Xu +2Language Model PretrainingAdaptive Loss Weighting

  20. Fine-Grained Analysis of Catastrophic Forgetting in Continual Learning via Algorithmic Stability

    Oct 22, 2026Guodong Zheng, Yan Sun, Peng Wang +5Catastrophic ForgettingGeneralization Bounds

  21. Why Constrained Updates Still Forget: A Functional-Path Analysis of Continual SFT

    Oct 21, 2026Qingsen Ma, Dianyun Wang, Jiahong Liu +1Supervised Fine-TuningContinual Learning for LLMs

  22. Combating Catastrophic Forgetting in Continual Domain Adaptation via Knowledge Recasting

    Oct 20, 2026Zijie Liu, Zhen Tan, Charles Fleming +1Continual Learning for LLMsDomain Adaptation