Overview

Continual Learning studies how models adapt to sequences of tasks or non-stationary data without losing useful earlier knowledge, a challenge known as catastrophic forgetting. Common approaches replay selected examples, regularize updates to protect important parameters, isolate tasks with adapters or separate subnetworks, or manage knowledge through prompts, memory, and model expansion. Methods are tested on class- and domain-incremental image benchmarks such as CIFAR and ImageNet, as well as task-free streams and applications in language, robotics, and healthcare. A central tension is balancing retention with the capacity to learn, while evaluations increasingly question assumptions such as known task boundaries and seek to measure transfer, recovery, resource use, and performance under realistic shifts.

Latest papers

CardsList

323 papers26 papers in the last four weeks, down 24% on the four weeks before. 0.2% of all new papers.

  1. Engram Neuron Inspired Adaptive Memorization for Lifelong Learning

    Oct 10, 2026Suiyang Jiang, Bomin Wang, Hangqi Zhou +2Continual LearningMemory-Augmented Neural Networks

  2. LadderEdit: Edit-Level Residual Compression for Memory-Efficient Lifelong Editing of LLMs

    Oct 8, 2026Xiaobing Yu, Peijie Qiu, Jin Yang +5Language Model EditingMemory-Efficient Fine-Tuning

  3. Continual Learning without Continual Training

    Oct 7, 2026Nikita Narayanan, Ritham Majumdarr, Sonali ParbhooContinual LearningClass-Incremental Learning

  4. MAGIC: Topology-Aware Analytic Graph Few-Shot Class-Incremental Learning

    Oct 4, 2026Junlin Chen, Yuhan Wang, Xuefei Wang +3Class-Incremental LearningContinual Learning

  5. Gated Target Propagation for Compositional Generalization in Continual Learning

    Oct 3, 2026Abdel Mfougouon Njupoun, Colin Bredenberg, Blake Aaron Richards +1Continual LearningCompositional Generalization

  6. VoiceWeaver: Staged Learning of Structured Controls for Expressive Speech and Sound-Event Generation

    Oct 3, 2026Xiaosu Su, Yun Cao, Yiping Ni +1Controllable Speech GenerationTTS Synthesis

  7. PaLoRA: Paced Low-Rank Adaptation for Continual Learning

    Oct 3, 2026Yuxuan Li, Fanhu Zeng, Hao TangContinual LoRAContinual Learning

  8. One-Step Curvature Probes Miss the Fitting Operator: Retained Capacity and Terminal Null-Space Correction for Continual Learning

    Oct 2, 2026Abu Sa-Adat Mohamed Moon-Im Al Ahsan, Ibne Farabi Shihab, Md Najmus SwaqeebContinual LearningIncremental Learning

  9. What Should World Models Forget? Stratified Retention for Continual Adaptation

    Oct 2, 2026Nishit Anand, Ramani Duraiswami, Dinesh ManochaWorld Model LearningContinual Learning

  10. Task-Oriented Rank Adaptation for Continual Learning in Text Classification

    Oct 1, 2026Rey Sanchez Lopez, Eduardo Morales Manzanares, Hugo Jair EscalanteContinual LearningLow-Rank Adaptation

  11. CLEAN: Psychometrically Consistent Incremental Cognitive Diagnosis under Concept-Space Expansion via Architectural Isolation

    Oct 1, 2026Tao He, Jinxing Xiang, Fan JiangContinual LearningCatastrophic Forgetting

  12. Dynamic LoRA-Experts and Prototype-Ensemble Matching for Class-Incremental Learning

    Sep 30, 2026Hongwei Zhao, Rui Liu, Yansong LiuClass-Incremental LearningPrototype-Based Classification

  13. SE-ADD: Self-Evolving Audio Deepfake Detection with Mistake-Driven Supervision

    Sep 30, 2026Rong Wan, Wei Xie, Jiaxi Li +4Audio Deepfake DetectionSelf-Training for Language Models

  14. Hyperbolic Prototype Routing for Rehearsal-Free Class-Incremental Learning

    Sep 30, 2026HongWei Zhao, Rui Liu, Yong ChenClass-Incremental LearningPrototype-Based Classification

  15. A Dynamical Theory of LoRA in Continual Learning

    Sep 30, 2026Théo Marchetta, Filippo Alessandroni, Alessandro Breccia +2Continual LearningLow-Rank Adaptation

  16. Generalized Residual Closure: General Learning Dynamics for Stability-Plasticity Compatibility

    Sep 30, 2026Dongxu Li, Yinuo Zhang, Hongyu Zhang +1Stability-Plasticity DilemmaContinual Learning

  17. Continual Learning of Dynamical Systems in Recurrent Neural Networks through Recyclable Unit Gating

    Sep 29, 2026Sima Hashemi, Daniel Durstewitz, Georgia KoppeDynamical SystemsContinual Learning

  18. ReCAP: Retrieval-Guided Capability Reuse for Multimodal Continual Instruction Tuning

    Sep 29, 2026Tao Hu, Zhinuo Zhou, Xialiang Tong +2Subspace-Based Continual LearningContinual Learning

  19. Generalizable Lifelong Model Editing via Preference Optimization

    Sep 29, 2026Dahyun Jung, Suhyune Son, Heuiseok LimContinual Learning for LLMsContinual Learning

  20. Neural Succession: A Mesoscopic Theory of Invasion, Coexistence, and Stabilization in Continual Learning

    Sep 28, 2026Shoaib Ahmed Dipu, Md Salman Shamil, Sayeed Shafayet ChowdhuryContinual LearningCatastrophic Forgetting

  21. Early Learning Shapes Later Directions Of Representation Change In Continual Learning

    Sep 28, 2026Yuantao Deng, Jinnuo Liu, Kaizhen Tan +1Neural Representation GeometryVisual Representation Learning

  22. SPACE-LoRA: Allocating Activation-Subspace Protection for Continual Learning

    Sep 28, 2026Seunghyun Yoo, Kiseok Kim, Hyeontae Joo +2Continual LearningLow-Rank Adaptation

  23. CARVE: Breaking Data Barriers in Chip Placement by Harnessing Reusable Expertise

    Sep 27, 2026Jiefu Zhang, Haixiang Sun, Yang Xu +2Macro PlacementContinual Learning