Continual Learning for LLMs

LLM: Large Language Model

Overview

The field investigates how large language models can keep learning through continual pretraining, instruction tuning, alignment, and personalization without losing earlier knowledge or skills. Common approaches include replaying old or generated examples, distillation and regularization, selective or orthogonal parameter updates, modular adapters, and external memories that leave the model weights unchanged. Evaluations use sequential task suites such as TRACE and SuperNI, domain streams such as biomedical NLP, and evolving knowledge or user-interaction settings, measuring both new-task performance and retention over time. No single approach works reliably across settings: results depend on task order, model capacity, and update type, while long-term evaluation must balance adaptation, forgetting, transfer, safety, and compute cost.

Latest papers

CardsList

256 papers29 papers in the last four weeks, down 37% on the four weeks before. 0.2% of all new papers.

  1. Decoupled Knowledge Retrieval and Compact Memory Enable Reliable Lifelong Model Editing

    Nov 19, 2026Yue Che, Jingze Wang, Chen Guoyi +3Model EditingLanguage Model Editing

  2. HOPD: Historical On-Policy Distillation for SAR MLLM Continual Learning

    Nov 19, 2026Yuxuan Li, Derrick Goh Xin Deik, Zheng-Peng Duan +2Continual Learning for LLMsContinual Learning for VLMs

  3. Learning through Discernment: when a small language model learns from user feedback on the job, and when it decays

    Nov 18, 2026Sirisilp KongsilpLanguage Model Self-ImprovementOnline Language Model Adaptation

  4. Maximizing Capacity Utilization of LoRA Adapters for Mitigating the Learning-Forgetting Trade-off

    Nov 12, 2026Tomohiro Sawada, Kartik GoyalLow-Rank AdaptationCatastrophic Forgetting

  5. TAMEing the Open-World Personalization: Towards Open-Set Personalized MLLM Assistant

    Nov 10, 2026Rongpei Hong, Jian Lang, Ting Zhong +1LLM PersonalizationPersonalized Language Models

  6. Beyond Passive Imitation: On-Policy Mid-Training Distillation for Language Models

    Nov 10, 2026Ruize Zheng, Xuyang Liu, Siyu Ren +5Mid-Training for Language ModelsLanguage Model Distillation

  7. FireGate: Bounding Behaviour Change Before Training in Continual RL Fine-Tuning

    Nov 9, 2026Md Anwar Hossen, Ali JannesariFine-Tuning Language ModelsSafety-Preserving Fine-Tuning of Language Models

  8. Self-Indexing Latent Memories for Access-Aware Continual Instruction Tuning of LLMs

    Nov 8, 2026Dhruv Dixit, Paritosh Pandey, Snehalkumar 'Neil' S. GaikwadContinual Learning for LLMsInstruction Tuning

  9. Audit Before You Merge: Provenance, Probing, and Continual LoRA Composition

    Nov 7, 2026Lenny Aharon, Neta Glazer, Lior AharonLanguage Model MergingCatastrophic Forgetting

  10. Continual Instruction Tuning for LLM-based Management of Continuum Resources

    Nov 6, 2026Lanpei Li, Antonino Vaccarella, Vincenzo Lomonaco +1Language Model-Based ControlInstruction Tuning

  11. Cultural Adaptation within Repeated Social Interactions

    Nov 5, 2026Chen Cecilia Liu, Roi Reichart, Anna KorhonenOnline Language Model AdaptationNormative Conformity in Language Models

  12. Feeling of Knowing in Large Language Models

    Nov 3, 2026Zichuan Fu, Xian Wu, Jingtong Gao +9Metacognition in Language ModelsFactual Knowledge in Language Models

  13. Online Label-Free Gradient Matching for Continual Language Model Training

    Nov 2, 2026Sajjad Pakdamansavoji, Mohammad Reza Rezaei, Ilija Subasic +3Continual Learning for LLMsDataset Distillation

  14. Adaptive Localization of Knowledge Negation for Continual LLM Unlearning

    Nov 2, 2026Abudukelimu Wuerkaixi, Qizhou Wang, Sen Cui +5Gradient SparsityContinual Machine Unlearning

  15. Prior Action Control Causally Alters Language-Model Plasticity

    Nov 2, 2026Marc-Andre SchulzLanguage Model ControllabilityCausal Interventions in Language Models

  16. Preserving Safety During Sequential Fine-Tuning: A Factorial and Geometric Analysis of Replay

    Oct 27, 2026George Ruellan, Diana Benavides-PradoSafety-Preserving Fine-Tuning of Language ModelsSafety-Utility Trade-Off in Language Models

  17. CaLLM: Continual Adaptation of LLMs via Non-Parametric Adapter Routing

    Oct 27, 2026Bilge Celik, Anna Vettoruzzo, Joaquin VanschorenContinual Learning for LLMsAdapter-Based Continual Learning

  18. CAMR: Compatibility-Aware Memory Replay for Continual Learning in Large Language Models

    Oct 27, 2026Jingpu Yang, Tianhao Li, Fengxian Ji +3Continual LearningContinual Learning for LLMs

  19. SHIFT-JEV: Certified Abstention and Gain-Gated Continual Adaptation for LLM-Based Decision Models under Distribution Shift

    Oct 25, 2026Muhammad Atif Saeed, Azka Atiq, Adarsh Kumar +3Online Language Model AdaptationSelective Prediction

  20. Entropic Control for Homeostatic Optimization: Pre-empting Catastrophic Forgetting via Dynamic Feedback

    Oct 25, 2026Shangxi Wu, Xiaorong Yan, Xiaojun Meng +2Catastrophic ForgettingContinual Learning for LLMs

  21. FedSEAM: Federated Continual Learning of LLMs via Subspace Expert Agreement Merging

    Oct 24, 2026Fatema Siddika, Abhijit Chunduru, Zilinghan Li +2Continual Learning for LLMsFederated Continual Learning

  22. Nested Sparsity for Scalable Pretraining and Continual Learning

    Oct 22, 2026Tianzhe Chu, Druv Pai, Yi MaConditional ComputationSparse Attention

  23. Why Constrained Updates Still Forget: A Functional-Path Analysis of Continual SFT

    Oct 21, 2026Qingsen Ma, Dianyun Wang, Jiahong Liu +1Supervised Fine-TuningContinual Learning for LLMs