Continual Learning
Overview
Continual Learning studies how models adapt to sequences of tasks or non-stationary data without losing useful earlier knowledge, a challenge known as catastrophic forgetting. Common approaches replay selected examples, regularize updates to protect important parameters, isolate tasks with adapters or separate subnetworks, or manage knowledge through prompts, memory, and model expansion. Methods are tested on class- and domain-incremental image benchmarks such as CIFAR and ImageNet, as well as task-free streams and applications in language, robotics, and healthcare. A central tension is balancing retention with the capacity to learn, while evaluations increasingly question assumptions such as known task boundaries and seek to measure transfer, recovery, resource use, and performance under realistic shifts.
Latest papers
323 papers26 papers in the last four weeks, down 24% on the four weeks before. 0.2% of all new papers.
Continual-ARC: Measuring Skill Acquisition over a Working Lifetime
MEOW: Medical Open-World Interactive Segmentation
F3-AGI v4.0: Bioenergetically-Gated Active Inference, Metaplastic Preconditioning, and Residual Program Synthesis for Sample-Efficient Abstract Reasoning
Anchor Behavior, Not Parameters: Rehearsal-Free Continual Learning with a Single Shared Prompt
Autonomous Continual Learning and Knowledge Transfer via Cortex-Inspired Neural Assemblies
Unified Factored Representations Resist Catastrophic Forgetting
STABLE: A Continual Learning Optimizer with Adaptive Drift Control
Permanent and Transient Representations for Continual Reinforcement Learning
Human Motion Prediction via Continual Prior Compensation
near-future'' prediction) could be hindered by the predictions of long-term (referring to far-future'' prediction) motions. In this paper, we develop a novel temporal continual learning framework called Continual Prior Compensation (CPC) to progressively train HMP models, in which we divide the prediction task of motions corresponding to varied temporal moments into several subtasks and train the model in a multi-stage manner. To mitigate the prior information forgetting in the progressive training, we further introduce a learnable random variable Prior Compensation Factor (PCF) to explicitly measure the prior knowledge loss. We theoretically show that the PCF can be efficiently learned together with the model parameters by minimizing a reasonable upper bound of the objective function. The proposed CPC is further enhanced to estimate the prior information loss for each subtask and a new framework called Continual Prior Compensation++ (CPC++) with Fine-Grained Prior Compensation Factor (FGPCF) is finally developed. Our CPC and CPC++ frameworks are quite flexible and can be easily integrated with different HMP backbone models and adapted to various datasets and applications. Extensive experiments on three HMP benchmark datasets using multiple SOTA HMP backbones (PGBIG, siMLPe, MotionMixer, and LTD) demonstrate the effectiveness and flexibility of our frameworks.