cs.LGNov 17, 2026

DuoCL: Dual-Path Online Continual Learning

Authors: Jebacyril Arockiaraj, Dhruv Parikh, Rajgopal Kannan, Viktor Prasanna

Organizations: University of Southern California · DEVCOM Army Research Office

Abstract

Online continual learning (OCL) requires learning from a data stream whose arrival rate is independent of model training speed. When training cannot keep pace, computationally expensive gradient-based methods update less frequently, limiting adaptation. Analytic methods reduce this overhead, but their frozen backbones cannot adapt representations to changing distributions. We propose DuoCL, a dual-path OCL framework whose fast analytic path accumulates feature statistics from every incoming minibatch while its slow path periodically adapts the backbone. The slow path adjusts its sample count to the available compute budget without interrupting fast-path learning. Feature alignment compensates for drift in the accumulated classifier statistics. Across four datasets and three computational budgets, DuoCL improves online accuracy by an average of 9.67 percentage points over the strongest gradient-based baseline in each setting. DuoCL consistently outperforms analytic learning under distribution shifts, with gains of up to 4.00 percentage points on CIFAR-C, and achieves higher accuracy than prior methods across disjoint class-incremental, domain-incremental, and Si-Blurry settings.

Figures & tables

Explore similar work

CardsList
  1. Natural Gradient Descent for Online Continual Learning

    Mar 21, 2026Joe Khawand, David ColliauxKronecker-Factored ApproximationOnline Continual Learning

  2. MANGO: Meta-Adaptive Network Gradient Optimization for Online Continual Learning

    May 18, 2026Ankita Awasthi, Marco Apolinario, Kaushik RoyClass-Incremental LearningMeta-Learning