cs.LGFeb 23, 2026

Representation Stability in a Minimal Continual Learning Agent

Authors: Vishnu Subramanian

Organizations: AI/ML Computational Science Associate Manager, Accenture

Abstract

Continual learning systems are increasingly deployed in environments where retraining or reset is infeasible, yet many approaches emphasize task performance rather than the evolution of internal representations over time. In this work, we study a minimal continual learning agent designed to isolate representational dynamics from architectural complexity and optimization objectives. The agent maintains a persistent state vector across executions and incrementally updates it as new textual data is introduced. We quantify representational change using cosine similarity between successive normalized state vectors and define a stability metric over time intervals. Longitudinal experiments across eight executions reveal a transition from an initial plastic regime to a stable representational regime under consistent input. A deliberately introduced semantic perturbation produces a bounded decrease in similarity, followed by recovery and restabilization under subsequent coherent input. These results demonstrate that meaningful stability plasticity tradeoffs can emerge in a minimal, stateful learning system without explicit regularization, replay, or architectural complexity. The work establishes a transparent empirical baseline for studying representational accumulation and adaptation in continual learning systems.

Figures & tables

Explore similar work

CardsList
  1. MoRe: Modular Representations for Principled Continual Representation Learning on Sequential Data

    May 14, 2026Jiaqi Sun, Boyang Sun, Rasmy M. H. +2Representation LearningHierarchical Representation Learning

  2. Harness Continual Learning: Continual Adaptation Beyond Model Parameters

    Aug 19, 2026Borui Kang, Jinrui Gu, Junhan Lv +3Continual Learning for LLM AgentsContinual Learning

  3. Balancing Plasticity and Stability with Fast and Slow Successor Features

    May 25, 2026Raymond Chua, Doina Precup, Blake RichardsStability-Plasticity DilemmaNon-Stationary RL