cs.LGOct 31, 2026

Unified dynamics of training, learning, inference, and reinforcement in neural networks

Authors: Mian Wang

Organizations: School of Civil Engineering and Architecture, Wuhan Polytechnic University, Wuhan 430023, China

Abstract

Through nine nanoGPT experiments, we established training-learning-inference relations: realized updates elicit state-dependent finite-amplitude responses; learning persistently reorganizes distributed functional support, with target-specific readout-boundary crossings determining capability transitions; inference recruits learned support without changing the learned state. Factors identified in the fifth experiment yielded a direct predictor of post-update capability transitions, achieving 91.43% accuracy and 91.49% four-way macro recall across 5,088 targets. We tested these relations and prediction across five additional neural architectures. In a seventh system, concentrated correct feedback eroded previously mastered skills; rebalanced feedback restored their accuracy from 70.31% to 99.48%. Linking inference consequences to subsequent training closes these relations into unified training-learning-inference-reinforcement dynamics. We subsequently established a unified system of dynamical equations, used it to reconcile positive and negative findings across existing research, and derived mathematical relationships in other neural-network theories using only the assumptions of the original studies.

Figures & tables

Explore similar work

CardsList
  1. Training, learning and inference: unified dynamics of neural systems

    Aug 21, 2026Mian WangNeural Network Training Dynamics

  2. When does a network's training history predict its future learning better than its current state? Evidence from a response probe and a forecasting screen

    Oct 7, 2026Martin Hofmann, Patrick MäderNeural Network Training Dynamics