cs.LGSep 30, 2026

Disentangling Computation in Multi-Task Neural Networks with the Green's Operator

Authors: James Hazelden

Organizations: Applied Mathematics, University of Washington · The Allen Institute Seattle, WA, USA

Abstract

How is computation organized and reused across tasks and time in a trained recurrent network? Most analyses emphasize the geometry of neural activity, dynamical motifs, or local perturbation growth. We instead study the network's global first-order perturbation response. The finite-horizon Green's operator maps perturbations at each source along a trajectory to their downstream state-space responses and therefore directly represents perturbation routing. Simple reductions of this operator provide task-to-task and time-to-time views of the same computation, while matrix-free products make these views accessible without constructing the full operator. In a flexible multitask recurrent network, task reductions reveal structured reuse of known computational motifs, while temporal reductions reveal causal pathways and how they emerge during training. Our main point is simple: the Green's operator provides a global response geometry for mapping the organization of learned dynamical computation.

Figures & tables

Explore similar work

CardsList
  1. Unifying Dynamical Systems and Graph Theory to Mechanistically Understand Computation in Neural Networks

    May 5, 2026Jatin Sharma, Dan F. M Goodman, Danyal AkarcaRecurrent Neural NetworksNeural Network

  2. Multiple Neural Operators Achieve Near-Optimal Rates for Multi-Task Learning

    May 21, 2026Adrien Weihs, Hayden SchaefferProbabilistic Operator LearningNeural Operators

  3. Task-Restricted Symmetries in Recurrent Weight Space

    Jun 16, 2026Simon DrägerRecurrent Neural NetworksWeight-Space