Neural Network Stability

Follow this topic Ask about this topic

Latest papers

56 papers14 papers in the last four weeks, up 367% on the four weeks before. 0.1% of all new papers.

Learning Time-Varying Connectomes for Stable Behavior Across Development
Nov 4, 2026Christof Fehrman, Jacob J. Morra, Eva A. NaumannNeural Network Stability Dynamic Neural Networks
Neurobiology, Duke University, Durham, 27710, NC, USA.
Unrolled gradients in disguise: bridging interpolation-based and Jacobian regularization for stable neural dynamics
Nov 2, 2026Maya Janvier, Etienne MeunierNeural Network Stability Neural ODEs
LOCEAN, Sorbonne University, Paris, France · Inria, Paris, France
End-to-End Stability of Online Active Learning in Large-Scale Neural Systems
Nov 2, 2026Shuiwen Shen, Jinhua Zhang, Chenlei Hou +6Online Learning Active Learning
School of Mechanical and Automotive Engineering, Xiamen University of Technology, Xiamen, 361024, China. · State Innovative Centre for Automotive Electric Driving at Xiamen, Xiamen, Fujian, 361010, China. · China Innovation Center for Intelligent and Connected Vehicles, Beijing, 100176, China. +4
Learning the Entropic Relaxation: Stable Coarse-Grid Emulation with Neural Discrete Equilibrium
Nov 2, 2026Jose Antonio Lara Benitez, Kareem Hegazy, Anastasis Kratsios +3PDE Surrogate Modeling Neural PDE Solvers
Rice University and LBNL · ICSI and University of California at Berkeley · McMaster University and the Vector Institute +3
When Does Jacobian Fine-Tuning Stabilize Neural PDE Emulators?
Oct 30, 2026Shreeyam Bangera, Manya GuptaPDE Surrogate Modeling Neural PDE Solvers
IIT Roorkee
Does LLM Pre-Training Typically Occur at the Edge of Stability?
Oct 27, 2026Yuhang Cai, Haodong Wen, Haofeng Huang +3Edge of Stability Neural Network Training Dynamics
UC Berkeley · Tsinghua University · ByteDance Seed
On the stability of learning
Oct 26, 2026John J. VastolaNeural Network Stability Neural Network Training Dynamics
Department of Neurobiology, Harvard Medical School · Department of Psychology and Center for Brain Science, Harvard University · Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University
Exploring perceptual straightness in learned visual representations
Oct 26, 2026Anne Harrington, Vasha DuTell, Ayush Tewari +4Visual Representation Learning Temporal Representation Learning
MIT CSAIL · MIT Brain and Cognitive Sciences · Woven Planet
Leveraging Dale's Principle as an Inductive Bias in Recurrent Neural Networks
Oct 25, 2026Jiyi Wang, Chenxiao Yang, Yujia Zhao +2Recurrent Neural Networks Neural Network Stability
Shanghai Qi Zhi Institute, Shanghai, China · Tsinghua University, Beijing, China
Certified Neural Approximation of Robust Nonlinear Model Predictive Control
Oct 21, 2026Hendrik Alsmeier, Maik Pfefferkorn, Rolf FindeisenNeural Network Control Nonlinear MPC
Control and Cyber-Physical Systems Laboratory, Technical University of Darmstadt, Landgraf-Georg-Str. 4, 64283 Darmstadt, Germany
Stabilizing Filters for Graph Signal Generation
Oct 20, 2026Martin Schmidt, Gonzalo MateosGraph Signal Processing Neural Network Stability
Dept. of Electrical and Computer Engineering, University of Rochester, Rochester, NY 14627, USA
Length-Independent Stability and $L_2$ -Gain Certificates for Chains of Delayed Neural Modules
Oct 18, 2026Ömer Faruk İşcanlıNeural Network Stability Modular Neural Networks
Department of Computer Engineering, Istanbul University-Cerrahpaşa, Istanbul, Türkiye
ControlJEPA: Principled Trajectory Regularization via Lyapunov Tube Loss
Oct 18, 2026Thai-Khanh Nguyen, Nhi Y. Pham, Uyen N. B. Vo +3Input-to-State Stability Latent-Space Regularization
Faculty of Information Technology 1, Posts & Telecommunications Institute of Technology · Center for AI Research, VinUniversity · Faculty of Artificial Intelligence, Posts & Telecommunications Institute of Technology +2
Global Convergence in Deep Networks via the Second Law of Thermodynamics
Oct 17, 2026Matan Tsipory, Ofir Gaash, Itamar Harel +2Neural Network Training Dynamics Stochastic Optimization Convergence
Technion - Israel Institute of Technology, The Andrew and Erna Viterbi Faculty of Electrical & Computer Engineering, Technion City, Haifa 3200003, Israel. · Technion - Israel Institute of Technology, Faculty of Data and Decision Sciences, Technion City, Haifa 3200003, Israel. · Toyota Technological Institute at Chicago, Chicago, IL, USA.
Muon Operates Beyond the Edge of Stability
Oct 16, 2026Niko Covic, Baraq Lipshitz, Alexander Padula +1Muon Optimizer Edge of Stability
Department of Informatics, ETH Zurich, Switzerland.
Distributed Performance Boosting through Neural Control for Plug-and-Play Networks
Oct 16, 2026Danilo Saccani, Leonardo Massai, Giancarlo Ferrari-TrecateNeural Network Control Distributed Control
Ecole polytechnique federale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland.
Understanding Stability of Outer Nesterov Momentum on Stochastic Pseudo-Gradients
Oct 15, 2026Nishant Sharma, Laura Gomezjurado Gonzalez, Ganesh Talluri +2Neural Network Stability Neural Network Training Dynamics
Chandar Research Lab · Mila – Quebec AI Institute · Université de Montréal +4
Lipschitz Thinking: Ten Years of Certifiable-by-Design Robust Neural Networks
Oct 5, 2026Fabio Brau, Giorgio Piras, Maura Pintor +1Neural Network Robustness Certified Robustness
Department of Electrical and Electronic Engineering, University of Cagliari, Cagliari, Italy
Learning Provable Neural Network Observer for Uncertain Dynamical Systems
Sep 25, 2026Zhangyi Wang, Jiaxu Liu, Song Chen +2Neural Network Stability Lyapunov Stability
College of Control Science and Engineering, Zhejiang University, China · School of Science, Huzhou Normal University, China · Department of Mathematics, National University of Singapore, Singapore
Stable initialization without the CLT
Sep 24, 2026Simon Kuang, Kyle Chickering, Xinfan LinNeural Network Initialization Neural Network Stability
Department of Mechanical and Aerospace Engineering University of California, Davis
When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay
Sep 8, 2026Hasan Amin, Wei-Kai Chang, Rajiv KhannaLearning Rate Scheduling Weight Decay
Purdue University
Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics
Aug 17, 2026Conrad Ainslie, Pedram Hassanzadeh, Michael W. Mahoney +1Neural Network Stability Neural Surrogate Modeling
Department of Applied Mathematics, University of California, Santa Cruz, Santa Cruz, 95064, CA · Department of Geophysical Sciences, University of Chicago, Chicago, IL 60637 · Committee on Computational and Applied Mathematics, University of Chicago, Chicago, IL 60637 +3
Local Stability and Gaussian Smoothing of Quantized Neural Networks
Jul 22, 2026Sergey Salishev, Anton Makarov, Oleg GranichinNeural Network Stability Neural Network Activation Functions
St. Petersburg State University, 199034, Saint Petersburg, Russia
Phasor Attention: Mean Root Square Normalization for Phase Manifold Preservation
Jul 20, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungNeural Network Stability Gradient Clipping
College of Pharmacy, Chungnam National University, Daejeon, Republic of Korea · Department of Computer Science & Engineering, Chungnam National University, Daejeon, Republic of Korea
Backward Coherence and Hidden-State Stability in Recurrent Neural Networks: A Quasi-Reverse-Martingale Theory
Jun 8, 2026Yuan-chin Ivan ChangRecurrent Neural Networks Neural Network Stability
Institute of Statistical Science, Academia Sinica · Academia Road, Section 2, Nankang, Taipei 115, Taiwan
Between Amnesia and Chaos: A Memory Stability Expressivity Trilemma for Trainable Dissipative Oscillator Networks
Jun 7, 2026Caleb MunigetyDynamical Systems Lyapunov Stability
Independent Researcher
Flatland: The Adventures of Gradient Descent with Large Step Sizes
Jun 4, 2026Leonardo Galli, Curtis Fox, Wiebke Bartolomaeus +2Gradient Descent Dynamics Edge of Stability
LMU Munich · Munich Center for Machine Learning · University of British Columbia +1
Mean--Fluctuation Dynamics at the Edge of Stability
Jun 3, 2026Antonin Chodron de CourcelEdge of Stability Gradient Descent Dynamics
Ecole Normale Sup´erieure, CNRS, 45 rue d’Ulm, 75005 Paris, France
Deep-layer limit and stability analysis of the basic forward-backward-splitting induced network (II): learning problems
May 26, 2026Xuan Lin, Chunlin WuNeural Network Stability Optimization Convergence Analysis
China Academy of Aerospace System and Innovation, 100088, Beijing, China · School of Mathematical Sciences, Nankai University, 94 Weijin Road, 300071, Tianjin, China
Non-normal spectral signatures of instability in neural network training dynamics
May 22, 2026Souvik GhoshDynamical Systems Neural Network Optimization
Department of Physics, National Sun Yat-sen University, Kaohsiung 80424, Taiwan

Nov 4, 2026J/K move · Enter open · S save

Learning Time-Varying Connectomes for Stable Behavior Across Development

Christof Fehrman, Jacob J. Morra, Eva A. Naumann

Neurobiology, Duke University, Durham, 27710, NC, USA.

Neural Network Stability Dynamic Neural Networks Neuroevolution

Open paper AskPDF arXiv

Neural circuits must maintain functionality to drive effective behavior while their size, topology, geometry, and intrinsic dynamics change across development. To model developing visuomotor circuits and behavior, we investigated whether a single compact generative encoding could produce functional recurrent controllers across such changes. Building on the HyperNEAT algorithm, we represented this program as a compositional pattern-producing network that received developmental time as an input to generate age-specific connectivity. The developmental substrate prescribed neuronal birth, position, sensory organization, and intrinsic time constants. We tested this approach using two geometrically distinct developmental substrates and two visuomotor tasks: optomotor responses and phototaxis. Controllers optimized at only the initial or mature substrate generally failed when evaluated at other ages. In contrast, controllers optimized across multiple developmental snapshots maintained substantially higher and more consistent performance across trained and unseen ages. Optimization at only three developmental snapshots was often sufficient to produce effective behavior across the tested developmental interval. The resulting connectomes changed substantially with age and did not converge on a single trajectory of sparsity or connection-weight statistics. Controllers also differed in whether they relied on neurons born later in development. These results demonstrate that a shared spatiotemporal time-varying connectivity program can produce recurrent neural networks that preserve behavior across substantial developmental changes. Together, these results provide a framework for studying how functional stability can emerge without requiring structural or dynamical stability.