Dynamic Neural Networks

Ask about this topic

Overview

Dynamic neural networks study how models can change what they compute or how they are structured in response to inputs, tasks, and available resources. Common approaches include early exits and conditional gating, elastic depth or width, expert routing, structural growth and pruning, and recurrent, spiking, or reservoir dynamics. These methods aim to reduce inference cost, handle changing environments, preserve learning across tasks, and model temporal processes, with evaluation spanning vision, forecasting, continual learning, and edge deployment. A central challenge is making adaptation reliable and efficient: routing and restructuring add overhead, and gains in accuracy, stability, and resource use depend strongly on the task and hardware.

Latest papers

CardsList

85 papers13 papers in the last four weeks, up 86% on the four weeks before. 0.1% of all new papers.

  1. FlowGenesis: Representation-Driven Self-Organization of Neural Architectures

    Oct 26, 2026Maksim A KazanskiiDynamic Neural NetworksNeural Network Growth

    Independent Researcher

  2. Dynamics of Hidden Learning Structure

    Oct 21, 2026Qinyou WangNeural Network Training DynamicsDynamic Neural Networks

  3. Sparse Federated Echo State Networks for Time-Series Classification via Smooth-L1 Regularization

    Oct 15, 2026Gengcheng Lyu, Manuel Röder, Frank-Michael SchleifSparse Neural NetworksTime Series Classification

    Faculty of Computer Science and Business Information Systems Technical University of Applied Sciences Würzburg-Schweinfurt, Würzburg, Germany

  4. CGDT-CESN: Correlation-Guided and Dynamics-Trained Clustered Echo State Network for Multivariate Time-Series Prediction

    Oct 15, 2026Hariharan Srinivasan, Masoom Bhargava, Sayan GuptaMultivariate Time Series ForecastingTime Series Forecasting

    The Uncertainty Lab, Department of Applied Mechanics & Biomedical Engineering, Indian Institute of Technology Madras, India - 600036 · Center for Complex Systems & Dynamics IIT Madras, India - 600036

  5. Your Transformer Is Secretly Elastic

    Oct 14, 2026Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts +1Elastic Neural NetworksTransformer Pruning

    University of Amsterdam · TNO, Intelligent Imaging

  6. Empirical Boundaries of Reservoir Computing for Few-Shot Sequence Pattern Tasks

    Oct 14, 2026Mario Mallea, Angela Nebot, Franscisco MugicaSequence-to-Sequence ModelsReservoir Computing

    Universitat Politècnica de Catalunya - BarcelonaTech, Soft Computing Research Group at the Intelligent Data Science and Artificial Intelligence Research Center, Barcelona, Spain.

  7. A Time-Variant Spiking Neuron from a Unified State-Dynamics Perspective

    Oct 14, 2026Jing Yang, Qianhui Liu, Gang Pan +1Spiking Neural NetworksDynamic Neural Networks

    School of Artificial Intelligence, Shandong University, Jinan, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, China · Department of Computer Science, National University of Singapore, Singapore

  8. Joint Embedding with Dynamic Integration network (JEDI-net)

    Oct 12, 2026Rishav Mukherjee, Jeffrey Ahearn ThompsonRepresentation LearningDynamic Neural Networks

    Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, Kansas, USA

  9. Analyzing the Dynamics of WSBM-based Echo State Networks using InputDSA

    Oct 11, 2026Huy Mai, Robert ClarkeReservoir ComputingDynamic Neural Networks

    Vietnam National University Ho Chi Minh City, University of Science · University of Bath

  10. ShellElastic: Scalable Elastic Pretraining with Simultaneous Maximal Updates and Hyperparameter Transfer

    Oct 10, 2026Can Jin, Yan Kang, Yifan Gong +5Elastic Neural NetworksTransformer

    Rutgers University · Adobe Research

  11. EV-JEPA: Elastic V-JEPA for Any Device and Cross-Device Inference

    Oct 9, 2026Anxhelo Diko, Jieyu Lin, Stefano Ambrogio +5Elastic Neural NetworksEdge-Cloud Collaborative Inference

    Meta Reality Labs Research · FAIR at Meta

  12. Physics-Informed Neural Plasticity: PDE Solvers That Reshape Themselves

    Oct 7, 2026Chun-Wun Cheng, Bingcheng Hu, Angelica I. Aviles-RiveroNeural PDE SolversPDE Solving

    Shanghai Normal University · YMSC, Tsinghua University

  13. Stepped MoE: Segment-Level Routing with Configurable Inference Complexity

    Oct 5, 2026Arnav Kundu, Zhaoyang Xu, Bairu Hou +3On-Device Language Model InferenceDynamic Neural Networks

    Apple

  14. Width Expansion as a Method for Class Incremental Learning

    Sep 29, 2026A. L. S. Conde, Y. Elkhatib, C. M. RanieriClass-Incremental LearningDynamic Neural Networks

    Institute of Geosciences and Exact Sciences, São Paulo State University (UNESP), Av. 24-A, 1515, Rio Claro, 13506-692, SP, Brazil · School of Computing Science, University of Glasgow, Glasgow, G12 8QQ, Scotland, United Kingdom

  15. NGN: Learning Neural Network Size as a Differentiable Count

    Sep 23, 2026Lixing LiDynamic Neural NetworksNeural Architecture Search

    Cornell University Ithaca, NY 14853

  16. HDND: Hierarchical Dynamic Neural Decoding for Multilingual Word/Character Retrieval from Non-Invasive Brain Recordings

    Sep 21, 2026Yueyang Li, Shuran Chen, Wai Ting Siok +1Dynamic Neural NetworksNeural Decoding

    Department of Language Science and Technology, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR, China

  17. Echo State Network (ESN) for Signal Recovery in RF-Impaired IBFD MIMO Systems

    Sep 20, 2026Conrad Prisby, Siyao Li, Chengtao Xu +1Wireless CommunicationsDynamic Neural Networks

    Department of Electrical Engineering and Computer Science, Embry-Riddle Aeronautical University, Daytona Beach, FL, USA · The Johns Hopkins University Applied Physics Laboratory, Laurel, MD, USA

  18. The Ups and Downs of Backprop Weights

    Sep 18, 2026Giuseppe Chindemi, Benjamin F. GreweModular Neural NetworksDynamic Neural Networks

    Institute of Neuroinformatics, UZH / ETH Zurich ETH AI Center Zurich, Switzerland

  19. SH-WRNN: Implicit Spherical Harmonics Weight Field Routing Neural Networks for Asymmetric Edge Intelligence

    Sep 13, 2026Zhibin Jiao, Xiangjing AnEfficient Neural Network InferenceDynamic Neural Networks

    Independent Researcher Team

  20. Runtime-Incremental Transformer for Reinforcement-Learning-Based Adaptive Control

    Sep 11, 2026Giansalvo Cirrincione, Adriano FagioliniRobotic ControlAdaptive Control

    Laboratoire LTI, Université de Picardie Jules Verne, Amiens, France · MIRPALab, Department of Engineering, University of Palermo, 90128 Palermo, Italy

  21. Elastoformer: Enabling Dynamic Adaptivity via Elastic Model Transformation

    Sep 9, 2026Sudaksh Kalra, Dolly SapraEfficient Neural Network InferenceDynamic Neural Networks

    University of Amsterdam The Netherlands

  22. Memristive-Friendly Hadamard Reservoir Computing: Structured, Multiplier-Free Recurrences at Scale

    Aug 28, 2026Andrea Ceni, Gianluca Milano, Carlo Ricciardi +1Reservoir ComputingNeuromorphic Computing

    Department of Computer Science, University of Pisa, Italy · Istituto Nazionale di Ricerca Metrologica (INRiM), Italy · Department of Applied Science and Technology, Politecnico di Torino, Italy

  23. Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models

    Aug 27, 2026Frederik BerenzWorld Model LearningDynamic Neural Networks

    121-labs.com Remscheid, Germany

  24. ENAF: A Multi-Exit Network with an Adaptive Patch Fusion for Large Image Super Resolution

    Aug 15, 2026Duong M. Nguyen, Tuan Nghia Nguyen, Xuan Truong NguyenImage Super-ResolutionEfficient Neural Network Inference

    Hanoi University of Science and Technology Hanoi, Vietnam · Seoul National University South Korea, Seoul 08826

  25. FEAST: Federated Shared-Space Training for Resource-Heterogeneous Clients

    Aug 10, 2026Bostan Khan, Masoud DaneshtalabDynamic Neural NetworksCommunication-Efficient Distributed Training

    Mälardalen University, Västerås, Sweden

  26. Tevatron-Elastic: A Unified Abstraction for Training Elastic Retrievers and Rerankers

    Aug 9, 2026Yu Wang, Shengyao Zhuang, Xueguang Ma +4Model CompressionDynamic Neural Networks

    University of Utah · 2The University of Queensland · University of Waterloo +1

  27. Rethinking Reservoir Pruning: A Dynamical Perspective for Echo State Networks

    Aug 5, 2026Sudip Laudari, Puspa Raj AdhikariDynamic Neural NetworksTime Series Forecasting

    Independent Researcher. · Advanced Materials Science and Engineering, Sungkyunkwan University.

  28. NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning

    Aug 5, 2026Seyed Roozbeh Razavi Rohani, Khashayar Khajavi, Wesley Chung +2Class-Incremental LearningDynamic Neural Networks

    Department of Computer Science Simon Fraser University · Department of Computer Science McGill Univeristy, Mila - Quebec AI Institute

  29. The Transformer Revolution, Part 1: Dynamic Processing through Output-Weight Interconnections

    Aug 4, 2026Marco Giunti, Fabrizia Giulia GaravagliaTransformer InferencePrompt Sensitivity

    ALOPHIS – Applied Logic Philosophy and History of Science Università di Cagliari · Dip. di Pedagogia, Psicologia, Filosofia Università di Cagliari

  30. Plasticity of Growing and Elastic Neural Networks in Online Continual Learning

    Aug 2, 2026Jeong Min Kong, Richard S. SuttonLoss of PlasticityDynamic Neural Networks

    Department of Electrical and Computer Engineering University of California, Los Angeles (UCLA) · Department of Computing Science University of Alberta Alberta Machine Intelligence Institute (Amii)