Overview

Dynamic neural networks study how models can change what they compute or how they are structured in response to inputs, tasks, and available resources. Common approaches include early exits and conditional gating, elastic depth or width, expert routing, structural growth and pruning, and recurrent, spiking, or reservoir dynamics. These methods aim to reduce inference cost, handle changing environments, preserve learning across tasks, and model temporal processes, with evaluation spanning vision, forecasting, continual learning, and edge deployment. A central challenge is making adaptation reliable and efficient: routing and restructuring add overhead, and gains in accuracy, stability, and resource use depend strongly on the task and hardware.

Latest papers

CardsList

93 papers8 papers in the last four weeks, down 43% on the four weeks before. 0.1% of all new papers.

  1. PERTINENCE: Input-based Opportunistic Neural Network Dynamic Execution

    Jul 2, 2025Omkar Shende, Gayathri Ananthanarayanan, Marcello TraiolaEfficient Neural Network InferenceAdaptive Inference

  2. SEAL: Searching Expandable Architectures for Incremental Learning

    May 15, 2025Matteo Gambella, Manuel RoveriDynamic Neural NetworksContinual Learning