Overview

Modular neural networks study how to divide computation among specialized components and coordinate them to solve a task. Common approaches include gated mixtures of experts, branch-based networks, task-specific parameter masks, and compositional neural operators for physical systems. These designs aim to improve reuse, interpretability, efficiency, and continual learning by limiting interference between tasks or domains. A central tension is that specialization can help when module boundaries match the task, but effective routing and communication are difficult, and too much separation can limit useful sharing.

Latest papers

CardsList

79 papers4 papers in the last four weeks, down 56% on the four weeks before. 0.0% of all new papers.

  1. Specificity-Guided Knowledge Diversion for Decomposable Generative Models

    Nov 16, 2026Yucheng Xie, Fu Feng, Jing Wang +2Generative ModelingModular Neural Networks

  2. Recurrent Modular Structure in Spiking Neural Network Reinforcement Learning

    Nov 10, 2026Vikram Ramavarapu, Himanshu Udupi, Ashish GautamSpiking Neural NetworksModular Neural Networks

  3. Exploring Synchrony for Communication in Modular Neural Networks

    Nov 10, 2026Nikolas Willems, Qiyang Sun, Björn W. SchullerModular Neural NetworksCompositional Generalization

  4. Modular Bayesian Foundation Models: Bayesian time series encoders for OOD detection, routing and forecasting

    Oct 28, 2026Mame Diarra Toure, Quang Hung Pham, Mohamed Ryad Zemouri +3Time-Series Foundation ModelsModular Neural Networks

  5. Sparsity-driven emergence of functional modularity in multitask neural networks

    Oct 23, 2026Bowen Shi, Qi Ouyang, Long QianModular Neural NetworksMulti-Task Learning

  6. Length-Independent Stability and L2L_2-Gain Certificates for Chains of Delayed Neural Modules

    Oct 18, 2026Ömer Faruk İşcanlıNeural Network StabilityModular Neural Networks

  7. Hybrid Parallel Bessel KAN Model: a Kolmogorov Arnold Network: integrated framework for developing a novel architecture to reconstruct the fused-basis approach via a parameter free quadratic interaction

    Oct 13, 2026Mintu Pathak, Meshv Patel, Mohendra Roy +1Kolmogorov-Arnold NetworksModular Neural Networks

  8. Analyzing the Dynamics of WSBM-based Echo State Networks using InputDSA

    Oct 11, 2026Huy Mai, Robert ClarkeReservoir ComputingDynamic Neural Networks

  9. Neural networks are more modular than single neurons suggest

    Oct 9, 2026Shreya Saha, Benjamin Bergen, Meenakshi KhoslaModular Neural NetworksNeural Network Interpretability

  10. Scaling of Wireless Foundation Models via Representation Diversity and Multi-Branch Architectures

    Oct 3, 2026Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-ZeidWireless Foundation ModelsRepresentation Learning

  11. Dirac-Interconnected Neural Elements: Discovering Modularity in Physical Systems Without Reduction

    Oct 2, 2026Reiho Li, Razmik Arman Khosrovian, Takaharu Yaguchi +2Dynamical SystemsSystem Identification

  12. CORTEX: Learning to Share and Specialize in Dense Language Models

    Sep 28, 2026Chuiyang Meng, Ming Tang, Vincent W. S. Wongmodular language model architecturesDomain Adaptation for LLMs

  13. Brain-Inspired Hierarchical Modularity for General Continual Learning

    Sep 21, 2026Hongwei Yan, Kanglei Zhou, Qi Cheng +7Continual Learning for LLMsContinual Learning for VLA Models

  14. The Ups and Downs of Backprop Weights

    Sep 18, 2026Giuseppe Chindemi, Benjamin F. GreweModular Neural NetworksDynamic Neural Networks

  15. Modular Deep Learning Mechanisms for Auditable Next-Day Wildfire Spread Prediction

    Sep 15, 2026Miguel Esparza, Aydin Ayanzadeh, Ahmad Mousavi +1Wildfire ForecastingSpatiotemporal Forecasting

  16. Dual-Part Multi-Lateral Branched Network for Multi-Class Segmentation in Cardiovascular Catheterization Angiograms

    Sep 4, 2026Olatunji Omisore, Ahmed Elazab, Ali Shahidinejad +1Medical Image SegmentationModular Neural Networks

  17. Modular Deep Recurrent Neural Network: Application to Quadrotors

    Sep 3, 2026Nima Mohajerin, Steven L. WaslanderRecurrent Neural NetworksModular Neural Networks

  18. Sparse Competition during Training For the Emergence of Specialized Modules

    Aug 31, 2026Baptiste Rossigneux, Karim HarounSparse Neural NetworksNeural Network Training Dynamics

  19. LaMoC: Loss-Aware Modular Compression for LLMs

    Aug 31, 2026Mohanad Odema, Jacob SongModel CompressionLLM Compression

  20. A Unified Backbone--Expert Framework with Relation-Token and Residual--Classifier Interfaces for Automatic Modulation Recognition

    Aug 15, 2026Zhixiang Deng, Houbiao Li, Zongyong CuiAutomatic Modulation ClassificationModular Neural Networks

  21. Communication in modular robotic motor control: Bilateral controllers under realistic constraints

    Aug 14, 2026Jingwen Li, Levin Kuhlmann, Jason Friedman +1Robotic ControlRobotics

  22. The Neural Division of Labor: Biologically-Inspired Modular Architectures for Robust Neuromorphic Computing

    Aug 8, 2026Maksim Bazhenov, Serafim Grubas, Vakhtang PutkaradzeEfficient Neural Network InferenceNeural Network Interpretability

  23. Neural Network-Driven Volatility Drag Mitigation under Aggressive Leverage

    Jul 25, 2026Christian Bongiorno, Efstratios Manolakis, Rosario Nunzio MantegnaPortfolio OptimizationNeural Network Compression

  24. Scalable Keyword Spotting via Modular Network Expansion

    Jul 22, 2026Viktor Khaymonenko, Dzmitry Saladukha, Aliaksei Rak +1Class-Incremental LearningEfficient Neural Network Inference