Overview

Neural network pruning studies how to remove parts of a model that contribute little to its predictions, reducing memory use, computation, energy, or latency. Methods range from magnitude-based removal to scores using gradients, Fisher information, curvature, activations, redundancy, or task-specific behavior; they may prune individual weights or structured units such as channels, attention heads, and layers. Pruning can happen during training or after training in one shot or iteratively, often with fine-tuning, distillation, or compensation to recover lost performance. A central challenge is that the best pruning decisions depend on the model, task, calibration data, and hardware, so lower parameter counts do not always translate into faster inference or preserve reliability and reasoning behavior.

Latest papers

CardsList

305 papers16 papers in the last four weeks, down 59% on the four weeks before. 0.1% of all new papers.

  1. SoU-RHS: Bayesian Structured Sparsity for Compact Architecture Recovery in CNNs

    Nov 18, 2026Rafael Mouallem Rosa, Julyan ArbelStructured Neural Network CompressionNeural Network Pruning

  2. AutoAssumption: Searching over Assumptions Discovers ML-Systems Algorithms

    Nov 10, 2026Igor Sadalski, Minghao Guo, Benjamin Jones +1Automated Algorithm DiscoveryKV-Cache Eviction

  3. Nowcasting Future Performance for Population Pruning in Survival-of-the-Fittest Training

    Nov 4, 2026Rico Städeli, Léo Meynent, Boris Knyazev +1Learning Curve PredictionNeural Architecture Performance Prediction

  4. Structured Channel Network Pruning with Bi-Sparse Matrix Factorization

    Oct 31, 2026Jingjing Liu, Ziyang Wang, Xianchao Xiu +1Channel PruningNeural Network Pruning

  5. Prune Gradually, Adapt Sparsely: Efficient Pruning of Large Language Models at Extreme Sparsity

    Oct 30, 2026Jean Lucien Randrianantenaina, Hung Nguyen, Nasib Ullah +4LLM PruningNeural Network Pruning

  6. DAC-Loop: Distillation-Aware Compression for Remote Sensing CNN

    Oct 26, 2026Rico Staedeli, Lorena Raichle, Konstantinos Tzevelekakis +2Neural Network CompressionNeural Network Pruning

  7. Decoupled Prune-and-Reconstruct: Training on a Compact Core with Double-Layer Sparsification

    Oct 25, 2026Siqi Gu, Gaozhen Ma, Liheng Huang +4Graph Neural NetworksMemory-Efficient Training

  8. Sparse Bayesian Neural Networks via Sticky Piecewise Deterministic Markov Processes

    Oct 23, 2026August Arnstad, Geir Olve Storvik, Filippo Pagani +1Bayesian Neural NetworksSparse Neural Networks

  9. Building a Nested LADDER for LLM Unstructured Post-Training Pruning

    Oct 20, 2026Nicolás Mauricio Cuadrado Ávila, Ivo Gollini Navarrete, Martin Takáč +1LLM PruningNeural Network Pruning

  10. AC/DC on a Budget - Alternating Sparse Phases

    Oct 20, 2026Rahul Nittala, Advait Gadhikar, Tom Jacobs +1Neural Network CompressionNeural Network Pruning

  11. Reconstruction-Optimized Expert Pruning for Mixture-of-Experts Language Models

    Oct 19, 2026Jelena Markovic-Voronov, Petros Prastakos, Kayhan Behdin +7Mixture-of-Experts PruningMixture-of-Experts Language Models

  12. PDNet: Exploring Pruning and Distillation for Real-Time Worker Activity Recognition in Industrial Assembly

    Oct 19, 2026Malek Baba, Thinesh Thiyakesan Ponbagavathi, Alina RoitbergHuman Activity RecognitionNeural Network Pruning

  13. SPAR: Structural Pruning and Action Recovery for Vision-Language-Action Models

    Oct 19, 2026Shenli Zheng, Zhou Fang, Yuan Du +2Efficient VLA InferenceLVLM Pruning

  14. LOOP: Recovery-Aligned Iterative Layer Pruning via On-Policy Distillation

    Oct 19, 2026Liang Xu, Shufan Shen, Zhongni Hou +4LLM PruningNeural Network Pruning

  15. Visual Sufficiency Landscapes: Understanding Query-Conditioned Reliability in Visual Token Pruning

    Oct 18, 2026Zhenghan Li, Kexin Sun, Wei Zheng +3Visual Token PruningLVLM Pruning

  16. Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

    Oct 16, 2026Se Un Park, Kyungkeon Chung, Huigeol Kim +1Channel PruningEfficient Inference

  17. Prune the Leaky Neurons: Mitigating Private Data Leakage in Fine-Tuned LLMs via Joint-Embedding-Guided Pruning

    Oct 16, 2026Mohamed Shaaban, Mohamed ElmahallawyPrivacy Leakage in Language ModelsPrivacy-Preserving Language Models

  18. The Dormant Spiking Neuron: A State-Driven Mechanism for Efficient Spiking Neural Networks

    Oct 15, 2026Ruichen Ma, Yicai Chen, Pujun Zhou +5Spiking Neural NetworksEnergy-Efficient ML

  19. Your Transformer Is Secretly Elastic

    Oct 14, 2026Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts +1Elastic Neural NetworksTransformer Pruning

  20. Two For The Price Of One: Curvature-Aware Pruning Preserves Influence Functions Too

    Oct 13, 2026Mehdi Makni, Natalia Ponomareva, Rahul MazumderLLM PruningNeural Network Pruning

  21. When Sparsity Breaks Connectivity: Functional Reachability and Guided Topology Dynamics in Extreme Sparse Training

    Oct 12, 2026Mohammad Pasande, Mateusz Jaworski, Jeroen Rook +1Dynamic Sparse TrainingSparse Neural Networks

  22. Carve VFM: Carving Specialists out of Generalists, Automatic Task-Specific Compression of Vision Foundation Models

    Oct 12, 2026Lotfi Abdelkrim Mecharbat, Abdelrahman Elsayed, Ibrahim Almakky +2Model CompressionNeural Network Pruning

  23. BARTER: Compact Dynamic Sparse Training with Standard Dense Kernels

    Oct 12, 2026Yueyuan Sui, Payal Mohapatra, Qi Zhu +1Dynamic Sparse TrainingNeural Network Pruning

  24. Heterogeneous Structured Pruning Under Resource Constraints for Hardware-Efficient Large Language Models

    Oct 11, 2026Cameron Barker, Andreas Paraskeva, Jan N. van Rijn +2LLM PruningNeural Network Pruning