Unstructured Pruning

Ask about this topic

Momentum

9 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 43

All topics
CardsList

  1. QK-Wanda: Coupling Queries and Keys for Unstructured Pruning

    Oct 1, 2026Ivan Ilin, Peter RichtárikUnstructured PruningModel Weights

    KAUST

  2. Better Nearest Neighbor Graph Indices via (Efficient) LLM-Guided Pruning

    Sep 28, 2026Fangzhou Wu, Haike Xu, Sandeep SilwalGraph-Based RetrievalApproximate Nearest-Neighbor Search

    University of Wisconsin–Madison · MIT

  3. Output-aware Residual Stream Pruning for Large Language Models

    Sep 28, 2026Chayne Thrash, Kevin Chen, Soheil KolouriLarge Language Model CompressionUnstructured Pruning

    Department of Computer Science Vanderbilt University Nashville, TN 37235, USA

  4. GroupMask: Layer-Adaptive Group-wise Sparsity for Semi-Structured LLM Pruning

    Sep 27, 2026Zhengao Li, Shuoqiu Li, Xiaofang Zhang +7Unstructured PruningLarge Language Model Compression

    Florida State University · University of Connecticut · College of William & Mary +1

  5. Artificial Structure Function Search: Preserving Artificial Functional Connectivity for Structured Pruning

    Sep 21, 2026Mindula Illeperuma, Rafael Pina, Charuka Herath +2Unstructured PruningStructured Pruning

    Intitute for Digital Technologies, Loughborough University London · Center for Neuromorphic Intelligence, Aston University

  6. Higher-order pruning of experts in mixture-of-experts language models

    Sep 16, 2026Alex M. Tseng, Prannay Kaul, Luca Zancato +2Mixture-Of-Experts Large Language ModelsMixture-Of-Experts

    AI Fundamental Research AWS Agentic AI

  7. Theoretical Guarantees for One-Shot Magnitude Pruning and Compute-Adaptive Early Exit

    Sep 14, 2026Erdem KoyuncuUnstructured PruningDeep Network

    Department of Electrical and Computer Engineering, University of Illinois Chicago, IL, USA.

  8. LILA: Calibration-Free Structured Pruning of Large Language Models via Latent Spectral Geometry

    Sep 11, 2026Sankar Behera, Dhruv Singh, Anshika Agnihotri +3Large Language Model CompressionUnstructured Pruning

    CSE, IIT Jammu · Mathematics, IIT Jammu · IT, EC Bikaner +1

  9. Forward-Free LLM Depth Pruning via Weight Redundancy

    Sep 9, 2026Vincent-Daniel Yun, Woosang LimUnstructured PruningLarge Language Model Compression

    University of Southern California, United States · 2Seoul National University, Republic of Korea

  10. Functional Degeneracy in Neural Networks: Measurement and Pruning

    Aug 31, 2026Maria Matveev, Pascal Esser, Ayush Bharadwaj +2Unstructured PruningNeural Network

    Department of Mathematics, LMU Munich · Munich Center for Machine Learning (MCML) · Independent +3

  11. Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning

    Jul 23, 2026Rogerio Guimaraes, Pietro PeronaDiffusion ModelsInference-Time

    California Institute of Technology, Pasadena CA 91125, USA

  12. PRISM: Sensitivity-Aware PolynoMial PRuning for EffIcient Neural Network Encryption

    Jul 20, 2026Sahaj Majavdia, Mahdi TaheriHomomorphic EncryptionUnstructured Pruning

    Brandenburgische Technische Universität Cottbus-Senftenberg, Germany · Humboldt University of Berlin, Germany · Tallinn University of Technology, Tallinn, Estonia

  13. WaveNet-Style Guitar Amplifier Model Pruning for Real-Time iOS Deployment

    Jul 11, 2026Ryota Sato, Eli SilversteinUnstructured PruningInstrument

    Dept. of Electrical Engineering Stanford University Stanford, USA

  14. Structured Pruning of Large Language Models via Power Transformation and Sign-Preserving Score Aggregation with Adaptive Feature Retention

    Jul 9, 2026Ryota Kobayashi, Tsubasa Hirakawa, Takayoshi Yamashita +4Unstructured PruningStructured Pruning

    1Chubu University · 2Panasonic Holdings Corporation

  15. PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning

    Jul 8, 2026Yazdan Jamshidi, Alexey ShvetsUnstructured PruningLarge Language Model Compression

    Palo Alto Networks

  16. Provable Pruning for Efficient 3D Gaussian Splatting via Coresets

    Jul 2, 2026Waseem Mousa, Alaa MaaloufNovel View SynthesisUnstructured Pruning

    Department of Computer Science, University of Haifa

  17. MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving

    Jun 26, 2026Nan Yang, Zhanwen Liu, Linfeng Zhang +4Visual Token PruningAutonomous Driving

    School of Information Engineering, Chang’an University, China · School of Artificial Intelligence, Shanghai Jiaotong University, China

  18. CascadeFormer: Depth-Tapered Transformers Motivated by Gradient Fan-in Asymmetry

    Jun 25, 2026Huzama Ahmad, Cao Viet Hai Nam, Se-Young YunTransformer ArchitecturesLayer-Wise

    KAIST

  19. Complementary Attention Head Pruning for Efficient Transformers

    Jun 17, 2026Yaniv Livertovsky, Shahar Somin, Gonen SingerTransformer AttentionUnstructured Pruning

    Bar-Ilan University Ramat Gan, Israel

  20. Beyond Layer Importance in Layer-wise Sparsity: An Inter-Layer Perturbation-Absorption Perspective

    Jun 13, 2026Tao Jing, Ningxin Wu, Chen Kang +3Unstructured PruningLayer-Wise

  21. Squeeze-Release: Iterative Pruning with Exact Structural Minimization

    Jun 12, 2026Roman Denkin, Ida Akerholm, Prashant Singh +1Unstructured PruningBatch Normalization

    Department of Information Technology, Uppsala University, Uppsala, Sweden · Science for Life Laboratory, Uppsala University, Uppsala, Sweden

  22. Finding Sparse Subnetworks in One Training Cycle via Progressive Magnitude-Based Pruning

    Jun 10, 2026Romana Qureshi, Hafida Benhidour, Said Kerrache +1Unstructured PruningLotteries

    Department of Computer Science, King Saud University, Riyadh, Saudi Arabia

  23. Towards Data-free and Training-free Compression for Speech Foundation Models Using Parameter Clustering

    Jun 10, 2026Haoning Xu, Zhaoqing Li, Huimeng Wang +4Task-Aware CompressionUnstructured Pruning

    The Chinese University of Hong Kong, Hong Kong SAR, China · National Research Council Canada, Canada

  24. Beyond FLOPs: Benchmarking Real Inference Acceleration of LLM Pruning under a GEMM-Centric Taxonomy

    Jun 8, 2026Haozhe Hu, Hao Wu, Anhao Zhao +4LLM Inference OptimizationUnstructured Pruning

    Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo · Department of Computing, The Hong Kong Polytechnic University · Munich Center for Machine Learning, LMU Munich

  25. VEDAL: Variational Error-Driven Asynchronous Learning for 3D Gaussian Splatting Pruning

    Jun 1, 2026Aoduo Li, Jiancheng Li, Huan Ye +5Novel View SynthesisUnstructured Pruning

    Guangdong University of Technology · Huizhou Boluo Power Supply Bureau, Guangdong Power Grid Co., Ltd. · Shenzhen Polytechnic University +1

  26. CRePE: Convolution-aware Relative Importance in Post-training Pruning with Efficient Search

    Jun 1, 2026Cheonjun ParkUnstructured PruningLarge Language Model Compression

    Hankuk University of Foreign Studies

  27. Neural Network Compression by Approximate Differential Equivalence

    May 31, 2026Ravi Dhiman, Andrea Passarella, Mirco Tribastone +1Compressed ModelNeural Approximations

    IMT School for Advanced Studies Lucca 55100, Italy · IIT CNR, Pisa 56124, Italy

  28. Structured Neuron Pruning in Deep Neural Networks Using Multi-Armed Bandits

    May 29, 2026Salem Ameen, Sunil VaderaModern Deep NetworksUnstructured Pruning

    School of Science, Engineering and Environment, University of Salford, Salford, United Kingdom

  29. Joint Model and Data Sparsification via the Marginal Likelihood

    May 28, 2026Alexander Timans, Thomas Möllenhoff, Christian A. Naesseth +2SparsityBayesian Networks

    1UvA-Bosch Delta Lab, University of Amsterdam · 2RIKEN Center for AI Project, Tokyo, Japan · Department of Computer Science, Johns Hopkins University.

  30. PrunePath: Towards Highly Structured Sparse Language Models

    May 27, 2026Zhexuan Gu, Zixun Fu, Yancheng YuanUnstructured PruningSparsity

    Department of Applied Mathematics, The Hong Kong Polytechnic University

  31. Prune, Update and Trim: Robust Structured Pruning for Large Language Models

    May 18, 2026Diego Coello de Portugal Mecke, Tom Hanika, Lars Schmidt-ThiemeUnstructured PruningFeed-Forward

    ISMLL & DARC VWFS · University of Hildesheim · Hildesheim, Germany +1

  32. LEAP: Learnable End-to-End Adaptive Pruning of Large Language Models

    May 17, 2026Mohammad Mozaffari, Younes Hourri, Mohammad Rastegari +1Unstructured PruningSparsity

    Elastix AI · Department of Computer Science, University of Toronto, Toronto, Ontario, Canada.

  33. Spectral structural distortion reveals redundant neurons in neural networks

    May 14, 2026Yongyu WangNeuronsUnstructured Pruning

  34. SparseForge: Efficient Semi-Structured LLM Sparsification via Annealing of Hessian-Guided Soft-Mask

    May 7, 2026Liu Hanzuo, Chaofan Lin, Weixuan Sun +4SparsityUnstructured Pruning

    †Tsinghua University · ‡Tencent

  35. Random Cloud: Finding Minimal Neural Architectures Without Training

    Apr 29, 2026Javier Gil BlázquezNeural Architecture SearchUnstructured Pruning

  36. Revisiting the Effectiveness of LLM Pruning for Test-Time Scaling

    Apr 28, 2026Ocean Monjur, Shahriar Kabir Nahin, Anshuman ChhabraUnstructured PruningTest-Time Scaling

    Bellini College of AI, Cybersecurity, and Computing University of South Florida Tampa, FL, USA

  37. Supernodes and Halos: Loss-Critical Hubs in LLM Feed-Forward Layers

    Apr 26, 2026Audrey Cherilyn, Houman SafaaiFeed-ForwardUnstructured Pruning

    Kempner Institute at Harvard University

  38. SimDiff: Depth Pruning via Similarity and Difference

    Apr 21, 2026Yuli Chen, Shuhao Zhang, Fanshen Meng +4Unstructured PruningLarge Language Model Compression

  39. GRASPrune: Global Gating for Budgeted Structured Pruning of Large Language Models

    Apr 21, 2026Ziyang Wang, Jiangfeng Xiao, Chuan Xiao +3Large Language Model CompressionUnstructured Pruning

    Beijing Institute of Technology, Zhuhai · Shenzhen University · Osaka University

  40. MOONSHOT : A Framework for Multi-Objective Pruning of Vision and Large Language Models

    Apr 14, 2026Gabriel Afriat, Xiang Meng, Shibal Ibrahim +2Unstructured PruningNeural Network

    Operations Research Center Massachusetts Institute of Technology · Google · OpenAI +1

  41. Garbage Attention in Large Language Models: BOS Sink Heads and Sink-aware Pruning

    Jan 11, 2026Jaewon Sok, Jewon Yeom, Seonghyeon Park +2Large Language Model CompressionUnstructured Pruning

    Department of Rural Systems Engineering, Seoul National University · Graduate School of Data Science, Seoul National University · Department of Aerospace Engineering, Seoul National University

  42. Hyperflux: Pruning Reveals Importance

    Apr 6, 2025Eugen Barbulescu, Antonio Alexoaie, Lucian BusoniuUnstructured PruningStructured Pruning

    Department of Computer Science Technical University of Cluj-Napoca · Department of Automation Technical University of Cluj-Napoca

  43. DarwinLM: Evolutionary Structured Pruning of Large Language Models

    Feb 11, 2025Shengkun Tang, Oliver Sieberling, Eldar Kurtic +2Large Language Model CompressionUnstructured Pruning

    MBZUAI · ETH Zurich · ISTA +1