Large Language Model Compression

Ask about this topic

Momentum

18 papers in the last four weeks, up 200% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 134

All topics
CardsList

  1. SemanticFold: Latent Sequence Compression SeparatesLanguage Modeling, Decodability, and Reasoning

    Oct 7, 2026Mingyan Liu, Min HuangLarge Language Model Compression

  2. Activation-Aware Weight Tensorization: A Calibration-Time Preconditioner for Tensor-Network LLM Compression

    Oct 7, 2026Alessandro Beatini, Marco Maronese, Emanuele RodolàLarge Language Model CompressionModel Weights

  3. Shared Low-rank Basis Factorization for Data-free Mixture-of-Experts Compression

    Oct 7, 2026Tianxiao Cao, Jiahe Shao, Yuning Qiu +3Large Language Model CompressionLow-Rank Structure

  4. A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention

    Oct 6, 2026Davis Wertheimer, Haochen Shen, Ahan Gupta +6Large Language Model CompressionKey-Value Cache Compression

  5. Differentiable Bit-Widths: Co-optimizing Pruning and Quantization via SVD for Ultra-Efficient LLM Compression

    Oct 5, 2026Hankyul Kang, Jongbin RyuLarge Language Model Compression

    Ajou University

  6. The Functional Structure of Post-Compression Recovery in Low-Rank LLMs

    Oct 4, 2026Zishan Shao, Liang Tian, Georgiy Zemlevskiy +10Large Language Model CompressionLow-Rank Structure

    Duke University · Wake Forest University · Carnegie Mellon University +2

  7. MWOP: Modality-aware Width-wise Operation Pruning for Efficient MLLMs

    Oct 1, 2026Xudong Wang, Hao Wu, Haozhe Hu +5Visual Token PruningLarge Language Model Compression

    EIT-NLP Lab, Eastern Institute of Technology, Ningbo · Shanghai Jiao Tong University · The Hong Kong Polytechnic University +1

  8. Sequential Functional Structured Tucker Compression for Large Language Model Attentions

    Sep 30, 2026Jiangfeng Chen, Xinyu Wang, Tianshuo Yan +4Large Language Model CompressionTask-Aware Compression

    University of Manitoba · McGill University · Simpleway +2

  9. Learning Functional Subspaces for Neural Network Compression

    Sep 30, 2026Massimo Bini, Anders Christensen, Stephan Alaniz +5Large Language Model CompressionSubspace

    Helmholtz Munich · Technical University of Munich · MCML +6

  10. IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs

    Sep 30, 2026Pietro Moriello, Pietro Buzzega, Angelo Porrello +1Large Language Model CompressionStructured Pruning

    AImageLab, University of Modena and Reggio Emilia, Italy

  11. PatchKV: Weight-Space Compensation of KV Cache

    Sep 30, 2026Chanryeol Lee, Chanhyuk Lee, Yeonwoo Choi +2Key-Value Cache CompressionKey-Value Cache

    KAIST

  12. KV-Kaizen: Learning Context-Adaptive Cache Compression Choices

    Sep 29, 2026Joao Monteiro, Louis Béthune, Anastasiia Filippova +3Key-Value Cache CompressionLarge Language Model Compression

    Apple

  13. GleanVID: Complementary Token Selection for Efficient Video Large Language Models

    Sep 29, 2026Shuo Yang, Changbai Li, Rui Tang +3Video-Language ModelsLong Videos

    Beihang University · Communication University of China

  14. Output-aware Residual Stream Pruning for Large Language Models

    Sep 28, 2026Chayne Thrash, Kevin Chen, Soheil KolouriLarge Language Model CompressionUnstructured Pruning

    Department of Computer Science Vanderbilt University Nashville, TN 37235, USA

  15. Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale

    Sep 28, 2026Jun-qiang LuLarge Language Model CompressionLarge Language Model Pretraining

    Department of Physics, University of Puerto Rico, Mayagüez, PR 00680, USA

  16. GroupMask: Layer-Adaptive Group-wise Sparsity for Semi-Structured LLM Pruning

    Sep 27, 2026Zhengao Li, Shuoqiu Li, Xiaofang Zhang +7Unstructured PruningLarge Language Model Compression

    Florida State University · University of Connecticut · College of William & Mary +1

  17. MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression

    Sep 24, 2026Youpeng Zhao, Tian Tan, Liqian Peng +2Large Language Model CompressionKey-Value Cache Compression

    Google · University of Central Florida

  18. Layer-wise Curriculum Learning for Efficient LLM Compression

    Sep 16, 2026Donggeon Lee, Dooyeon Na, Seungmin Oh +1Large Language Model CompressionAdaptive Curriculum

    Ajou University, South Korea

  19. Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression

    Sep 14, 2026Huicheng Zhang, Xiyao Feng, Ze-Tong Li +6Large Language Model CompressionSingular Value Decomposition

    Hong Kong University of Science and Technology (Guangzhou), Guangdong 511453, China · QudeLeap Research, Shanghai 200030, China

  20. ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression

    Sep 14, 2026Liu O. Martin, Lucas Bandarkar, Nanyun PengLarge Language Model CompressionData Compression Methods

    University of California, Los Angeles

  21. LILA: Calibration-Free Structured Pruning of Large Language Models via Latent Spectral Geometry

    Sep 11, 2026Sankar Behera, Dhruv Singh, Anshika Agnihotri +3Large Language Model CompressionUnstructured Pruning

    CSE, IIT Jammu · Mathematics, IIT Jammu · IT, EC Bikaner +1

  22. Forward-Free LLM Depth Pruning via Weight Redundancy

    Sep 9, 2026Vincent-Daniel Yun, Woosang LimUnstructured PruningLarge Language Model Compression

    University of Southern California, United States · 2Seoul National University, Republic of Korea

  23. OMP-MoE: Efficient Expert Pruning for Mixture-of-Experts LLMs via Orthogonal Matching Pursuit

    Sep 9, 2026Dezhi Li, Lujun Li, Qiyuan Zhu +4Mixture-Of-Experts Large Language ModelsLarge Language Model Compression

    The Hong Kong University of Science and Technology

  24. LatentPress: Context Compression Beyond Text and Vision

    Sep 1, 2026Zhengze Zhou, Hejian SangEfficient Long-Context InferenceLarge Language Model Compression

    1Cornell University · 2Iowa State University

  25. Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

    Sep 1, 2026Seungwoo Jung, Dohyeok Kwon, Seungmin Cha +4Large Language Model CompressionImportance

    Department of Computer Science and Engineering, Korea University · Department of Computer Science and Artificial Intelligence, Dongguk University

  26. Tensor Methods for Language Models: From Token Representation to Training, Adaptation, Inference, Compression, and Interpretability

    Aug 31, 2026Matvei Tarasov, Salman Ahmadi-Asl, Andre L. F. de Almeida +1Large Language Model CompressionTensor Networks

    Innopolis University, Innopolis 420500, Russia · Department of Teleinformatics Engineering, Federal University of Cear´a, Fortaleza 60455-760, Brazil · Systems Research Institute of Polish Academy of Science and Warsaw University of Technology, Poland

  27. LaMoC: Loss-Aware Modular Compression for LLMs

    Aug 31, 2026Mohanad Odema, Jacob SongLarge Language Model CompressionData Compression Methods

    LG Electronics USA

  28. Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects

    Aug 30, 2026Hongyu Yu, Yifei ShenLarge Language Model CompressionLLM Inference Optimization

    Lenovo Research · University of Washington

  29. Unifying Depth and Width Pruning for LLMs via Binary Knapsack Optimization

    Aug 13, 2026Palaash Goel, Ayan Sengupta, Akshay Nambi +1Large Language Model CompressionStructured Pruning

    Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi · Department of Electrical Engineering, Indian Institute of Technology Delhi · Microsoft Research (MSR) India

  30. LegoLM: Structured Weight Sharing for Large Language Models

    Aug 9, 2026Joseph BinghamLarge Language Model CompressionModel Weights

    Deparment of Biology, Technion – Israel Institute of Technology

  31. Understanding Calibration and Truncation Error Propagation in Training-Free Low-Rank Compression for LLMs

    Aug 9, 2026Mohanad Odema, Gabrielle De Micheli, Dayin Gou +3Large Language Model CompressionLow-Rank Structure

    LG Electronics, North America

  32. Shape Mutating Expert Compression:LorExperts and BTExperts

    Aug 7, 2026Inesh Chakrabarti, Sourjya Roy, Bowen Bao +3Mixture-Of-Experts Large Language ModelsExperts

    Advanced Micro Devices

  33. Prune Once: Retraining-Free Task-Agnostic Pruning for Vision-Language Models

    Aug 7, 2026Minseok Kang, Hyunwoo Kim, Chanyoung Kim +3Visual Token PruningLarge Language Model Compression

    Department of Artificial Intelligence, Chung-Ang University, Seoul, Korea · School of Computer Science and Engineering, Soongsil University, Seoul, Korea · Department of Computer Science, Kookmin University, Seoul, Korea

  34. Pin Once, Swap Light: Subspace-Aligned Centroid-Residual Training for Efficient Ultra-LoRA Serving

    Aug 4, 2026Xiang Li, Pengcheng Wang, Huazheng Wang +1Low-Rank Adaptation AdaptersHip-Lora

    1Purdue University · 2Oregon State University

  35. Diffuse to Compress: Leveraging Diffusion LMs for Lossless Compression

    Aug 4, 2026Angelo Nardone, Paolo FerraginaLarge Language Model CompressionData Compression Methods

    University of Pisa, Department of Computer Science, Pisa, Italy · Scuola Superiore Sant’Anna, Pisa, Italy

  36. AnchorKV: Anchor-Residual KV Cache Compression

    Aug 3, 2026Malik Khalaf, Yara Shamshoum, Nitzan Hodos +2Key-Value Cache CompressionKey-Value Cache

    Department of Computer Science, Technion - Israel Institute of Technology

  37. Messages, Not Tokens: Grounded Coresets for Faithful VLM Compression

    Aug 3, 2026Long Qian, Jiaqi Wei, Bingke Zhu +2Large Language Model CompressionLearned Image Compression

    Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Engineering, Cardiff University, Cardiff, United Kingdom · School of Future Technology, University of Chinese Academy of Sciences, Beijing, China +1

  38. S4^4R: Selective Sampling, Subspaces, and Sparse Reconstruction for Compressed Long-Context KV Caching

    Aug 1, 2026Jialong Han, You Wu, Kewei TuKey-Value Cache CompressionKey-Value Cache

    School of Information Science and Technology, ShanghaiTech University · Shanghai Engineering Research Center of Intelligent Vision and Imaging

  39. F-WANDA: Fisher-Reweighted Post-Training Pruning for Sustainable Deployment of Large Language Models

    Aug 1, 2026Himanshu MishraLarge Language Model CompressionFluency

    University of British Columbia

  40. Lost in Compaction: Evaluating Side-Constraint Loss under Context Compaction

    Jul 31, 2026Zhiqi Wang, Yichi Zhang, Dongwon Lee +1CompactionLarge Language Model Compression

    The Pennsylvania State University

  41. LLM-based Source Code Compression via Thresholded Symbol Ranking

    Jul 27, 2026Angelo Nardone, Paolo FerraginaLarge Language Model CompressionTask-Aware Compression

    University of Pisa, Department of Computer Science, Pisa, Italy · Scuola Superiore Sant’Anna, Pisa, Italy

  42. CoCurve: Cross-Module Co-Pruning Curvature for Training-Free Structured LLM Pruning

    Jul 20, 2026Zhiren Gong, Zihao Zeng, Zijie Wang +3Structured PruningLarge Language Model Compression

    College of Computing and Data Science, Nanyang Technological University, Singapore · Interdisciplinary Graduate Programme, Nanyang Technological University, Singapore · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore

  43. Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching

    Jul 17, 2026Yan SongKey-Value Cache CompressionLarge Language Model Compression

    PayPal Inc.

  44. A JoLT for the KV cache: Near-Lossless KV Cache Compression via Joint Rank-bit Allocation

    Jul 14, 2026Rahul Krishnan, Volker SchulzKey-Value Cache CompressionKey-Value Cache

    Universität Trier · Fachbereich IV, Mathematik, Universität Trier

  45. CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA

    Jul 11, 2026Gengyu Zhang, Haiyin Ran, Zhengbao He +4Low-Rank Adaptation FrameworkLarge Language Model Compression

    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, China

  46. BiSCo-LLM: Lookup-Free Binary Spherical Coding for Extreme Low-Bit Large Language Model Compression

    Jul 9, 2026Yuantian Shao, Peisong Wang, Zhilei Liu +6Large Language Model Compression

    Nanjing University of Science and Technology, Nanjing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · Huawei, China

  47. Prompt Compression via Activation Aggregation

    Jul 9, 2026Thibaud Ardoin, Semira Einsele, Evis Bregu +1Large Language Model CompressionInstruction-Tuned Models

    Freie Universität Berlin

  48. LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression

    Jul 9, 2026Chris Xing Tian, Chengkai Wu, Ziyu Wang +6Learned Image CompressionLarge Language Model Compression

    Peng Cheng Laboratory, Shenzhen, China · Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR · Department of Computer Science, City University of Hong Kong, Hong Kong SAR +1

  49. What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

    Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiCompactionLarge Language Model Memory

    University of California, Irvine Irvine, California, USA

  50. PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning

    Jul 8, 2026Yazdan Jamshidi, Alexey ShvetsUnstructured PruningLarge Language Model Compression

    Palo Alto Networks

  51. LACE-SVD: Loss-Aware SVD with Cumulative Error Correction for LLM Compression

    Jul 3, 2026Zhuowen Liu, Longkun Hao, Shiyu Feng +3Large Language Model CompressionSingular Value Decomposition

    Zhuowen Liu1 · Longkun Hao2 · Shiyu Feng3 +3

  52. MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

    Jul 1, 2026Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5Key-Value Cache CompressionLarge Language Model Compression

    Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University, Shanghai, China

  53. CHERRY: Compressed Hierarchical Experts with Recurrent Representational Yield

    Jun 30, 2026Dohyeon Kwon, Youngjin ParkLarge Language Model CompressionLoss Function

    AXOps Team, TeamSparta Inc., Seoul, South Korea

  54. FlexMoE: One-for-All Nested Intra-Expert Pruning for MoE Language Models

    Jun 26, 2026Fan Mo, Yuxuan Han, Geng Zhang +2Mixture-Of-Experts Large Language ModelsMixture-Of-Experts

    National University of Singapore

  55. Output-Space Allocation Costs for Calibration-Guided LLM Compression: An Empirical Study

    Jun 26, 2026Qiong Tang, Xiangkun Hu, Xiangyang Liu +2Large Language Model CompressionTask-Aware Compression

    Analemma

  56. SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference

    Jun 25, 2026Haoqian Meng, Yilun Luo, Yafei Zhao +4Large Language Model QuantizationLarge Language Model Compression

    School of Computer Science and Technology, Tianjin University

  57. EPTS: Elastic Post-Training Sparsity for Efficient Large Language Model Compression

    Jun 24, 2026Ke Xu, Jiaqi Wan, Wenhao Hu +2Large Language Model CompressionSparsity

  58. Scaling Laws for Task-Specific LLM Distillation

    Jun 23, 2026Lavinia Ghita, Dhruv Desai, Ioana BoierLarge Language Model CompressionDataset Distillation

    NVIDIA

  59. SVD-Surgeon: Optimal Singular-Value Surgery for Large Language Model Compression

    Jun 22, 2026Mahmoud Safari, Frank HutterLarge Language Model CompressionSingular Value Decomposition

    University of Freiburg · Prior Labs · ELLIS Institute Tübingen

  60. UniRank: Unified Rank Allocation for Low-Rank LLM Compression

    Jun 20, 2026Chao Han, Yongjie Du, Junjie Tan +1Large Language Model CompressionTask-Aware Compression

    Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo