Large Language Model Compression

Follow this topic Ask about this topic

Recent momentum

-7%

14 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

3 new papers

A weekly snapshot of new work published in Large Language Model Compression.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Large Language Model Compression.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Large Language Model Compression.

136 papers

Latest in Large Language Model Compression

Browse all topics →

EinSort: Sorting is All We Need for Tensorizing LLM
Jun 7, 2026Toshiaki Koike-Akino, Jing Liu, Ye WangTensor Networks Low-Rank Factorization
STAR-KV: Low-Rank KV Cache Compression via Soft Thresholding for Adaptive Rank Control
Jun 7, 2026Priyansh Bhatnagar, Ashkan Moradifirouzabadi, Se-Hyun Yang +3Key-Value Cache Compression Key-Value Cache
Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression
Jun 5, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Mixed-Precision Quantization Weight-Only Quantization
SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
Jun 5, 2026Ernests Lavrinovics, Marco Letizia, Roy Janco +3Large Language Model Compression Context Compression
LLMCodec: Adapting Video Codecs for Efficient Weight Compression of Large Language Models
Jun 4, 2026Rui Wang, Yan Zhao, Li Song +1Large Language Model Compression Video Coding
Less is MoE: Trimming Experts in Domain-Specialist Language Models
Jun 4, 2026Haoze He, Xinkai Zou, Xuan Jiang +4Mixture-of-Experts Models Large Language Model Compression
Learned Subspace Compression for Communication-Efficient Pipeline Parallelism
Jun 3, 2026Paul Janson, Edouard Oyallon, Eugene BelilovskyLarge Language Model Compression Low-Rank Factorization
TENP: Trapezoidal Expert Neuron Pruning For Mixture-of-Experts
Jun 3, 2026Jiangyang He, Shaolin Zhu, Deyi XiongMixture-Of-Expert Language Models Mixture-of-Experts Models
Compress then Merge: From Multiple LoRAs into One Low-Rank Adapter
Jun 2, 2026Zhengbao He, Ruiqi Ding, Zhehao Huang +3Low-Rank Adaptation Large Language Model Compression
LLM Compression with Jointly Optimizing Architectural and Quantization choices
Jun 2, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Large Language Model Compression LLM Inference Efficiency
Rethinking the Role of Tensor Decompositions in Post-Training LLM Compression
Jun 2, 2026Artur Zagitov, Alexander Miasnikov, Maxim Krutikov +5Large Language Model Compression Tensor Programs
From Layers to Submodules: Rethinking Granularity in Replacement-Based LLM Compression
Jun 1, 2026Elia Cunegatti, Marcus Vukojevic, Erik Nielsen +1Large Language Model Compression Downstream Fine-Tuning
HMPO: Hybrid Median-length Policy Optimization for Chain-of-Thought Compression
Jun 1, 2026Minghui Zheng, Hongxu Chen, Huimin Ren +8Large Language Model Compression Context Compression
Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Prediction
Jun 1, 2026Yujia Tong, Yuxi Wang, Yunyang Wan +3Large Language Model Uncertainty Large Language Model Compression
CRePE: Convolution-aware Relative Importance in Post-training Pruning with Efficient Search
Jun 1, 2026Cheonjun ParkHeterogeneous Pruning Scores Large Language Model Post-Training
When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression
May 31, 2026Riku Kisako, Hayato Tsukagoshi, Ryohei SasanoLarge Language Model Compression Domain-Invariant Text Embeddings
LASER: Loss-Aware Singular-value Decomposition and Rank Allocation for Efficient Low-Precision Vision-Language Models
May 30, 2026Haiyu Wang, Yutong Wang, Leshu Li +2Large Language Model Compression Low-Rank Factorization
ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression
May 30, 2026Wenya Yu, Chao Zhang, Li Wang +2Large Language Model Quantization Large Language Model Compression
GRKV: Global Regression for Training-Free KV Cache Compression in Long-Context LLMs
May 29, 2026Junjie Peng, You Wu, Haoyi Wu +4Key-Value Cache Compression Key-Value Cache
Cross-Layer Subspace Coupling for LLM Compression: A Unifying Framework and Its Empirical Limits
May 29, 2026Snigdha Chandan KhilarLarge Language Model Compression Cross-Layer Interactions
Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended
May 29, 2026Aditya K Kamath, Arvind Krishnamurthy, Marco Canini +1Large Language Model Compression Context Compression
Moment-KV: Momentum-Based Decode-Time KV Cache Compression for Long Generation
May 28, 2026Soumyadeep Jana, Sagar Nishad, Sanasam Ranbir SinghKey-Value Cache Compression Efficient Long-Context Inference
AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference
May 28, 2026Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan KandemirVisual Token Pruning Visual Tokens
ConMoE: Expert-Pool Consolidation via Prototype Reassignment for MoE Compression
May 28, 2026Yilun Yao, Jiaming Pan, Elsie Dai +3Mixture-Of-Expert Language Models Mixture-of-Experts Models
Text-Preserving Lossy Text Compression: A Study of Strategic Deletion and LLM Reconstruction
May 27, 2026Yuchun Zou, Junhong Tong, Jun LiLarge Language Model Compression Domain-Invariant Text Embeddings
Pruning and Distilling Mixture-of-Experts into Dense Language Models
May 27, 2026Junhyuck Kim, Jihun Yun, Haechan Kim +3Mixture-Of-Expert Language Models Mixture-of-Experts Models
Locality-Aware Redundancy Pruning for LLM Depth Compression
May 27, 2026Vincent-Daniel Yun, Youngrae Kim, Woosang Lim +3Large Language Model Compression Pruning
NestedKV: Nested Memory Routing for Long-Context KV Cache Compression
May 26, 2026Hong Chen, Xiang Liu, Yubo Gao +5Key-Value Cache Compression Efficient Long-Context Inference
A general tensor-structured compression scheme for efficient large language models
May 25, 2026Ying Lu, Peng-Fei Zhou, Qi-Xuan Fang +3Large Language Model Compression Large Models
SemanticZip: A Pilot Framework for Lossy Text Compression with LLMs as Semantic Decompressors
May 23, 2026Natalia Trukhina, Vadim VashkelisLarge Language Model Compression Context Compression
Prompt Compression in Diffusion Large Language Models: Evaluating LLMLingua-2 on LLaDA
May 18, 2026Sterling Huang, Abigayle Brown, Jiyoo Noh +4Large Language Model Compression Diffusion Language Models
Compress the Context, Keep the Commitments: A Formal Framework for Verifiable LLM Context Compression
May 17, 2026Natalia Trukhina, Vadim VashkelisLarge Language Model Compression Context Compression
IO-SVD: Input-Output Whitened SVD for Adaptive-Rank LLM Compression
May 15, 2026Ali Abbasi, Chayne Thrash, Haoran Qin +2Large Language Model Compression Singular Value Decomposition
Self-Pruned Key-Value Attention: Learning When to Write by Predicting Future Utility
May 13, 2026Gergely Szilvasy, Manuel Faysse, Maria Lomeli +5Key-Value Cache Compression Key-Value Cache
Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven
May 10, 2026Jiwei Tang, Zhijing Huang, Xinyu Zhang +5Large Language Model Compression Efficient Long-Context Inference
SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
May 9, 2026Shengkun Tang, Zekun Wang, Bo Zheng +7Large Language Model Compression Large Language Model Pretraining
Different Prompts, Different Ranks: Prompt-aware Dynamic Rank Selection for SVD-based LLM Compression
May 9, 2026Hengyi Zhu, Zhendong Mi, Grace Li Zhang +1Large Language Model Compression Gradient-Free Rank Allocator
FlashSVD v1.5: Making Low-Rank Transformers Inference Actually Fast
May 8, 2026Wenhao Wu, Zishan Shao, Kangning Cui +5Singular Value Decomposition Large Language Model Compression
Layer Collapse in Diffusion Language Models
May 7, 2026Alexander Conzelmann, Albert Catalan-Tatjer, Shiwei LiuDiffusion Language Models Large Language Model Compression
Training Transformers for KV Cache Compressibility
May 7, 2026Yoav Gelberg, Yam Eitan, Michael Bronstein +2Key-Value Cache Compression Large Language Model Compression
Telegraph English: Semantic Prompt Compression via Structured Symbolic Rewriting
May 6, 2026Mikhail L. Arbuzov, Sisong Bei, Ziwei Dong +2Large Language Model Compression Context Compression
Complexity Horizons of Compressed Models in Analog Circuit Analysis
May 4, 2026Pacome Simon MbonimpaAnalog Circuits Large Language Model Compression
Mapping Text to Multiplex Graph: Prompt Compression as Lévy Walk-Guided Graph Pruning
May 4, 2026Yaxin Gao, Yao Lu, Jinhong Deng +7Large Language Model Compression Graph Language Models
SplitZip: Ultra Fast Lossless KV Compression for Disaggregated LLM Serving
May 3, 2026Yipin Guo, Siddharth JoshiKey-Value Cache Compression Large Language Model Compression
Importance-Guided Basis Selection for Low-Rank Decomposition of Large Language Models
May 2, 2026Daniel Agyei Asante, Ernie Chang, Yang LiLarge Language Model Compression Low-Rank Factorization
Activation Compression in LLMs: Theoretical Analysis and Efficient Algorithm
May 2, 2026Wen-Da Wei, Han-Bin Fang, Yang-Di Liu +3Large Language Model Compression Context Compression
KARA: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression
May 1, 2026Shen Han, Yuyang Wu, Junpu Yu +1Key-Value Cache Compression Large Language Model Compression
BWLA: Breaking the Barrier of W1AX Post-Training Quantization for LLMs
May 1, 2026Zhixiong Zhao, Zukang Xu, Dawei YangLarge Language Model Quantization Large Language Model Compression
ZipCCL: Efficient Lossless Data Compression of Communication Collectives for Accelerating LLM Training
Apr 30, 2026Wenxiang Lin, Xinglin Pan, Ruibo Fan +2Large Language Model Compression Context Compression
Post-Optimization Adaptive Rank Allocation for LoRA
Apr 30, 2026Vishnuprasadh Kumaravelu, Sunil Gupta, P. K. SrijithLow-Rank Adaptation Gradient-Free Rank Allocator
Carbon-Taxed Transformers: A Green Compression Pipeline for Overgrown Language Models
Apr 28, 2026Ajmain Inqiad Alam, Palash Roy, Chanchal K. Roy +2Large Language Model Compression Context Compression
Less is More: Lightweight Prompt Compression for Question Answering Applications on Edge Devices
Apr 27, 2026Zihuai Xu, Ruofei Hou, Yang Xu +3Large Language Model Compression LLM Inference Efficiency
Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency
Apr 27, 2026Yiran Huang, Lukas Thede, Massimiliano Mancini +2Large Language Model Compression Large Vision Language Models
From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priors
Apr 25, 2026Yitian Zhou, Chaoning Zhang, Jiaquan Zhang +6Large Language Model Compression Efficient Long-Context Inference
ResRank: Unifying Retrieval and Listwise Reranking via End-to-End Joint Training with Residual Passage Compression
Apr 24, 2026Xiaojie Ke, Shuai Zhang, Liansheng Sun +6Reranking Large Language Model Compression
FASQ: Flexible Accelerated Subspace Quantization for Calibration-Free LLM Compression
Apr 22, 2026Ye Qiao, Yian Wang, Zhiheng Chen +2Large Language Model Compression LLM Inference Efficiency
LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction
Apr 22, 2026Enshuai Zhou, Yifan Hao, Chao Wang +7Key-Value Cache Compression Large Language Model Compression
SimDiff: Depth Pruning via Similarity and Difference
Apr 21, 2026Yuli Chen, Shuhao Zhang, Fanshen Meng +4Heterogeneous Pruning Scores Large Language Model Compression
Predicting LLM Compression Degradation from Spectral Statistics
Apr 20, 2026Mingxue XuLarge Language Model Compression Low-Rank Factorization
UCCL-Zip: Lossless Compression Supercharged GPU Communication
Apr 19, 2026Shuang Ma, Chon Lam Lao, Zhiying Xu +8Multi-Gpu Systems Large Language Model Compression

Jun 7, 2026 · cs.LGJ/K move · Enter open · S save

EinSort: Sorting is All We Need for Tensorizing LLM

Toshiaki Koike-Akino, Jing Liu, Ye Wang

Tensor networks provide efficient representations for compressing large neural networks. By carefully designing shapes and topologies, they can significantly reduce memory and computational costs. However, identifying implicit low-rank structures in large foundation models remains challenging due to their enormous scale and un-structured weight distributions. We propose an adaptive tensorization method that discovers inherent low-rank structure in a target tensor by index ordering. Experiments on weight and KV-cache compression demonstrate improved reconstruction quality compared to baselines.

Tensor Networks Low-Rank Factorization Large Language Model Compression Neural Architectures Wireless Foundation Models Neural Network Key-Value Cache Compression Order Matters

Open paper Ask about it PDF