Overview

Model compression studies how to make trained models smaller or cheaper to run, especially for large language models, vision and generative models, and deployment on edge devices. Common approaches include quantization, pruning, low-rank factorization, layer or channel merging, and knowledge distillation; some methods combine them or optimize compression for a specific task and hardware. Evaluation typically measures model size, inference speed, and task quality on benchmarks such as language-model perplexity, vision accuracy, and generation quality. A central challenge is that parameter reduction does not always yield faster deployment or preserve reasoning, fairness, safety, and adaptability, so hardware-aware and task-specific evaluation remains important.

Latest papers

CardsList

131 papers10 papers in the last four weeks, down 29% on the four weeks before. 0.1% of all new papers.

  1. RACE: Ranking-Uncertainty Aware Capacity-Adaptive Customization for Efficient Sequential Recommendation

    Nov 13, 2026Tianqi Liu, Kaipu Sun, Kairui Fu +6Sequential RecommendationModel Compression

  2. Folding Language Models into Themselves

    Nov 13, 2026Ziyang Zhang, Yubin Jing, Yuyao Li +2Language Model DistillationModel Compression

  3. DictLLM: Post-training Compression of Large Language Model with Dictionary Kernels

    Nov 5, 2026Jinho Park, Se Young Chun, Mingoo SeokModel CompressionLLM Compression

  4. The Behavioral Rate of Fine-Tuning: Compression as a Measure of Useful Information

    Nov 4, 2026Joey David, Paul Caillon, Alexandre AllauzenFine-TuningModel Compression

  5. CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models

    Oct 29, 2026Andre Guarnier De Mitri, Giovani Decico Lucafo, Miller Matheus Lima Anacleto Rocha +1Medical Imaging Foundation ModelsCross-Architecture Knowledge Distillation

  6. Depth through Recurrence: Towards Ultra-Efficient On-Device ASR

    Oct 27, 2026Chen Feng, Tianyi Xu, Ramchalam Kinattinkara Ramakrishnan +5Automatic Speech RecognitionModel Compression

  7. Knowledge distillation across teacher architectures for compact diabetic retinopathy grading

    Oct 25, 2026Mossa Manisa, Habiba Jahan Priya, A. K. M. Fakhrul HossainKnowledge DistillationCross-Architecture Knowledge Distillation

  8. Compression of Vision Foundation Models for Retinal OCT via Growing-Neural-Gas Codebooks and Graph-Guided Masked Image Modeling

    Oct 23, 2026Ali Yavari, Tilman Schmoll, Rainer A. Leitgeb +2Model CompressionVision Foundation Models

  9. Benchmarking Model Compression Techniques Across Heterogeneous Edge Platforms: A Predictive Maintenance Use Case for Rotating Machinery

    Oct 21, 2026Matheus Calheira Guimarães de Oliveira, Marco Aurélio da Silva Cruz, Regis Cardoso +9Model CompressionEdge Inference

  10. How Far Can Foundation Models Be Distilled for Efficient Jet Tagging?

    Oct 21, 2026Jay Agarwal, Siddharth Khare, Dhruv KumarJet TaggingKnowledge Distillation

  11. Reliability-Preserving Compression for Deployable Medical Image Segmentation

    Oct 18, 2026Sagar Kumar, Shailja Sharma, Tirthajit Baruah +1Model CompressionNeural Network Compression

  12. Carve VFM: Carving Specialists out of Generalists, Automatic Task-Specific Compression of Vision Foundation Models

    Oct 12, 2026Lotfi Abdelkrim Mecharbat, Abdelrahman Elsayed, Ibrahim Almakky +2Model CompressionNeural Network Pruning

  13. Tabular Foundation Models Are Effectively Shallow

    Oct 9, 2026Irene Cannistraci, Julia E. VogtTransformer PruningTabular Foundation Models

  14. Dynamics as Code: On Model Compression via Dynamic System

    Oct 8, 2026Fan Gao, Wei Su, Juntong Fan +4Model CompressionNeural Network Compression

  15. Investigating Model Compression for Neural Machine Translation in the Biomedical Domain

    Oct 4, 2026Maria Zafar, Souhail Bakkali, Rejwanul HaqueModel CompressionMachine Translation

  16. What to Preserve in Recursive Computation: A Local Predictive Sufficiency Principle

    Oct 3, 2026Peilin Wang, Feng Shiyang, Hongfu Gao +4Model Compression

  17. Progressive Multi-Ancestor Bit-Depth Distillation

    Oct 2, 2026Adil Mubashir Chaudhry, Osama Ahmad, Zubair Khalid +1Quantization-Aware DistillationModel Compression

  18. Depth as Time in One-Step Generative Models

    Oct 2, 2026Arnold Caleb Asiimwe, William Yang, Sanghyuk Chun +2Diffusion ModelsOne-Step Generative Modeling

  19. CrossGMN: Graph Metanetworks for Cross-Architecture Weight-Space Transformations

    Oct 1, 2026Adir Dayan, Yam Eitan, Haggai MaronModel CompressionHypernetworks

  20. Toward Elastic Speech Inference: Training-Free Wake-Word Detection from Pretrained ASR

    Oct 1, 2026Hwayeon Kim, Youngwon Choi, Hyeonyu KimModel CompressionSpeech Processing

  21. GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

    Sep 22, 2026Baher Mohammad, Ammar Ali, Stamatios LefkimmiatisModel CompressionLow-Rank Compression

  22. Artificial Structure Function Search: Preserving Artificial Functional Connectivity for Structured Pruning

    Sep 21, 2026Mindula Illeperuma, Rafael Pina, Charuka Herath +2Model CompressionFunctional Connectivity

  23. FairCompressAgent: An Agentic Framework for Fairness-Aware Model Compression for FPGA Deployment

    Sep 15, 2026Yuanbo Guo, Yiyu ShiModel CompressionAlgorithmic Fairness

  24. Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression

    Sep 14, 2026Huicheng Zhang, Xiyao Feng, Ze-Tong Li +6Model CompressionLLM Compression

  25. ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression

    Sep 11, 2026Liu O. Martin, Lucas Bandarkar, Nanyun PengModel CompressionMixture-of-Experts Pruning

  26. Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging

    Sep 7, 2026Nazish Khalid, Tausifa Jan Saleem, Amal Saqib +2Model CompressionExplainable Medical Image Analysis

  27. Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions

    Sep 4, 2026Mahadev Sunil Kumar, Bhavika Gondi, Desaisetty Venkata Satya Sai Swapnith +6QuantizationModel Compression