Model Compression

Ask about this topic

Momentum

9 papers in the last four weeks, up 80% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 79

All topics
CardsList

  1. CrossGMN: Graph Metanetworks for Cross-Architecture Weight-Space Transformations

    Oct 1, 2026Adir Dayan, Yam Eitan, Haggai MaronModel CompressionHypernetworks

    Technion – Israel Institute of Technology · NVIDIA Research

  2. Toward Elastic Speech Inference: Training-Free Wake-Word Detection from Pretrained ASR

    Oct 1, 2026Hwayeon Kim, Youngwon Choi, Hyeonyu KimModel CompressionSpeech Processing

    MAUM AI Inc., Republic of Korea

  3. GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

    Sep 22, 2026Baher Mohammad, Ammar Ali, Stamatios LefkimmiatisModel CompressionLow-Rank Compression

    MWS AI, ITMO University · MWS AI

  4. Artificial Structure Function Search: Preserving Artificial Functional Connectivity for Structured Pruning

    Sep 21, 2026Mindula Illeperuma, Rafael Pina, Charuka Herath +2Model CompressionFunctional Connectivity

    Intitute for Digital Technologies, Loughborough University London · Center for Neuromorphic Intelligence, Aston University

  5. FairCompressAgent: An Agentic Framework for Fairness-Aware Model Compression for FPGA Deployment

    Sep 15, 2026Yuanbo Guo, Yiyu ShiModel CompressionAlgorithmic Fairness

    Department of Computer Science and Engineering University of Notre Dame Notre Dame, USA

  6. Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression

    Sep 14, 2026Huicheng Zhang, Xiyao Feng, Ze-Tong Li +6Model CompressionLLM Compression

    Hong Kong University of Science and Technology (Guangzhou), Guangdong 511453, China · QudeLeap Research, Shanghai 200030, China

  7. Distilling Foundation Models for Agentic What-If Reasoning:Cost, Latency, and Governance in a Hybrid LLM+SLM Architecture

    Sep 14, 2026Sourish Dey, Aditya KumarModel CompressionTabular Foundation Models

    Machine Learning SumUp, Berlin

  8. ESTS at WMT26: Routing-Informed Expert Pruning for Model Compression

    Sep 14, 2026Liu O. Martin, Lucas Bandarkar, Nanyun PengModel CompressionMixture-of-Experts Pruning

    University of California, Los Angeles

  9. Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging

    Sep 7, 2026Nazish Khalid, Tausifa Jan Saleem, Amal Saqib +2Model CompressionExplainable Medical Image Analysis

    Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409 USA · Computing and Mathematical Sciences Division, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  10. On the Interaction Between Model Compression and Test-Time Adaptation

    Sep 3, 2026Francesco Corti, Dong Wang, Young D. Kwon +2Model CompressionTest-Time Adaptation

    Graz University of Technology Graz, Austria · Samsung AI Center-Cambridge University of Cambridge Cambridge, United Kingdom · University of Cambridge Cambridge, United Kingdom +1

  11. Debias-SparseGPT: Bias-Aware Pruning for Large Language Models

    Sep 2, 2026Irina Proskurina, Guillaume Metzler, Antoine Gourru +1LLM PruningNeural Network Pruning

    1Laboratoire Hubert Curien, UMR CNRS 5516, Saint-Étienne, France · 2Université Claude Bernard Lyon 1, Université Lumière Lyon 2, ERIC · 3École Centrale de Lyon, LIRIS, CNRS UMR 5205

  12. XMerge: Cross-Axis Selection and Reconstructive Layer Merging for LLM Depth Compression

    Sep 2, 2026Jundong Hu, Shekar RamachandranLLM CompressionModel Compression

    PayPal AI

  13. LaMoC: Loss-Aware Modular Compression for LLMs

    Aug 31, 2026Mohanad Odema, Jacob SongModel CompressionLLM Compression

    LG Electronics USA

  14. TACTICL: Task-Aware Compression of Tabular ICL Models

    Aug 11, 2026Mykhailo Koshil, Matthias Feurer, Katharina EggenspergerModel CompressionTabular Foundation Models

    TU Dortmund University, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence, Germany

  15. Tevatron-Elastic: A Unified Abstraction for Training Elastic Retrievers and Rerankers

    Aug 9, 2026Yu Wang, Shengyao Zhuang, Xueguang Ma +4Model CompressionDynamic Neural Networks

    University of Utah · 2The University of Queensland · University of Waterloo +1

  16. Understanding Calibration and Truncation Error Propagation in Training-Free Low-Rank Compression for LLMs

    Aug 9, 2026Mohanad Odema, Gabrielle De Micheli, Dayin Gou +3Model CompressionLLM Compression

    LG Electronics, North America

  17. APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

    Aug 6, 2026Sadegh Jafari, Mohiuddin Bilwal, Fan Zhou +2Model CompressionMixed-Precision Quantization

    Department of Computer Science Iowa State University Ames, IA, USA · Department of Agricultural and Biosystems Engineering Iowa State University Ames, IA, USA

  18. Lossless Tensor Compression as Program Synthesis

    Aug 3, 2026Jieke Shi, Junda He, Wenjia Jiang +11Model CompressionProgram Synthesis

    James · Singapore Management University, Singapore · CSIRO, Australia +3

  19. Progressive2^2: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression

    Jul 31, 2026Tiancong Cheng, Ying Zhang, Zhiwen Yu +2Model CompressionKnowledge Distillation

    School of Computer Science, Northwestern Polytechnical University, Xi’an 710129, China

  20. Fidelity Is Not Safety: Gently-Compressed LLMs Pass Every Data-Free Quality Guard Yet Invent Procedure Steps in Agentic Execution

    Jul 30, 2026I. Kennedy, T. KennedyModel CompressionAI Agent Reliability

  21. Memory Efficient Tabular Foundation Models

    Jul 30, 2026Shuting Luo, Monika Mikhail Kanaan, Cameron Gordon +2Model CompressionTabular Foundation Models

    Commonwealth Bank of Australia, Australia · Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia

  22. VAD to the Bone: Ultra-Tiny Speech Activity Detection for Edge Deployment

    Jul 28, 2026Stephen Bauer, Sheila Seidel, Shanza Iftikhar +2Model CompressionSpeech Processing

    Analog Devices, Inc., USA · University of California, Los Angeles (UCLA), USA

  23. Post-Training in Time Series Foundation Models: A Unifying Framework

    Jul 22, 2026Shifeng Xie, Ambroise Odonnat, Zehao Xiao +7Model CompressionTime-Series Foundation Models

    Noah’s Ark Lab · Université Paris Cité · Inria +2

  24. Real-Time Semantic Segmentation with Optimized RetinaNet Architectures for Embedded Automotive Systems

    Jul 21, 2026Sai Sidharth DModel CompressionEdge Inference

  25. Decoder-Preserving Sparse Autoencoders: Which Readouts Survive Sparse Compression?

    Jul 19, 2026Aniket DeshpandeModel CompressionActivation Sparsity

    Department of Physics, University of Illinois Urbana-Champaign

  26. MIS-HCC: Hierarchical Channel Clustering for Efficient Medical Image Segmentation

    Jul 19, 2026Bo Zhao, Haoran Yu, Lifei Liu +5Model CompressionClustering

    Yale University · University of Florida · Wichita State University +5

  27. Constraint-Driven Model Optimization: An Industry Framework for Selecting Compression and Acceleration Techniques in Modern Machine Learning Systems

    Jul 15, 2026Dhruv Shivkant, Saket Mohanty, Utkarsh WadhwaModel CompressionConstrained Optimization

    Indian Institute of Science · EXL

  28. Requential Coding: Pushing the Limits of Model Compression with Self-Generated Training Data

    Jul 13, 2026Shikai Qiu, Marc Finzi, Yujia Zheng +2Model CompressionNeural Network Generalization

    New York University · Carnegie Mellon University

  29. Adaptive Model Compression (AMC): Saliency-Driven Resource Allocation for Ultra-Low-Power Transformer Inference

    Jul 11, 2026Jiayin Hu, Kai Yuan, Vanessa Hu +3Efficient Transformer InferenceModel Compression

    Apple USA

  30. Displacement Preserving Relational Distillation for Robust Medical Segmentation

    Jul 6, 2026Zhicheng Ding, Xinyu Chu, Jung Im Choi +5Model CompressionRelational Knowledge Distillation

    Bowling Green State University, Bowling Green, OH, USA · University of Alabama at Birmingham, Birmingham, AL, USA · The University of Findlay, Findlay, OH, USA +3

  31. LACE-SVD: Loss-Aware SVD with Cumulative Error Correction for LLM Compression

    Jul 3, 2026Zhuowen Liu, Longkun Hao, Shiyu Feng +3Model CompressionLLM Compression

    Zhuowen Liu1 · Longkun Hao2 · Shiyu Feng3 +3

  32. SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models

    Jul 2, 2026Qi Lyu, Jiahua Dong, Baichen Liu +7Model CompressionVision-Language Models

    State Key Laboratory of Robotics and Intelligent Systems · Shenyang Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences +2

  33. Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers

    Jul 1, 2026Jaeah Lee, Hyunjin Kim, Jaewoong Cho +1Model CompressionDiffusion Transformer

    KRAFTON AI, Republic of Korea · Amazon, Australia

  34. Output-Space Allocation Costs for Calibration-Guided LLM Compression: An Empirical Study

    Jun 26, 2026Qiong Tang, Xiangkun Hu, Xiangyang Liu +2Model CompressionLLM Compression

    Analemma

  35. Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?

    Jun 26, 2026Guoheng Sun, Kaixi Feng, Shwai He +8Model CompressionEfficient VLA Models

    University of Maryland, College Park · 2Cisco Research

  36. TMP: Tree-structured Mixed-policy Pruning for Large-scale Image Generation and Editing

    Jun 25, 2026Peizhen Zhang, Yang Li, Xunsong Li +10Model CompressionDiffusion-Based Image Generation

    Multimodal Model Department, Tencent

  37. What Survives When You Compress a Recursive Reasoner for the Edge?

    Jun 25, 2026Pearse Jim, Steven Kolawole, Opegbemi Matthias Busoye +2Model CompressionEfficient Neural Network Inference

    ML Collective · Carnegie Mellon University

  38. Agentic evolution of physically constrained foundation models

    Jun 24, 2026Jiangwei Zhang, Wen Sun, Chong Wang +7Model CompressionLLM Quantization

    State Key Laboratory of Cyberspace Security Defense, Institute of Information Engineering, Chinese Academy of Sciences, Beijing, 100084, China. · University of Chinese Academy of Sciences, Beijing, 101408, China. · Department of Electronic Engineering, Tsinghua University, Beijing, 100084, China.

  39. Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks

    Jun 22, 2026Minh-Loi Nguyen, Long-Bao Nguyen, Van-Hieu Huynh +2Model CompressionEfficient Neural Network Inference

    University of Science, Ho Chi Minh city, Vietnam · Vietnam National University, Ho Chi Minh city, Vietnam

  40. Scaling Audio Models Efficiently: Joint Optimization of Scale, Resolution, Adaptation, Precision, and Sparsity

    Jun 22, 2026Vyom Agarwal, Mokshda Gangrade, Siddharth Pal +1Model CompressionStructured Sparsity

    Computer, Mathematical, and Natural Sciences, University of Maryland, College Park, MD, USA · RTX BBN Technologies, Columbia, MD, USA · Electrical and Computer Engineering, University of Maryland, College Park, MD, USA

  41. When Compression Helps and When It Hurts: Condition-Aware Analysis of Chain-of-Thought Distillation

    Jun 19, 2026Siyang Lyu, Xinghao Chen, Zhijing Sun +3Model CompressionCoT Distillation

    Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo · Viterbi School of Engineering, University of Southern California · The Hong Kong Polytechnic University +2

  42. Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think

    Jun 18, 2026Gia-Binh Nguyen, Trong-Bao Ho, Thien-Loc Ha +18Model CompressionEfficient VLA Model Inference

    Center for AI Research, VinUniversity · VinRobotics · University of Arkansas +10

  43. Complementary Attention Head Pruning for Efficient Transformers

    Jun 17, 2026Yaniv Livertovsky, Shahar Somin, Gonen SingerModel CompressionTransformer Attention

    Bar-Ilan University Ramat Gan, Israel

  44. Efficiency-Performance Trade-offs in Neural Speaker Diarization via Structured Pruning and Low-Bit Quantization

    Jun 12, 2026Rishit Chatterjee, Tahiya ChowdhuryModel CompressionSpeaker Diarization

    Department of Computer Science, Colby College, Waterville, Maine, United States

  45. Simplex-Constrained Sparse Bagging: Transitioning from Uniform Priors to Sparse Posteriors in Ensemble Learning

    Jun 11, 2026Meher Sai Preetam Madiraju, Meher Bhaskar MadirajuModel CompressionProbability Calibration

  46. SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices

    Jun 5, 2026Ernests Lavrinovics, Marco Letizia, Roy Janco +3Model CompressionLLM Compression

    Department of Computer Science, Aalborg University Copenhagen, Denmark · MaLGa-DIBRIS, University of Genoa, Genoa, Italy · INFN, Sezione di Genova, Genoa, Italy +2

  47. LLMCodec: Adapting Video Codecs for Efficient Weight Compression of Large Language Models

    Jun 4, 2026Rui Wang, Yan Zhao, Li Song +1Model CompressionLLM Quantization

    Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University. Shanghai, China

  48. Spatially Distributed Task-Oriented Compression for Multi-Emitter Localization and Characterization with Spectral Overlap

    May 31, 2026H. Nazim Bicer, J. Nicholas LanemanModel CompressionWireless Communications

    Dept. of Electrical Engineering University of Notre Dame Notre Dame, IN, USA

  49. DASH: Dual-Branch Score Distillation for Guidance-Calibrated Compact Diffusion Models

    May 30, 2026Abdullah Al Shafi, Kazi Saeed Alam, Sk Imran Hossain +1Model CompressionClassifier-Free Guidance

    Khulna University of Engineering & Technology, Bangladesh · University Clermont Auvergne, France

  50. Cross-Layer Subspace Coupling for LLM Compression: A Unifying Framework and Its Empirical Limits

    May 29, 2026Snigdha Chandan KhilarModel CompressionLLM Compression

    Independent Researcher

  51. Smaller and Faster 3DGS via Post-Training Dictionary Learning

    May 28, 2026Jiarong Gong, Jonas Unger, Ehsan Miandji3DGS CompressionModel Compression

    Linköping University Department of Science and technology

  52. PINE: Pruning Boosted Tree Ensembles with Conformal In-Distribution Prediction Equivalence

    May 27, 2026Haruki Yajima, Yusuke MatsuiModel CompressionEnsemble Learning

    The University of Tokyo.

  53. LIFT and PLACE: A Simple, Stable, and Effective Knowledge Distillation Framework for Lightweight Diffusion Models

    May 19, 2026Hyunsoo Han, Sangyeop Yeo, Jaejun YooModel CompressionDiffusion Model Distillation

    Ulsan National Institute of Science and Technology (UNIST)

  54. SAFE-SVD: Sensitivity-Aware Fidelity-Enforcing SVD for Physics Foundation Models

    May 18, 2026Chengjie Hong, Feixiang He, Yiheng Zeng +2Model CompressionLow-Rank Compression

    University College London, UK · Central South University, China · University of Massachusetts at Amherst, US +1

  55. MedCore: Boundary-Preserving Medical Core Pruning for MedSAM

    May 13, 2026Cenwei Zhang, Suncheng Xiang, Lei YouModel CompressionImage Segmentation

    Shanghai Jiao Tong University Shanghai, China · Technical University of Denmark Ballerup, Denmark

  56. Minimax Rates and Spectral Distillation for Tree Ensembles

    May 12, 2026Binh Duc Vu, David S. WatsonModel CompressionGradient-Boosted Decision Trees

    King’s College London

  57. Robust Basis Spline Decoupling for the Compression of Transformer Models

    May 11, 2026Joppe De Jonghe, Van Tien Pham, Mariya IshtevaModel CompressionTensor Decomposition

    aNUMA, Department of Computer Science, KU Leuven, Kleinhoefstraat 4, Geel, 2440, Antwerpen, België · bUniversité Paris-Saclay, CEA, List, Palaiseau, F-91120, France

  58. XTinyU-Net: Training-Free U-Net Scaling via Initialization-Time Sensitivity

    May 10, 2026Alvin Kimbowa, Moein Heidari, David Liu +1Model CompressionU-Net

    School of Biomedical Engineering, The University of British Columbia, Vancouver, Canada · Department of Radiology, The University of British Columbia, Vancouver, Canada · Department of Medicine, The University of British Columbia, Vancouver, Canada

  59. PACE: Prune-And-Compress Ensemble Models

    May 7, 2026Fabian Akkerman, Julien Ferry, Théo Guyard +1Model CompressionEnsemble Learning

    Industrial Engineering and Management Science University of Twente, Netherlands · SCALE-AI Chair and CIRRELT Polytechnique Montréal, Canada

  60. Compress Then Adapt? No, Do It Together via Task-aware Union of Subspaces

    May 4, 2026Jingze Ge, Yun Liu, Xue Geng +4Model CompressionAdapter Tuning

    National University of Singapore · Nankai University · Institute for Infocomm Research (I2R), A*STAR