Neural Network Compression

Ask about this topic

Momentum

13 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 128

All topics
CardsList

  1. NeuralZip: Reusable Setup for Fast Lossless Compression

    Oct 7, 2026Martín Bravo, Samuel Horváth, Gonzalo Navarro +1Neural Network CompressionEntropy Coding

    Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Department of Computer Science, University of Chile, Santiago, Chile · National Center for Artificial Intelligence (CENIA), Santiago, Chile

  2. CHASE: Channel-Aligned Structure Exploitation for Geometry-Aware Model Engineering

    Oct 7, 2026Wei Wang, Wei Jiang, Ziran LiuNeural Network CompressionKV-Cache Compression

    Futurewei Technologies San Jose, CA 95131, USA · Shanghai Institute for Mathematics and Interdisciplinary Sciences (SIMIS) Shanghai, 200433, China

  3. Differentiable Bit-Widths: Co-optimizing Pruning and Quantization via SVD for Ultra-Efficient LLM Compression

    Oct 5, 2026Hankyul Kang, Jongbin RyuLLM QuantizationLLM Pruning

    Ajou University

  4. Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detection

    Oct 4, 2026Miao He, Peng Cheng, Zhongjie Ba +4Audio Deepfake DetectionKnowledge Distillation

    The State Key Laboratory of Blockchain and Data Security, Zhejiang University, China · Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security, China · Qingdao Institute of Software College of Computer Science and Technology, China University of Petroleum (East China), China +1

  5. Learning Functional Subspaces for Neural Network Compression

    Sep 30, 2026Massimo Bini, Anders Christensen, Stephan Alaniz +5LLM CompressionLow-Rank Matrix Decomposition

    Helmholtz Munich · Technical University of Munich · MCML +6

  6. A Tilted Bowl Is Not a Slippery Slope: Compressing Looped Models

    Sep 30, 2026Steven Kolawole, Pearse Jim, Opegbemi M. Busoye +2Efficient Neural Network InferenceRecurrent Neural Networks

    Carnegie Mellon University · ML Collective

  7. Security-Enhanced Seed-Based Weight Quantization for Large Language Models

    Sep 29, 2026Qiuyu Ren, Sudipta Paria, Aritra Dasgupta +1LLM QuantizationLLM Compression

    Department of Electrical and Computer Engineering (ECE) University of Florida Gainesville, FL 32611, USA

  8. Hardware-Aware Functional Kolmogorov-Arnold Networks for Efficient Medical Image Enhancement and Segmentation

    Sep 28, 2026Mohammad Sadegh SirjaniEfficient Neural Network InferenceKolmogorov-Arnold Networks

    Department of Computer Science University of Texas at San Antonio, San Antonio, TX, USA

  9. P4Q: Co-designing Token Pruning and Quantization for Vision-Language Model Acceleration

    Sep 28, 2026Haizhao Jing, Zhenhao Shang, Haokui Zhang +2VLM QuantizationEfficient VLM Inference

    Northwest Polytechnical University · Intellifusion

  10. EntroPack: Fast and Accurate Entropy-Coded Weight Compression at Arbitrary Bitrates

    Sep 28, 2026Hong Zhang, Zhongjie Duan, Yingda ChenEfficient Neural Network InferenceWeight-Only Quantization

    Alibaba Inc.

  11. One Latent, Many Tokens: Jointly Learning Compressed Embeddings for Efficient Language Diffusion

    Sep 27, 2026Yulin Yuan, Ying Zhang, Xiangming MengDiffusion Language Model InferenceDiffusion Language Models

    Zhejiang University · University of Cambridge · ZJU-UIUC Institute, Zhejiang University

  12. GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

    Sep 22, 2026Baher Mohammad, Ammar Ali, Stamatios LefkimmiatisModel CompressionLow-Rank Compression

    MWS AI, ITMO University · MWS AI

  13. A Smaller Transformer in Your Transformer

    Sep 17, 2026Dhananjay Tomar, Marius Aasan, Andreas Kleppe +1Transformer InferenceVision Transformer

    Institute for Cancer Genetics and Informatics Oslo University Hospital Oslo, Norway · Department of Informatics University of Oslo Oslo, Norway · SFI Visual Intelligence UiT The Arctic University of Norway Tromsø, Norway

  14. Multi-Agent Learning with Cooperation-Driven Optimization Dynamics

    Sep 15, 2026Jarod Ketcha Kouakep, Sreyvi UANN, Timoteo CarlettiMultilayer PerceptronsNeural Network Optimization

    Department of Mathematics and Namur Institute for Complex Systems, naXys, University of Namur, Belgium · Department of Applied Mathematics and Statistics, Institute of Technology of Cambodia, Phnom Penh, Cambodia.

  15. Dense Structural Compression of Transformers via Gauge-Correct Channel Removal

    Sep 7, 2026Jed A. Duersch, Naïm Es-Sebbani, Nathanaël Haas +1Efficient Transformer InferenceStructured Pruning

    Université d’Artois, CNRS, CRIL UMR 8188, Lens, France

  16. Mind the Approximation: Fisher-Weighted SVD Compression for ViTs

    Sep 7, 2026Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler +7Efficient ViTsLow-Rank Compression

    Technical University of Munich, DE · BMW Group, DE · University of Glasgow, GB +1

  17. Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

    Sep 3, 2026Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7Audio Token CompressionAudio Representation Learning

    Apple

  18. TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Models

    Sep 3, 2026Mehedi Hasan, Ashfak Yeafi, Md Khairul IslamComputational PathologyPathology Foundation Models

    Department of Computer Science and Engineering, Brac University, Dhaka, Bangladesh · EEE, Khulna University of Engineering & Technology, Khulna, Bangladesh · Mathematics and Computer Science, Hobart and William Smith Colleges, Geneva, NY, USA

  19. H3DNAS: Hardware-Aware ONNX-Native 3D Point Cloud Model Compression

    Sep 2, 2026Anchit Mulye, Rhythm Baghel, Sujay Kumar Ingle +1Neural Network CompressionHardware-Aware NAS

    Indian Institute of Technology Jodhpur

  20. Emergence of Fibrations, Compression, and Symmetry Breaking in Artificial Neural Networks

    Sep 1, 2026Osvaldo M Velarde, Lucas C Parra, Alireza Hashemi +1Neural Network InterpretabilityNeural Network Compression

    Levich Institute and Physics Department, City College of New York, 160 Convent Ave, NY, 10031, NY, USA. · Biomedical Engineering Department, City College of New York, 160 Convent Ave, NY, 610101, NY, USA.

  21. Linear Reusable Neural Bases Architecture for Network Compression

    Sep 1, 2026Binshuai Wang, Peng Wei, Mahyar GhazanfariNeural Network Compression

    Department of Computer Science The George Washington University Washington D.C., USA

  22. A Closed-Loop Evaluation of Capability Loss and Recovery in Compressed Driving Policies

    Sep 1, 2026Ahmad Alfan Alfian Irfan, Nur Ahmad Khatim, Mansur AriefAutonomous Driving Safety EvaluationKnowledge Distillation

    Information Technology, Universitas Muhammadiyah Yogyakarta, Indonesia · Division of Information Science, Nara Institute of Science and Technology (NAIST), Japan · Industrial and Systems Engineering (ISE) Department and IRC for Smart Mobility and Logistics (IRC-SML), King Fahd University of Petroleum and Minerals (KFUPM), Saudi Arabia

  23. A hybrid quantum-classical neural network for learning to route

    Aug 31, 2026Marcus Rolf Peter Ritt, Alexsandro Santos da Rosa Júnior, Marcos Vinicius Reballo +2Hybrid Quantum-Classical MLVehicle Routing

    Instituto de Pesquisas Eldorado – Porto Alegre – RS – Brazil · Departamento de Física, Universidade Federal de Santa Catarina, Florianópolis 88040-900, SC, Brazil

  24. Sharp Approximation Rates for Neural Networks with Affine Latent Parameterizations

    Aug 31, 2026Shijun ZhangHypernetworksNeural Network Approximation Theory

    Department of Applied Mathematics Hong Kong Polytechnic University

  25. Functional Degeneracy in Neural Networks: Measurement and Pruning

    Aug 31, 2026Maria Matveev, Pascal Esser, Ayush Bharadwaj +2Structured PruningNeural Network Compression

    Department of Mathematics, LMU Munich · Munich Center for Machine Learning (MCML) · Independent +3

  26. Multivariate Scientific Data Compression with Learned Cross-Variable Latent Decorrelation and Autoregressive Entropy Modeling

    Aug 31, 2026Liangji Zhu, Anand Rangarajan, Sanjay RankaNeural Network CompressionAutoregressive Modeling

    Department of Computer & Information Science & Engineering University of Florida Gainesville, FL, USA

  27. Selection, Representation, and Execution in Sparse Fourier Neural Operators

    Aug 30, 2026Abdul Qadir Ibrahim, Martin BurgerEfficient Neural Network InferenceFourier Neural Operator

    Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, 22607 Hamburg, Germany

  28. Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth

    Aug 17, 2026Zhaocen Liu, Satvik Praveen, Yi ShengNeural Network CompressionNeural Network Pruning

    University of British Columbia Vancouver, British Columbia, CA · University of South Florida Tampa, Florida, USA

  29. HYDRA: Hyperbolic Dynamic Representation Architecture for Kolmogorov-Arnold Networks

    Aug 12, 2026Zhao Su, Yuxin Xia, Haoran Li +4Kolmogorov-Arnold NetworksNeural Network Approximation Theory

    School of Information Science and Engineering, Lanzhou University · Department of Data Science and AI, Monash University · School of Computing and Information Technology, University of Wollongong +1

  30. Lossless Tensor Compression as Program Synthesis

    Aug 3, 2026Jieke Shi, Junda He, Wenjia Jiang +11Model CompressionProgram Synthesis

    James · Singapore Management University, Singapore · CSIRO, Australia +3

  31. Gram-Space: Structure-Preserving Codebook Compression for Memory-Efficient Neuro-Symbolic AI

    Aug 2, 2026Weilun Wang, Wantong LiMemory-Efficient InferenceVector Symbolic Architectures

    University of California, Riverside

  32. Kilobyte Models: Neural Networks as a Seed and a Quantized Latent

    Aug 1, 2026Sahil Rajesh DhayalkarNeural Network Compression

    Arizona State University

  33. Simplifying Neural Networks During Training

    Jul 30, 2026Lorenzo Sciandra, Samuele Fonio, Roberto EspositoNeural Network Training DynamicsNeural Network Compression

    Department of Computer Science, University of Turin, Turin, Italy

  34. SPRKD: Effective Knowledge Distillation for Deep Neural Networks via Saddle Region Approximation

    Jul 25, 2026Aditya Dewan, Arjun Yogeswaran, Benjamin FedorukKnowledge DistillationNeural Network Compression

    Carnegie Mellon University · Ontario Tech University

  35. Neural Network-Driven Volatility Drag Mitigation under Aggressive Leverage

    Jul 25, 2026Christian Bongiorno, Efstratios Manolakis, Rosario Nunzio MantegnaPortfolio OptimizationNeural Network Compression

    Université Paris-Saclay, CentraleSupélec, Mathématiques et Informatique pour la Complexité et les Systèmes, 91190, Gif-sur-Yvette, France · Dipartimento di Fisica e Astronomia “Ettore Majorana” Catania, Italy · Dipartimento di Fisica e Chimica Palermo, Italy +1

  36. Hilbert Operator for Progressive Encoding (HOPE): A Mathematical Framework for Deconstructing Learned Representations in Deep Networks

    Jul 23, 2026Hossein Mobahi, Peter L. BartlettNeural Network CompressionNeural Network Pruning

    Google DeepMind · University of California, Berkeley

  37. Neural Feature Governance: Extending Atom Prevalence

    Jul 23, 2026Idris Karel Seunda Ekwe, Patrick Tenga Shako, Ernest Parfait FokouéBayesian Neural NetworksUncertainty Quantification

    African Institute for Mathematical Sciences (AIMS), Cameroon · Rochester Institute of Technology (RIT), US

  38. Importance-Aware OBS Pruning for Diffusion Models

    Jul 22, 2026Ba-Thinh Lam, Srijan Das, Hieu LeNeural Network CompressionNeural Network Pruning

    Department of Computer Science UNC Charlotte NC, USA

  39. ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualization

    Jul 20, 2026Kaiyuan Tang, Chaoli Wang3DGS CompressionScientific Visualization

    Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN 46556, USA

  40. Efficient Audio-Visual Event Recognition via Knowledge Distillation and Dynamic INT8 Quantization of a Hybrid Cross-Attention Network

    Jul 18, 2026Parinaz Binandeh Dehaghani, Danilo Pena, A. Pedro AguiarAudio-Visual UnderstandingNeural Network Compression

    University of Porto, Porto, Portugal · ResoSight, Montreal, Canada

  41. GB-SVFBP: Gaussian-Based Shift-Variant FBP neural network

    Jul 13, 2026Chengze Ye, Linda-Sophie Schneider, Yipeng Sun +1Cone-Beam CTImage Reconstruction

    Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany

  42. CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA

    Jul 11, 2026Gengyu Zhang, Haiyin Ran, Zhengbao He +4Fine-TuningMemory-Efficient Fine-Tuning

    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, China

  43. EvoLP: Self-Evolving Latency Predictor for Model Compression in Real-Time Edge Systems

    Jul 10, 2026Shuo Huai, Hao Kong, Shiqing Li +5Efficient Neural Network InferenceEdge Computing

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · HP Inc., Palo Alto, California, USA

  44. SLORR: Simple and Efficient In-Training Low-Rank Regularization

    Jul 9, 2026David González-Martínez, Shiwei LiuLLM CompressionLow-Rank Matrix Decomposition

    Max Planck Institute for Intelligent Systems · University of Tübingen · ELLIS Institute Tübingen +1

  45. It Takes Few to TANGO: A Quantized Distributed Model for Binaural Speech Enhancement

    Jul 9, 2026Zahra Benslimane, Pierre Chouteau, Martyna Poreba +4Quantization-Aware TrainingSpeech Enhancement

    Université Paris-Saclay, CEA, List, F-91120 Palaiseau, France · Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France

  46. EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

    Jul 8, 2026Hao Kong, Di Liu, Shuo Huai +5Edge InferenceConvolutional Neural Networks

    School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University (NTU), Singapore · Department of Computer Science, Norwegian University of Science and Technology (NTNU), Trondheim, Norway +1

  47. Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware

    Jul 8, 2026Hao Kong, Di Liu, Shuo Huai +5Efficient Neural Network InferenceEdge Inference

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · HP Inc., Palo Alto, California, USA

  48. Enhancing deep learning models for time series classification via knowledge distillation

    Jul 7, 2026Javidan Abdullayev, Maxime Devanne, Jonathan Weber +1Time Series ClassificationKnowledge Distillation

    IRIMAS, University of Haute Alsace, Frères Lumière, Mulhouse 68200, France · Faculty of IT, Monash University, Wellington Road, Melbourne 3800, Australia

  49. Empirical Minimal-Realisation Compression of Deep Neural Networks via Controllability-Observability Tests

    Jul 5, 2026Anis Hamadouche, Amir HussainReduced-Order ModelingNeural Network Compression

    The School of Engineering & Physical Sciences Heriot-Watt University Edinburgh EH14 4AS, UK · SDAIA-KFUPM Joint Research Centre for Artificial Intelligence King Fahd University of Petroleum and Minerals Dhahran, Saudi Arabia

  50. Expander Sparse Autoencoders: Parameter-Efficient Dictionaries for Mechanistic Interpretability

    Jul 2, 2026Rodrigo Mendoza-SmithSparse RecoveryActivation Sparsity

    Independent Researcher.

  51. Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers

    Jul 1, 2026Jaeah Lee, Hyunjin Kim, Jaewoong Cho +1Model CompressionDiffusion Transformer

    KRAFTON AI, Republic of Korea · Amazon, Australia

  52. HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks

    Jun 29, 2026Lukas Meiner, Jens Mehnert, Alexandru Paul ConduracheEfficient Neural Network InferenceConvolutional Neural Networks

    Robert Bosch GmbH, Leonberg, Germany. · Universität zu Lübeck, Lübeck, Germany.

  53. DTM-Codec: Dynamic Token Masking for VFR Speech Coding with Efficient Boundary Selection

    Jun 28, 2026Hoyeol Sohn, Juhan NamNeural Audio CodecsNeural Network Compression

    Graduate School of Cultural Technology, KAIST, South Korea

  54. Elastic Time: Dynamic Frame Rate Bottlenecks for Neural Audio Coding

    Jun 25, 2026Dimitrios Bralios, Paris Smaragdis, Minje KimNeural Audio CodecsAutoencoders

    University of Illinois Urbana-Champaign, Urbana, IL, USA · Massachusetts Institute of Technology, Cambridge, MA, USA

  55. Neural Texture Compression using Hypernetworks

    Jun 25, 2026Belcour LaurentLearned Image CompressionHypernetworks

    Intel Corporation

  56. Hierarchical Reinforcement Learning for Neural Network Compression (HiReLC): Pruning and Quantization

    Jun 24, 2026Kamar Hibatallah Baghdadi, Kawther Guoual Belhamidi, Sara Belhadj +2Hierarchical RLNeural Network Quantization

    aNational School of Artificial Intelligence (ENSIA), Sidi Abdellah Campus, Algiers, Algeria · bCosys-Grettia, Univ Gustave Eiffel, F-77454 Marne-la-Vallee, France. · aNational School of Artificial Intelligence (ENSIA), Sidi Abdellah

  57. Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks

    Jun 22, 2026Minh-Loi Nguyen, Long-Bao Nguyen, Van-Hieu Huynh +2Model CompressionEfficient Neural Network Inference

    University of Science, Ho Chi Minh city, Vietnam · Vietnam National University, Ho Chi Minh city, Vietnam

  58. Activation- and Influence-Aware Ranks (AIR): Function-Preserving SVD Compression for LLMs

    Jun 18, 2026Nico Harder, Daniel Becking, Karsten Mueller +1LLM CompressionLow-Rank Matrix Decomposition

    Fraunhofer HHI, Berlin, Germany

  59. Operator Boosting Produces Pareto-Efficient PDE Surrogates

    Jun 16, 2026Lennon J. ShikhmanPDE Surrogate ModelingDeep Operator Networks

    Georgia Institute of Technology College of Computing Atlanta, Georgia, USA

  60. From Compression to Deployment: Real-Time and Energy-Efficient FastGRNN on Ultra-Constrained Microcontrollers

    Jun 15, 2026Emre Can KizilatesEfficient Neural Network InferenceRecurrent Neural Networks

    Independent Researcher, Izmir, Turkey