Activation Compression

Ask about this topic

Latest papers

CardsList

11 papers1 paper in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. BitSparse: Compact Activation Storage for ReLU Feed-Forward Networks

    Oct 15, 2026Max Zhu, Bohang Sun, Pietro Lio +1Activation CompressionMemory Compression

    University of Cambridge · University of Oxford

  2. HiLoRe: What to Store, Compress, or Recompute for Efficient GRPO Training

    Sep 27, 2026Xinrui Chen, Mengyang Li, Ou Wu +1Group Relative Policy OptimizationActivation Compression

    Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, China · Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin, China · University of Southern Queensland

  3. Communication-Efficient LLM Adaptation over Decentralized GPU Meshes

    Sep 13, 2026Sameera Ramasinghe, Shamane Siriwardhana, Thalaiyasingam Ajanthan +8Activation CompressionCommunication-Efficient Distributed Training

    Pluralis Research

  4. Contribution-Aware Bandwidth Allocation for Multimodal Split Learning

    Sep 1, 2026Iason Ofeidis, Leandros TassiulasActivation CompressionDistributed Training

    Department of Electrical and Computer Engineering, Yale University, New Haven, CT, USA

  5. CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA

    Jul 11, 2026Gengyu Zhang, Haiyin Ran, Zhengbao He +4Fine-TuningMemory-Efficient Fine-Tuning

    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, China

  6. Prompt Compression via Activation Aggregation

    Jul 9, 2026Thibaud Ardoin, Semira Einsele, Evis Bregu +1LLM Inference AccelerationRepresentation Geometry in Language Models

    Freie Universität Berlin

  7. Learned Subspace Compression for Communication-Efficient Pipeline Parallelism

    Jun 3, 2026Paul Janson, Edouard Oyallon, Eugene BelilovskyLLM CompressionCommunication-Efficient Distributed Training

    Concordia University · Mila Quebec AI Institute · CNRS, Sorbonne University

  8. Activation Compression in LLMs: Theoretical Analysis and Efficient Algorithm

    May 2, 2026Wen-Da Wei, Han-Bin Fang, Yang-Di Liu +3LLM CompressionGradient Compression

    Nanjing University, Nanjing, China · Tsinghua University, Beijing, China · Huazhong University of Science and Technology, Wuhan, China +1

  9. ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism

    Apr 13, 2026Alan Aboudib, Rodrigo Lopez Portillo A., Kalei Brady +1Activation CompressionCommunication-Efficient Distributed Training

    Macrocosmos AI

  10. SL-FAC: A Communication-Efficient Split Learning Framework with Frequency-Aware Compression

    Apr 8, 2026Zehang Lin, Miao Yang, Haihan Zhu +9Activation CompressionCommunication-Efficient Distributed Training

    School of Computer and Information Engineering, Xiamen University of Technology, Xiamen, 361000, China · School of Artificial Intelligence, Hebei University of Technology · Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong +5

  11. Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism

    Jun 2, 2025Sameera Ramasinghe, Thalaiyasingam Ajanthan, Gil Avraham +2Communication-Efficient Distributed TrainingDecentralized Learning

    Pluralis Research