Overview

Embedding compression aims to make vector representations cheaper to store, transmit, and use without losing the information needed for downstream tasks. Methods include dimensionality reduction such as PCA, scalar and product quantization, binary hashing, pruning or pooling multi-vector representations, and learned codebooks or autoencoders. In retrieval, systems are often evaluated on benchmarks such as BEIR and MTEB using ranking quality alongside index size and latency; recommendation and on-device applications also measure parameter and compute costs. Very compact representations can work well, but the best method and acceptable tradeoff depend on the task, embedding geometry, and whether compression preserves reconstruction, similarity, or ranking quality.

Latest papers

CardsList

55 papers8 papers in the last four weeks, up 14% on the four weeks before. 0.1% of all new papers.

  1. Practical Semantic Communication for General-Purpose Networks: Compression of High-Dimensional Embeddings Under Quantization

    Nov 16, 2026Leonardo Roque, Louis-Adrien Dufrène, Quentin Lampin +2Semantic CommunicationEmbedding Compression

  2. What Does Each Part of Speech Need? Contexts, Subspaces and Dimensions in Static Word Embeddings

    Nov 11, 2026Jintang Xue, Chengwei Wei, Yun-Cheng Wang +1Word EmbeddingsEmbedding Compression

  3. Enhancing Local and Global Structure in Compressed AI Agent Memory

    Nov 5, 2026Henry HanMemory CompressionEmbedding Compression

  4. Invariance before structure: two modes of emergent compression in representation learning

    Nov 5, 2026Hardik Rajpal, Dan GoodmanInvariant Representation LearningTemporal Representation Learning

  5. Balancing hierarchical representation and quantization: A performance trade-off in text embeddings

    Nov 4, 2026Kai Ponel, Marco Polignano, Erasmo Purificato +4Embedding CompressionText Embedding Evaluation

  6. Relevance-Guided Residual Calibration for Spectral Compression of Dense Retrieval Embeddings

    Oct 26, 2026Yongkang Li, Panagiotis Eustratiadis, Evangelos KanoulasEmbedding CompressionDense Retrieval

  7. Extreme Compression of Per-Layer Embeddings via Cross-Layer Latent Vector Quantization

    Oct 22, 2026Jiacheng Liu, Yaxin Luo, Xiaohan Zhao +5Embedding CompressionLLM Compression

  8. A KAN-based Non-linear Factorization for Embedding Layer Compression

    Oct 21, 2026Oliver Giudice, Anna Russo RussoEmbedding CompressionLow-Rank Compression

  9. SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum

    Oct 19, 2026Zhongxin Chen, Songhao Wu, Heng Cui +3Representation LearningMatryoshka Representation Learning

  10. Geometric Structure Predicts Per-Example Neighborhood Loss Under PCA Truncation

    Oct 13, 2026Sriram Loganathan, Gokul Anand, Ragavan ArivazhaganText Embedding EvaluationEmbedding Compression

  11. Simple Linear Corrections for Compression in Late Interaction

    Oct 9, 2026Mihir Agarwal, Sabyasachi Basu, Viraj AgrawalLate Interaction RetrievalMulti-Vector Retrieval

  12. Lossy Compressive Text Autoencoders

    Oct 7, 2026Vinko Sabolčec, Angelos Katharopoulos, David GrangierAutoencodersRepresentation Learning

  13. OrBIT: Structure-Guided Embedding Compression

    Oct 7, 2026Yunied Puig, Amit Kumar JaiswalEmbedding CompressionLLM Compression

  14. MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search

    Oct 2, 2026Sean Culatana, Shang-En Huang, Kang LiEmbedding CompressionDense Retrieval

  15. Planetary Feature Fields are Scalable Earth Representations

    Sep 29, 2026Arjun Rao, Sebastian Loeschcke, Anthony Fuller +3Implicit Neural RepresentationsGeospatial Representation Learning

  16. MAGIC: Marginal-Guided Compression with Optimal Transport for Efficient Visual Document Retrieval

    Sep 17, 2026Xu Yuan, Hua Liu, Wenqi Fan +1Visual Document RetrievalEmbedding Compression

  17. Exact semantic readout from compressed vector representations

    Sep 16, 2026Daniel QuigleyLinear ProbingEmbedding Compression

  18. Hybrid Quantum-Classical NLP Classification with Compact Semantic Representations: An Experimental Analysis of Representation Compression

    Sep 9, 2026Ali Hassan, Zijia Zhao, Maha A. MetaweiHybrid Quantum-Classical MLText Classification

  19. FastE: Readout-Triggered Token Compression for LLM Embedding Inference

    Sep 8, 2026Jinsong Shu, Jinyong Wen, Baokun Wang +4Token PruningLLM Inference Acceleration

  20. Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddings

    Sep 3, 2026Peichun Hua, Yunming XiaoSecure Multi-Party ComputationEmbedding Compression

  21. RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search

    Aug 31, 2026Rastislav Lenhardt, Teodora Dobos, Thomas Vecchiato +2Rotation-Based QuantizationVector Quantization

  22. Scalable partial information decomposition for symptom networks via supervised embeddings

    Aug 14, 2026Cillian Hourican, Eric Dignum, Rick Quax +1Embedding CompressionMental Health

  23. Progressive Cramming: Reliable Token Compression and What It Reveals

    Jul 23, 2026Dmitrii Tarasov, Timofei Lashukov, Elizaveta Goncharova +1LLM CompressionEmbedding Compression

  24. TurboVec: A Case Study in Cost-Efficient Private Retrieval for Enterprise RAG via Codebook-Oblivious Quantization

    Jul 18, 2026Navnit Shukla, Kamal Pandey, Omsankar TiwariRetrieval-Augmented GenerationVector Quantization

  25. BitNet Text Embeddings

    Jun 24, 2026Zhen Li, Xin Huang, Liang Wang +8LLM QuantizationEmbedding Compression

  26. Geometric and Information Compression of Representations in Deep Learning

    Jun 19, 2026Linara Adilova, Henning Petzka, Asja Fischer +1Neural Representation GeometryEmbedding Compression

  27. Fast-TurboQuant: A Multiplier-Free Online Vector Quantization Approach

    Jun 19, 2026Pedro M. R. Pereira, Felipe A. P. de Figueiredo, Rausley A. A. de SouzaLLM QuantizationRotation-Based Quantization