Token Compression

Ask about this topic

Latest papers

CardsList

26 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

  1. zip2zip++: Towards Inference-Time Token Compression with Minimal Quality Loss

    Oct 9, 2026Saibo Geng, Andrea Gentilini, Xinxian Ma +3Token CompressionLLM Compression

    EPFL · Technical University of Munich · Zuse School ELIZA +1

  2. One Model, Multiple Compute Budgets: Multi-Ratio ConceptMoE for Flexible Compute Across Turns

    Oct 8, 2026Yiyang Fu, Zihao Huang, Dongchen Han +4Token CompressionMixture-of-Experts Models

    Peking University · ByteDance Seed · Tsinghua University +1

  3. Audio Token Attention Is Predictable Before the Language Model Runs

    Sep 30, 2026Kyoungjun Park, Yunzhe Li, Lili QiuAudio Token CompressionAudio Understanding

    The University of Texas at Austin

  4. Aperture: Merge-Consistent Rotary States for Compressed Tokens

    Sep 29, 2026Yuhao Du, Shunian ChenRotary Positional EmbeddingsVisual Token Merging

    The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute

  5. The Price of Token Boundaries: Compression Certificates and Prediction

    Sep 26, 2026Yuhao Du, Shunian ChenToken CompressionToken Efficiency

    The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute

  6. Query Independent Variable Rate Visual Token Coding

    Sep 20, 2026Hongbo Zhang, Zihao Yang, Liuyang Song +4Visual Token CompressionToken Compression

    Peking University · Uppsala University · University of Southern California

  7. FlexComp: One Model for Every Ratio in Context Compression

    Sep 10, 2026Kaiyan Zhao, Zhongtao Miao, Akiko Aizawa +1LLM Inference AccelerationContext Compression

    The University of Tokyo · National Institute of Informatics

  8. Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation

    Aug 28, 2026Zijun Zhang, Li Qiao, Mahdi Boloursaz Mashhadi +3Token CompressionSemantic Communication

    School of Information and Electronics, Beijing Institute of Technology (Zhuhai), Zhuhai 519088, China · Department of Electrical and Computer Engineering, The University of Hong Kong, Pokfulam Road, Hong Kong SAR · University of Surrey, Guildford, U.K. +1

  9. An Empirical Cost Attribution of Context-Compression Gateways in Multi-Turn Coding Agents

    Aug 19, 2026Luzhuo Chen, Jiayu ShiContext CompressionLLM Agent Workflow Optimization

    Paritok

  10. A Pilot Study of Autocompleting Tokenizers

    Aug 15, 2026Samuel Wexler, Mark HopkinsToken CompressionMachine Translation

    Department of Computer Science Williams College Williamstown, MA 01267, USA

  11. Tevatron-Elastic: A Unified Abstraction for Training Elastic Retrievers and Rerankers

    Aug 9, 2026Yu Wang, Shengyao Zhuang, Xueguang Ma +4Model CompressionDynamic Neural Networks

    University of Utah · 2The University of Queensland · University of Waterloo +1

  12. Allocation Before Ranking: Decoupled Token Compression for OmniLLMs

    Aug 3, 2026Zhenghui Guo, Yilin Yang, Yuanbin Man +5Audio Token CompressionUnified Multimodal Models

    Department of Computer Science, University of Houston · Department of Computer Science and Engineering, The University of Texas at Arlington

  13. Think in Sets for Streaming Video Token Compression

    Aug 2, 2026Moxu Duan, Jingwen Fu, Yuwang WangVideo Token CompressionVisual Token Pruning

    Beijing Jiaotong University · Zhongguancun Academy · Tsinghua University

  14. TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference

    Aug 1, 2026Ning Li, Xinyu Wang, Xin Yuan +3Edge InferenceMixture-of-Experts Inference

    School of Artificial Intelligence, University of Science and Technology Beijing, China · School of Computer Science and Technology, Harbin Institute of Technology, Heilongjiang, China · School of Ocean Engineering, Harbin Institute of Technology, Heilongjiang, China +2

  15. Progressive Cramming: Reliable Token Compression and What It Reveals

    Jul 23, 2026Dmitrii Tarasov, Timofei Lashukov, Elizaveta Goncharova +1LLM CompressionEmbedding Compression

    FusionBrain Lab, AXXX, Moscow, Russia · HSE University, Moscow, Russia · Artificial Intelligence Institute, Innopolis University, Innopolis, Russia

  16. MinGram: A Minimalist Unigram Tokenizer with High Compression and Competitive Morphological Alignment

    Jun 25, 2026Sander LandToken EfficiencySubword Tokenization

    Writer, Inc.

  17. Entropy Gate: Entropy Quenching for Near-Lossless Token Compression in LLM Pipelines

    Jun 2, 2026Justice Owusu Agyemang, Jerry John Kponyo, Kwame Opuni-Boachie Obour Agyekum +3LLM CompressionToken Pruning

    1VIA Cybersecurity Lab, Kwame Nkrumah University of Science and Technology, Kumasi, Ghana · 2Quantum and Assistive Technologies Lab, Kwame Nkrumah University of Science and Technology, Kumasi, Ghana

  18. BrahmicTokenizer-131K: An Indic-Capable Drop-In Replacement for o200k_base

    May 28, 2026Rohan ShravanToken EfficiencySubword Tokenization

    The School of AI India

  19. Telegraph English: Semantic Prompt Compression via Structured Symbolic Rewriting

    May 6, 2026Mikhail L. Arbuzov, Sisong Bei, Ziwei Dong +2LLM CompressionPrompt Compression

    Independent Researcher · Palo Alto Networks

  20. Compute Optimal Tokenization

    May 2, 2026Tomasz Limisiewicz, Artidoro Pagnoni, Srini Iyer +6Language Model Scaling LawsEfficient Language Model Training

    1FAIR at Meta · University of Washington

  21. Sub-Token Routing for KV Cache Compression

    Apr 23, 2026Wei Jiang, Wei WangLLM Inference EfficiencyKV Caching

    Futurewei Technologies San Jose, CA 95131, USA

  22. UIPress: Bringing Optical Token Compression to UI-to-Code Generation

    Apr 10, 2026Dasen Dai, Shuoqi Li, Ronghao Chen +3Token CompressionVisual Token Compression

    The Chinese University of Hong Kong China · Peking University China · University of Chinese Academy of Sciences China +2

  23. Collapse-Free Prototype Readout Layer for Transformer Encoders

    Apr 4, 2026Giansalvo Cirrincione, Rahul Ranjeev KumarToken CompressionPrototype Learning

    Laboratory LTI, Université de Picardie Jules Verne, Amiens, France · Institute of Energy and Resources, Charles Darwin University, Darwin, NT, Australia

  24. BiGain: Unified Token Compression for Joint Generation and Classification

    Mar 12, 2026Jiacheng Liu, Shengkun Tang, Jiacheng Cui +2Token CompressionDiffusion Model Compression

    VILA Lab, MBZUAI · North Carolina State University

  25. Prompt Compression in Production Task Orchestration: A Pre-Registered Randomized Trial

    Mar 6, 2026Warren Johnson, Charles LeePrompt CompressionToken Compression

    Plexor Labs, Issaquah, WA, USA · Project Autobots, Seattle, WA, USA

  26. No Need For Real Anomaly: MLLM Empowered Zero-Shot Video Anomaly Detection

    Feb 22, 2026Zunkai Dai, Ke Li, Jiajia Liu +2Token CompressionVideo Anomaly Detection

    Beijing University of Posts and Telecommunications · Northwestern Polytechnical University