Video Token Compression

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 44

All topics

VEDJE: Video-Efficient Discriminative Joint Encoder for Scalable Video-Text Retrieval
Oct 8, 2026Shahaf Wagner, Gabriele Serussi, Dan Ben Ami +2Video Retrieval Vision-Language Retrieval
INSIGHT Lab, Ben-Gurion University of the Negev, Israel · Decart AI · Texas A&M University, College Station
GRACE: Generation-aware latent compression for efficient video generation
Oct 7, 2026Jiyoung Kim, Paul Hyunbin Cho, Jisu Nam +5Diffusion Model Inference Acceleration Video Diffusion Models
KAIST AI · Kakao Corp.
Video Encoders Built on Image Representations
Oct 5, 2026Jusheng Zhang, Wenhao Wang, Longqi Cai +3Video-Language Models Video Representation Learning
Stanford University · Vast Intelligence Lab · Google DeepMind
VETO: Video Efficient Token Optimization for Vision Language Models
Oct 1, 2026Gueter Josmy Faure, Hao Ping Wang, Min-Hung Chen +1Efficient VLM Inference Large Vision-Language Models
National Taiwan University · NVIDIA
SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation
Sep 30, 2026Mikhail Dereviannykh, Vikram Voleti, Simon Donne +3Visual Tokenization Autoregressive Video Generation
Stability AI · Karlsruhe Institut für Technologie
CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding
Sep 30, 2026Yulong Liu, Xiaotian Han, Junyuan Shang +6Video Understanding Efficient VLM Inference
ERNIE Team, Baidu Inc. · The Hong Kong University of Science and Technology · Institute of Automation, Chinese Academy of Sciences (CASIA)
DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency
Sep 30, 2026Zeqi Xiao, Qingle Liu, Kaiwen Zhang +3KV-Cache Management Autoregressive Video Generation
Nanyang Technological University · Tsinghua University · Princeton University
OmniRoute: Mapping Temporal Semantic Evidence to Audio-Visual Token Budgets for Efficient Omnimodal Large Language Models
Sep 29, 2026Yuchen Deng, Zidang Cai, Feidiao Yang +4Efficient Multimodal Inference Audio Token Compression
Shenzhen International Graduate School, Tsinghua University, China · Pengcheng Laboratory, China
GleanVID: Complementary Token Selection for Efficient Video Large Language Models
Sep 29, 2026Shuo Yang, Changbai Li, Rui Tang +3Efficient VLM Inference Video-Language Models
Beihang University · Communication University of China
Compress to Remember: Learning Compact Memory via On-Policy Distillation for Long Video Generation
Sep 28, 2026Xiaoyu Wu, Weihang Guo, Yifei Wang +3Video Diffusion Models Long Video Generation
Carnegie Mellon University · Rice University
Rethinking Visual Token Compression for Video Large Language Models: A Simple Yet Strong Baseline
Sep 28, 2026Xiao Zhang, Wang Zeng, Sheng Jin +3Video Understanding Video-Language Models
School of Computer Science and Engineering, Central South University · SenseTime Research and Tetras.AI
Summarize Before Grounding: Query-Guided Chunk Condensation for Long-Video Temporal Grounding
Sep 28, 2026Nanxing Hu, Xiaoyue Duan, Qiwei Yan +3Temporal Video Grounding Video Token Compression
Beihang University · University of the Chinese Academy of Sciences · Institute of automation, Chinese academy of science
VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation
Sep 14, 2026Xinyi Chen, Hanxin Zhu, Xijun Wang +4Video Diffusion Models Video Token Compression
University of Science and Technology of China
Select, Compress, Reinvest: A Controlled Study of Visual-Token Allocation in Long-Video MLLMs
Sep 3, 2026Prakhar KhatriVideo-Language Model Evaluation Long-Video Understanding
Independent Researcher
KVAE: Family of Tokenizers for Multimodal Generative Models
Aug 6, 2026Andrey Shutkin, Denis Parkhomenko, Ivan Kirillov +11Variational Autoencoders Audio Token Compression
Kandinsky Lab
Allocation Before Ranking: Decoupled Token Compression for OmniLLMs
Aug 3, 2026Zhenghui Guo, Yilin Yang, Yuanbin Man +5Audio Token Compression Unified Multimodal Models
Department of Computer Science, University of Houston · Department of Computer Science and Engineering, The University of Texas at Arlington
CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
Aug 3, 2026Yu Chen, Xiaohong Li, Xiaole Wang +3Efficient VLM Inference Large Vision-Language Models
1Evermind · 2Shanda Group · 3Peking University
Rethinking Video Token Compression with a Global Codebook: Learning Once, Compressing Everywhere
Aug 2, 2026Jiayang He, Tianling Xu, Diancheng Kang +4Efficient VLM Inference Video-Language Models
Southern University of Science and Technology · Imperial College London · Jilin University
Think in Sets for Streaming Video Token Compression
Aug 2, 2026Moxu Duan, Jingwen Fu, Yuwang WangVideo Token Compression Visual Token Pruning
Beijing Jiaotong University · Zhongguancun Academy · Tsinghua University
OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs
Jul 28, 2026Haoyang Huang, Wenjie Huang, Tianqi Xu +14Efficient Multimodal Inference Audio Token Compression
Zhejiang University · Qwen Application, Alibaba · Carnegie Mellon University +2
WaveZip: Wavelet-Driven Space-Time Decoupling for Video Token Condensation
Jul 25, 2026Yuhui Zeng, Wang Chen, Jinfa Huang +5Efficient VLM Inference Video Token Compression
Media Analytics and Computing Lab, Xiamen University, Xiamen, China · Department of Computer Science, University of Rochester, Rochester, NY, USA
Out of Sight, Still in Mind: Token Compression for Omni-LLMs
Jul 23, 2026Suho Yoo, Youngjoon Jang, Hyebin Cho +1Efficient Multimodal Inference Multimodal Large Language Models
KAIST · VGG, University of Oxford
GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models
Jul 10, 2026Guohuan Xie, Mengqi Lei, Chuan Shi +3Efficient VLM Inference Video-Language Models
BNRist, THUIBCS, BLBCI, School of Software, Tsinghua University · Yangtze Delta Region Institute, Tsinghua University · Beijing University of Posts and Telecommunications, Beijing, China
STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation
Jul 3, 2026Syed Ariff Syed Hesham, Yun Liu, Guolei Sun +4Video Reasoning Reasoning Segmentation
School of EEE, Nanyang Technological University, Singapore · Institute for Infocomm Research, A*STAR, Singapore · VCIP, CS, Nankai University, Tianjin, China +4
AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression
Jun 23, 2026Yijing Chen, Wenhui Tan, Xiaoyi Yu +7Audio-Visual Understanding Multimodal Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China · Huawei Inc.
TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization
Jun 16, 2026Weiliang Chen, Yuanhui Huang, Xuebo Wang +1Visual Tokenization Video Token Compression
Department of Electronic Engineering, Tsinghua University, Beijing, 100084, China · Department of Automation, Tsinghua University, Beijing, 100084, China · Kuaishou Technology, Beijing, China
Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting
Jun 4, 2026Kevin Dave, Sai Aditya Patkuri, Chhaya Kumar Das +3Visual Tokenization Video Token Compression
Phronetic AI · IISc Bangalore · IIT Bombay
AdaCodec: A Predictive Visual Code for Video MLLMs
Jun 1, 2026Haowen Hou, Zhen Huang, Zheming Liang +8Predictive Coding Efficient VLM Inference
Shanghai Jiao Tong University · Shanghai Innovation Institute
InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models
Jun 1, 2026Xinxin Liu, Shiwei Gan, Xiao Liu +3Efficient VLM Inference Video-Language Models
State Key Laboratory of Novel Software Technology, Nanjing University Nanjing 210023, China
EarlyTom: Early Token Compression Completes Fast Video Understanding
May 28, 2026Hesong Wang, Xin Jin, Lu Lu +4Video Understanding Efficient VLM Inference
Zhejiang University · Westlake University · Alibaba Cloud Computing

Oct 8, 2026, cs.CVJ/K move · Enter open · S save

VEDJE: Video-Efficient Discriminative Joint Encoder for Scalable Video-Text Retrieval

Shahaf Wagner, Gabriele Serussi, Dan Ben Ami, Tomer Galanti+1

INSIGHT Lab, Ben-Gurion University of the Negev, Israel · Decart AI · Texas A&M University, College Station

Video Retrieval Vision-Language Retrieval Video Token Compression

Open paper AskPDF arXiv

Finding the right video often requires distinguishing similar scenes in which different events occur. Joint matching improves retrieval, but processing rich video representations for each query is costly. VEDJE compresses features within sampled frames while keeping their representations separate in a reusable cache. Feature-change prediction supplies an auxiliary training signal that improves retrieval from the compressed cache without adding work at query time. On MSR-VTT, MSVD, DiDeMo, and ActivityNet, VEDJE improves R@1 over matched first-stage retrievers in both retrieval directions. On MSR-VTT, it reaches 59.8 text-to-video R@1 with a fine-tuned VideoCLIP-XL first stage. In the VideoPrism configuration, shrinking the per-video cache fourfold to 12 KiB preserves text-to-video recall within 0.2 points. These results show that accurate video search can operate on compact evidence, encoded once and reused as new queries arrive.

Momentum

Related topics

Latest papers 44