Efficient Long-Context Inference

Ask about this topic

Recent momentum

-41%

19 papers in the last 28 days · 0.5% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

10 new papers

A weekly snapshot of new work published in Efficient Long-Context Inference.

Period ending 2026-09-07

8 new papers

A weekly snapshot of new work published in Efficient Long-Context Inference.

251 papers

Latest in Efficient Long-Context Inference

Open your feed →
CardsList

  1. QLAM: A Quantum Long-Attention Memory Approach to Long-Sequence Token Modeling

    May 13, 2026Hoang-Quan Nguyen, Sankalp Pandey, Khoa LuuQuantum Neural NetworksEfficient Long-Context Inference

  2. Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context

    May 13, 2026Zhaowei Wang, Lishu Luo, Haodong Duan +9Efficient Long-Context InferenceRecent Vision-Language Models

  3. KV-Fold: One-Step KV-Cache Recurrence for Long-Context Inference

    May 12, 2026Alireza Nadali, Patrick Cooper, Ashutosh Trivedi +1Efficient Long-Context InferenceKv-Cache Steering

  4. δ-mem: Efficient Online Memory for Large Language Models

    May 12, 2026Jingdi Lei, Di Zhang, Junxian Li +7Efficient Long-Context InferenceMemoryagentbench

  5. Training-Inference Consistent Segmented Execution for Long-Context LLMs

    May 12, 2026Xianpeng Shang, Jiang Li, Zehua Duo +2Efficient Long-Context InferenceLLM Inference Efficiency

  6. Variational Linear Attention: Stable Associative Memory for Long-Context Transformers

    May 11, 2026Vishal Pandey, Gopal SinghSoftmax AttentionAssociative Memory

  7. Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing

    May 11, 2026Jinchang Zhu, Jindong Li, Chengyu Zou +4Efficient Long-Context InferenceLarge Language Model Adaptation

  8. Mela: Test-Time Memory Consolidation based on Transformation Hypothesis

    May 11, 2026Lungchuan ChenMemory-Augmented Large Language ModelsEfficient Long-Context Inference

  9. Remember to Forget: Gated Adaptive Positional Encoding

    May 11, 2026Riccardo Ali, Alessio Borgi, Christopher Irwin +2Rotary Position EmbeddingPositional Encoding

  10. FocuSFT: Bilevel Optimization for Dilution-Aware Long-Context Fine-Tuning

    May 11, 2026Zehua Pei, Hui-Ling Zhen, Xianzhi Yu +3Efficient Long-Context InferenceRetrieval Benchmarks

  11. Key-Value Means: Transformers with Expandable Block-Recurrent Compressed Memory

    May 11, 2026Daniel Goldstein, Eugene CheahDynamic Sparse AttentionEfficient Long-Context Inference

  12. Nectar: Neural Estimation of Cached-Token Attention via Regression

    May 10, 2026João Monteiro, Michal Klein, Pierre Ablin +1Softmax AttentionEfficient Long-Context Inference

  13. Make Each Token Count: Towards Improving Long-Context Performance with KV Cache Eviction

    May 10, 2026Ngoc Bui, Hieu Trung Nguyen, Arman Cohan +1Key-Value Cache EvictionKey-Value Cache

  14. Positional LSH: Binary Block Matrix Approximation for Attention with Linear Biases

    May 10, 2026Daniel Wolfson, Tal WagnerPositional EncodingEfficient Long-Context Inference

  15. Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven

    May 10, 2026Jiwei Tang, Zhijing Huang, Xinyu Zhang +5Large Language Model CompressionEfficient Long-Context Inference

  16. UxSID: Semantic-Aware User Interests Modeling for Ultra-Long Sequence

    May 9, 2026Hongwei Zhang, Qiqiang Zhong, Jiangxia Cao +8User ModelingSequence Modeling

  17. ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference

    May 9, 2026Junjie Li, Jiong Lou, Jie LiLLM Inference EfficiencyEfficient Long-Context Inference

  18. ReST-KV: Robust KV Cache Eviction with Layer-wise Output Reconstruction and Spatial-Temporal Smoothing

    May 9, 2026Yongqi An, Chang Lu, Kuan Zhu +5Key-Value Cache EvictionEfficient Long-Context Inference

  19. Scaling Limits of Long-Context Transformers

    May 8, 2026Giuseppe Bruno, Shi Chen, Zhengjiang Lin +2Softmax AttentionEfficient Long-Context Inference

  20. An Efficient Hybrid Sparse Attention with CPU-GPU Parallelism for Long-Context Inference

    May 8, 2026Feiyu Yao, Zhixiong Niu, Xiaqing Li +3Dynamic Sparse AttentionEfficient Long-Context Inference

  21. MISA: Mixture of Indexer Sparse Attention for Long-Context LLM Inference

    May 8, 2026Ruijie Zhou, Fanxu Meng, Yufei Xu +4Dynamic Sparse AttentionDeepseek-R1

  22. Reformulating KV Cache Eviction Problem for Long-Context LLM Inference

    May 8, 2026Tho Mai, Joo-Young KimKey-Value Cache EvictionKey-Value Cache

  23. Self-Consolidating Language Models: Continual Knowledge Incorporation from Context

    May 8, 2026Zekun Wang, Anant Gupta, Zihan Dong +1Efficient Long-Context InferenceConsolidation

  24. Adaptive Memory Decay for Log-Linear Attention

    May 7, 2026Yaxita Amin, Helen Zichen Li, Mengfan Zhang +1Recurrent ModelEfficient Long-Context Inference

  25. MiA-Signature: Approximating Global Activation for Long-Context Understanding

    May 7, 2026Yuqing Li, Jiangnan Li, Mo Yu +3Model ActivationsSignatures

  26. Shallow Prefill, Deep Decoding: Efficient Long-Context Inference via Layer-Asymmetric KV Visibility

    May 7, 2026Jungsuk Oh, Hyeseo Jeon, Hyunjune Ji +2Efficient Long-Context InferenceLLM Inference Efficiency

  27. Training Transformers for KV Cache Compressibility

    May 7, 2026Yoav Gelberg, Yam Eitan, Michael Bronstein +2Key-Value Cache CompressionLarge Language Model Compression

  28. The Impossibility Triangle of Long-Context Modeling

    May 6, 2026Yan ZhouEfficient Long-Context InferenceSequence Modeling

  29. Retrieval Mechanisms Surpass Long-Context Scaling in Time Series Forecasting

    May 6, 2026Rishi Ahuja, Kumar Prateek, Simranjit Singh +1Time Series Foundation ModelsRetrieval-Augmented Forecasting

  30. Beyond Item IDs: Scaling Short-Form-Video Recommendation via Semantic-Native Long Sequence Modeling

    May 4, 2026Ruixiao Sun, Diego Uribe Mora, Zhimeng Jiang +7Long Video UnderstandingDynamic Sparse Attention

  31. On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility

    May 2, 2026Zhitao He, Haolin Yang, Rui Min +2Long-Form GenerationEfficient Long-Context Inference

  32. Context Recycling for Long-Horizon LLM Inference

    May 1, 2026Derek ThomasEfficient Long-Context InferenceDialogue Benchmarks

  33. AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism

    Apr 29, 2026Ahan Gupta, Zhihao Wang, Neel Dani +3Efficient Long-Context InferenceLarge Language Model Training

  34. Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving

    Apr 29, 2026Zihan Zhao, Baotong Lu, Shengjie Lin +8Dynamic Sparse AttentionGraphics Processing Unit Memory

  35. Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling

    Apr 27, 2026Parsa Ashrafi Fashi, Utkarsh Saxena, Mehdi Rezagholizadeh +7Efficient Long-Context InferenceScaling

  36. Salca: A Sparsity-Aware Hardware Accelerator for Efficient Long-Context Attention Decoding

    Apr 27, 2026Wang Fan, Wei Cao, Xi Zha +5Efficient Long-Context InferenceDynamic Sparse Attention

  37. Kwai Summary Attention Technical Report

    Apr 27, 2026Chenglong Chu, Guorui Zhou, Guowang Zhang +35Efficient Long-Context InferenceKey-Value Cache

  38. Versioned Late Materialization for Ultra-Long Sequence Training in Recommendation Systems at Scale

    Apr 27, 2026Liang Guo, Ge Song, Litao Deng +9Recommender SystemsSequence Modeling

  39. DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence

    Apr 26, 2026DeepSeek-AI, Anyi Xu, Bangcai Lin +316Efficient Long-Context InferenceDeepseek-R1

  40. From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priors

    Apr 25, 2026Yitian Zhou, Chaoning Zhang, Jiaquan Zhang +6Large Language Model CompressionEfficient Long-Context Inference

  41. SpikingBrain2.0: Brain-Inspired Foundation Models for Efficient Long-Context and Cross-Platform Inference

    Apr 24, 2026Yuqi Pan, Jinghao Zhuang, Yupeng Feng +16Dynamic Sparse AttentionEfficient Long-Context Inference

  42. Simplified Sparse Attention via Gist Tokens

    Apr 22, 2026Yuzhen Mao, Michael Y. Li, Emily B. FoxDynamic Sparse AttentionEfficient Long-Context Inference

  43. Absorber LLM: Harnessing Causal Synchronization for Test-Time Training

    Apr 22, 2026Zhixin Zhang, Shabo Zhang, Chengcan Wu +2Efficient Long-Context InferenceLarge Language

  44. 'The Order in the Horse's Heart': A Case Study in LLM-Assisted Stylometry for the Discovery of Biblical Allusion in Modern Literary Fiction

    Apr 21, 2026Ewan CameronStylometricPoetry

  45. FG^2-GDN: Enhancing Long-Context Gated Delta Networks with Doubly Fine-Grained Control

    Apr 21, 2026Pingwei Sun, Yuxuan Hu, Jianchao Tan +6Model AttentionEfficient Long-Context Inference

  46. Sessa: Selective State Space Attention

    Apr 20, 2026Liubomyr HorbatkoEfficient Long-Context InferenceSequence Modeling

  47. Stability Implies Redundancy: Delta Attention Selective Halting for Efficient Long-Context Prefilling

    Apr 20, 2026Yujie Chen, Tailai Chen, Yifeng Gao +4PrefillEfficient Long-Context Inference

  48. OPSDL: On-Policy Self-Distillation for Long-Context Language Models

    Apr 19, 2026Xinsen Zhang, Zhenkai Ding, Tianjun Pan +4Efficient Long-Context InferenceToken-Level Supervision

  49. Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluation

    Apr 19, 2026Zhijiang Tang, Jiaxin Qi, Bing Zhao +1Long-Video BenchmarksLarge-Scale Video Generation Models

  50. SinkRouter: Sink-Aware Routing for Efficient Long-Context Decoding in Large Language and Multimodal Models

    Apr 18, 2026Junnan Liu, Xinyan Liu, Peifeng Gao +4Efficient Long-Context InferenceLarge Language Model Decoding

  51. AdaSplash-2: Faster Differentiable Sparse Attention

    Apr 16, 2026Nuno Gonçalves, Hugo Pitorro, Vlad Niculae +4Dynamic Sparse AttentionEfficient Long-Context Inference

  52. LongAct: Harnessing Intrinsic Activation Patterns for Long-Context Reinforcement Learning

    Apr 16, 2026Bowen Ping, Zijun Chen, Tingfeng Hui +4Efficient Long-Context InferenceContext Length

  53. KV Cache Offloading for Context-Intensive Tasks

    Apr 9, 2026Andrey Bocharnikov, Ivan Ermakov, Denis Kuznedelev +2Efficient Long-Context InferenceKey-Value Cache

  54. HISA: Efficient Hierarchical Indexing for Fine-Grained Sparse Attention

    Mar 30, 2026Yufei Xu, Fanxu Meng, Fan Jiang +11Dynamic Sparse AttentionIndex

  55. Learning When to Attend: Conditional Memory Access for Long-Context LLMs

    Mar 18, 2026Sakshi Choudhary, Aditya Chattopadhyay, Luca Zancato +4Efficient Long-Context InferenceNeural Tokens

  56. Recursive Models for Long-Horizon Reasoning

    Mar 2, 2026Chenxiao Yang, Nathan Srebro, Zhiyuan LiRecursionLLM Reasoning Methods

  57. HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders

    Feb 24, 2026Kun Yuan, Junyu Bi, Daixuan Cheng +5Recommender SystemsSequence Modeling

  58. How to Train Your Long-Context Visual Document Model

    Feb 16, 2026Austin VeselkaEfficient Long-Context InferenceRecent Vision-Language Models

  59. FlashBlock: Attention Caching for Efficient Long-Context Block Diffusion

    Feb 5, 2026Zhuokun Chen, Jianfei Cai, Bohan ZhuangDynamic Sparse AttentionDiffusion Language Models

  60. AMA: Adaptive Memory via Multi-Agent Collaboration

    Jan 28, 2026Weiquan Huang, Zixuan Wang, Hehai Lin +6Agent MemoryEfficient Long-Context Inference