Efficient Long-Context Inference

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

6 new papers

A weekly snapshot of new work published in Efficient Long-Context Inference.

Inside this field

Focused directions

312 papers

Latest in Efficient Long-Context Inference

Browse all topics →
CardsList

  1. Recall Before You Rank: Similarity-Guided Top-KK Reuse for Efficient Long-Context Attention

    Jul 30, 2026Wenshuai Yao, Wenyong Zhou, Hanyong Shao +5Top-KEfficient Long-Context Inference

  2. SciFigQual-Bench: A Benchmark for Scientific Figure Quality Assessment with Full-Manuscript Context

    Jul 29, 2026Zihan Deng, Chuanzhi Xu, Huiqi Liang +3Image Quality AssessmentScientific Discovery

  3. ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models

    Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangLarge Language Model MemoryCatastrophic Forgetting

  4. Mergeable Model-Side Aggregation States for Long-Context Language Models

    Jul 29, 2026Dachuan Song, Junyu Yin, Zechen Hu +1Efficient Long-Context InferenceCardinality

  5. CoSA: Accelerating Long-Context Inference via Proxy-Kernel Co-Designed Sparse Attention

    Jul 28, 2026Yufei Xue, Lin Niu, Hong Liu +6Dynamic Sparse AttentionEfficient Long-Context Inference

  6. LOCKS: Page-Local Compact Key Summaries for Efficient Long-Context Decoding

    Jul 27, 2026Junsung HwangEfficient Long-Context InferenceKey-Value

  7. Parameter-free Adaptive Sparse Attention via Compression-Based Content Selection

    Jul 23, 2026Debarshi Kundu, Swaroop Ghosh, Vasant HonavarDynamic Sparse AttentionEfficient Long-Context Inference

  8. REFACT: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning

    Jul 23, 2026Zhensheng Jin, Xin Dai, Zhenghao Liu +5Large Language Model ReasoningContextual Grounding

  9. ELSAA: Efficient Low-Rank and Sparse Attention Approximation for Training Transformers

    Jul 22, 2026Mahdi Heidari, Mohammad Mahdi Rahimi, Jaekyun MoonEfficient Long-Context InferenceLow-Dimensional Structure

  10. Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning

    Jul 21, 2026Lizhe Fang, Weizhou Shen, Tianyi Tang +1Efficient Long-Context InferenceLarge Language Model Reasoning

  11. DocAtlas: Long-Document Understanding as Mutable-State Interaction

    Jul 21, 2026Hongchen Wei, Yuanzhe Wang, Bei Liu +8Multimodal DocumentsLongbench

  12. XL-DocBench: Benchmarking Evidence-Grounded Extra-Long Document Understanding

    Jul 21, 2026Hongchen Wei, Yuanzhe Wang, Bei Liu +9LongbenchSpreadsheets

  13. C2^2KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference

    Jul 20, 2026Chuheng Du, Junyi Chen, Hanlin Tang +7Key-Value CacheEfficient Long-Context Inference

  14. SALT: Salience-Aware Lexical Trie for Long-Context Compression

    Jul 20, 2026Oteo Mamo, Hyunjin Yi, Joydhriti Choudhury +2Efficient Long-Context InferenceLarge Language Model Memory

  15. Long-Context Fine-Tuning with Limited VRAM

    Jul 16, 2026Vladimir Fedosov, Aleksandr Sazhin, Artemiy Grinenko +1Efficient Long-Context InferenceParameter-Efficient Fine-Tuning

  16. LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget

    Jul 16, 2026Changhai Zhou, Kieran Liu, Yuhua Zhou +17Efficient Long-Context InferenceLLM Inference Efficiency

  17. PReM: Learning What to Preserve and When to Refresh for Context Compression

    Jul 15, 2026Bohan Yu, Lei Shen, Chenxi Zhou +5Efficient Long-Context InferenceMemory-Augmented Large Language Models

  18. OvisOCR2 Technical Report

    Jul 15, 2026Shiyin Lu, Yinglun Li, Yu Xia +10Deepseek-OcrVisual Document Retrieval

  19. Extending LLM Context via Associative Recurrent Memory

    Jul 13, 2026Gleb Kuzmin, Ivan Rodkin, Aydar Bulatov +8Efficient Long-Context InferenceDense Associative Memory

  20. Tool-Adaptive LLM Reranker

    Jul 12, 2026Zichuan Liu, Ruijin HuaRerankingLongbench

  21. Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams

    Jul 11, 2026Siddharth Pal, Viktoria RojkovaEfficient Long-Context InferenceWorking Memory

  22. SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding

    Jul 11, 2026Abhigya Verma, Khyati Mahajan, Amit Kumar Saha +4Visual Document RetrievalLongbench

  23. Self-Guided Test-Time Training for Long-Context LLMs

    Jul 10, 2026Xinyu Zhu, Zhe Xu, Xiaohan Wei +10Efficient Long-Context InferenceLarge Language

  24. COBS: Cumulant Order Block Sparse Attention

    Jul 10, 2026Alexander Tian, Aditya Ghai, Sanjit Neelam +2Dynamic Sparse AttentionLongbench

  25. Understanding Axes of Difficulty For Long Context Tasks Via PredicateLongBench

    Jul 9, 2026Siddhartha Jain, Ameya VelingkerContext LengthLongbench

  26. What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

    Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiCompactionAgent Memory

  27. The Key to Going Linear: Analysis-Driven Transformer Linearization

    Jul 8, 2026Anna Kuzina, Paul N. Whatmough, Babak Ehteshami BejnordiTransformer ArchitecturesCausal Attention

  28. DeLS-Spec: Decoupled Long-Short Contexts for Parallel Speculative Drafting

    Jul 8, 2026Hong-Kai Zheng, Piji LiSpeculative DecodingDrafter

  29. Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity

    Jul 8, 2026Loïc Cabannes, Pierre-Emmanuel Mazaré, Gergely Szilvasy +6Efficient Long-Context InferenceSparsity

  30. Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE

    Jul 8, 2026Haozhan Tang, Zerui Wang, Yuxian Gu +2Efficient Long-Context InferenceZero-Shot Inference

  31. DepthWeave-KV: Token-Adaptive Cross-Layer Residual Factorization for Long-Context KV Cache Compression

    Jul 7, 2026Anna Cordoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionEfficient Long-Context Inference

  32. FreqDepthKV: Frequency-Guided Depth Sharing for Robust KV Cache Compression in Long-Context LLM Inference

    Jul 7, 2026Anna Córdoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionLLM Inference Efficiency

  33. LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesis

    Jul 7, 2026Chenhao Yuan, Yinhao Xu, Shuwen Xu +8Efficient Long-Context InferenceContext Length

  34. ResonatorLM: Causal Resonant Field Mixing for Efficient Long-Context Language Modeling

    Jul 6, 2026Archie ChaudhuryEfficient Long-Context InferenceTransformer Architectures

  35. CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon Agents

    Jul 6, 2026Yujiang Li, Zhenyu Hou, Yi Jing +2CompactionAgentic Reinforcement-Learning Framework

  36. Nemotron-Labs-3-Puzzle-75B-A9B: Compressing Hybrid MoE LLMs

    Jul 5, 2026Akhiad Bercovich, Talor Abramovich, Daniel Afrimi +67Context CompressionEfficient Long-Context Inference

  37. Beyond Multilingual Averages: MTEB-PT, a Benchmark for Portuguese Sentence Encoders

    Jul 5, 2026Lucas Hideki Takeuchi Okamura, Alexandre Alcoforado, Anna Helena Reali CostaDomain-Invariant Text EmbeddingsPortuguese

  38. Uncertainty-gated selection for block-sparse attention

    Jul 4, 2026Thomas RossiEfficient Long-Context InferenceLongbench

  39. Sequential Correlations Change In-Context Learning: Effective Context Length and Architectural Mismatch

    Jul 4, 2026Mary Letey, Yue M. Lu, Cengiz Pehlevan +1In-Context LearningSequence Modeling

  40. Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling

    Jul 3, 2026Xiang Hu, Xinyu Wei, Hao Gu +10Efficient Long-Context InferenceDynamic Sparse Attention

  41. Training Hybrid Block Diffusion Language Models with Partial Bidirectionality

    Jul 2, 2026Pranshu Chaturvedi, Parth Shroff, Tarun Suresh +2Diffusion Language ModelsEfficient Long-Context Inference

  42. ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning

    Jul 2, 2026Yanjun Zhao, Ruizhong Qiu, Tianxin Wei +6Efficient Long-Context InferenceLarge Language Model Reasoning

  43. A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets

    Jul 2, 2026Wanyun CuiQuadratic AttentionDense Associative Memory

  44. BamiBERT: A New BERT-based Language Model for Vietnamese

    Jul 2, 2026Dat Quoc Nguyen, Thinh Pham, Chi Tran +1Bert-Based ModelsContext Length

  45. Multi-Head Recurrent Memory Agents

    Jul 1, 2026Jiatong Li, Samuel Yeh, Sharon LiRecurrent ModelEfficient Long-Context Inference

  46. Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads

    Jul 1, 2026Aryo Pradipta Gema, Beatrice Alex, Pasquale MinerviniEfficient Long-Context InferenceBiasing Score Estimation

  47. MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

    Jul 1, 2026Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5Key-Value Cache CompressionEfficient Long-Context Inference

  48. HyFL-CLIP: Hyperbolic Fine-Tuning of CLIP for Robust Long-Context Understanding

    Jul 1, 2026Ji Ha Jang, Hayeon Kim, Chulwon Lee +2Few-Shot Contrastive Language-Image Pre-Training AdaptationEfficient Long-Context Inference

  49. SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference

    Jun 30, 2026Amirhossein Abaskohi, Giuseppe Carenini, Peter West +1Key-Value Cache CompressionKey-Value Cache

  50. Morphing into Hybrid Attention Models

    Jun 29, 2026Disen Lan, Jianbin Zheng, Yuxi Ren +5Hybrid TransformerTransformer Attention

  51. Hierarchical Global Attention (HGA)

    Jun 29, 2026Woernle Frank, Fedosov Vladimir, Grinenko ArtemiyEfficient Long-Context InferenceTransformer Architectures

  52. HSAP: A Hierarchical Sequence-aware Parallelism for Hybrid-Context Generative Models

    Jun 29, 2026Songxin Zhang, Zejian Xie, Zhuoyang Song +4ParallelSequence Modeling

  53. Predict, Reuse, and Repair: Accelerating Dynamic Sparse Attention for Long-Context LLM Decoding

    Jun 29, 2026Tianyu Wang, Gourav Rattihalli, Aditya Dhakal +4Dynamic Sparse AttentionEfficient Long-Context Inference

  54. MATCH: Modulating Attention via In-Context Retrieval for Long-Context Transformers

    Jun 29, 2026Linrui Ma, Chun Hei Lo, Xinyu Wang +12Efficient Long-Context InferenceDynamic Sparse Attention

  55. Diagnosing and Mitigating Context Rot in Long-horizon Search

    Jun 29, 2026Shijie Xia, Yikun Wang, Zhen Huang +1Efficient Long-Context InferenceLong-Horizon Tasks

  56. MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation

    Jun 27, 2026Junyi Zou, Avrova DonzEfficient Long-Context InferenceLong-Term Memory

  57. Database Context Compression for Text-to-SQL on Real-World Large Databases

    Jun 26, 2026Jingwen Liu, Weibin Liao, Xin Gao +2Text-To-SqlLongbench

  58. Turn-Averaged SAEs for Feature Discovery and Long-Context Attribution

    Jun 26, 2026Kevin Der, Harish Kamath, Ben ThompsonSparse Autoencoder FeaturesImproving Sparse Autoencoders

  59. NLL-Guided Full-Attention Layer Selection for Training-Free Sliding-Window Adaptation

    Jun 26, 2026Qiong Tang, Xiangkun Hu, Xiangyang Liu +2Sliding-Window AttentionEfficient Long-Context Inference

  60. Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling

    Jun 26, 2026Changze Lv, Zhenghua Wang, Yiran Ding +9Rotary Position EmbeddingTransformer Architectures