LLM Context Management

LLM: Large Language Model

Overview

This field studies how language models and agents can use conversation history, documents, tool outputs, and memory when their working context is limited or grows costly. Common approaches include truncation and summarization, relevance-based retrieval, structured or external memory, and adaptive policies that decide what to retain, restore, or discard; some systems also manage attention or KV-cache state directly. Methods are tested on tasks such as long-horizon search, coding, multi-turn question answering, and tool use. The central tension is reducing tokens, latency, and cost without losing evidence, dependencies, or safety constraints needed for later decisions, and results vary substantially by task and model.

Latest papers

CardsList

265 papers15 papers in the last four weeks, down 66% on the four weeks before. 0.1% of all new papers.

  1. Semantic Context Handoff with On-Demand Evidence for Long-Horizon Agents

    Nov 18, 2026Guolong Zheng, Chen Hou, Xu Yang +2Long-Horizon LLM AgentsLLM Context Management

  2. Measuring and Charging for Retained Context in Long-Context LLM Services

    Nov 18, 2026Yi Lu, Qianshi Lin, Yumeng Yang +1LLM ServingLLM Context Management

  3. Stopping Is Not the Limit: Understanding and Eliciting Agent Capability in Long-Horizon Vulnerability Exploitation

    Nov 17, 2026Deokhyung Kang, Minjae Gwon, Sangdon ParkLLM AgentsAutomated Exploit Generation

  4. CarryOn: Learning What to Keep in Context for Long-Horizon LLM Agents

    Nov 13, 2026Lihuan Li, Ruiyi Yang, Jiru Wang +5LLM Context ManagementLong-Horizon LLM Agents

  5. Folio: Recoverable Multi-Resolution Context Folding for Long-Horizon Language Agents

    Nov 12, 2026Yubo Ruan, Tao Peng, Jiao Zhang +11LLM Context ManagementContext Compaction for LLM Agents

  6. How Much Conversation History Does an AI Agent Need?

    Nov 6, 2026Danny Kim, Fernando KochLLM Context ManagementConversational Memory

  7. CORE: Coarse-to-Fine Search with Context Management for Deep Research

    Nov 5, 2026Hoang Tran Vuong, Ngoc Quan Pham, Hung Bui +2Agentic RetrievalInformation Retrieval

  8. Switch-SWE: Do Coding Agents Hold Focus When Switching Between Unfinished Tasks?

    Nov 1, 2026Shuochen Chang, Qianli Ma, Yibo Miao +7Coding AgentsCoding Agent Benchmarks

  9. Agentic Context Management for Multi-Turn Human-AI Conversations

    Oct 31, 2026Matthew Ho, Chenglong Wang, Baolin Peng +5LLM Context ManagementMulti-Turn Dialogue Management

  10. MEMENTO: Learning Context Management for Long Context Processing Agents

    Oct 30, 2026Yunfan Zhang, Taehoon Hwang, Kathleen McKeown +1LLM Context ManagementContext Compaction for LLM Agents

  11. Context Is a Pipeline, Not a Window: Information Attrition in LLM Agent Harnesses

    Oct 26, 2026Yuvraj Sehgal, Mahsa Panahandeh, Naser Ezzati-JivanLLM Context ManagementLLM Agent Harnesses

  12. MarkovSim: an LLM Agent Harness with Bounded Context for Long-Horizon Computational Simulation

    Oct 26, 2026Yeui-Lung Lei, Wen-Bo Chen, Pan ZhangLLM Agent HarnessesLarge Language Model-Based Simulation

  13. The Physical Cost of Context: Quality-Constrained Resource Accounting for Coding Agents

    Oct 26, 2026Zhongming Yu, Yitong Ma, Hengjia Yu +4LLM Agent EfficiencyLLM Context Management

  14. CTXAgent - Self-Controlled Context Management of LLM Agents

    Oct 25, 2026Matthias Busch, Marius Tacke, Roland C. Aydin +2LLM Context ManagementContext Compaction for LLM Agents

  15. Cache Engineering for Agents

    Oct 20, 2026Tianyu Fu, Ruoxi Wang, Zihan Min +6KV-Cache ManagementMemory Management for LLM Agents

  16. Editing as Language: Teaching LLM Agents a Grammar for Native Context Editing

    Oct 18, 2026Yunlong Deng, Yan Li, Xing Hu +4LLM Context ManagementLLM Agent Training

  17. MemPrice: Online Memory Allocation via Adaptive Pricing for Long-Horizon Agents

    Oct 18, 2026Yiming Zong, Shiyuan Piao, Jiashuo Jiang +1Memory Management for LLM AgentsLLM Context Management

  18. Reasoning with Context Management and External Memory

    Oct 16, 2026Man-Ling Sung, William Hartmann, Jiangying ZhouLLM Context ManagementEfficient Language Model Reasoning

  19. When to Forget: Risk-Controlled Context Adaptation for Long-Horizon Agents

    Oct 16, 2026Chenle Chen, Yangbo Wei, Zhijie Zheng +6LLM Context ManagementLong-Horizon Agent Tasks

  20. Scaling Discovery Requires Forgetting

    Oct 14, 2026Shangyin Tan, Ben Zhou, Lakshya A Agrawal +8AI Agents for Scientific DiscoveryLLM Agent Memory

  21. Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon Agents

    Oct 13, 2026Yuchen Lu, Julian McAuley, Lei ZhangLLM Context ManagementLong-Horizon LLM Agents

  22. Encoding Context into LLM Weights: What Makes It Context?

    Oct 13, 2026Yue Wang, Qizhou Wang, Feng Liu +3LLM Context ManagementTest-Time Training