Long-Context QA

QA: Question Answering

Follow this topic Ask about this topic

Momentum

1 paper in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 22

All topics

When Learned Context Planning Fails to Beat Strong Retrieval: A Controlled Study of Planning, Routing, and Reranking for Long-Context QA
Sep 22, 2026Yingrui Li, Han ChenLong-Context Retrieval LLM Planning
Independent Researcher, United States
TopoCompress: Long Context Compression via Graph-Wired Semantic Trajectories
Aug 31, 2026Daniel Agyei Asante, Yang LiLLM Compression Long-Context QA
1Iowa State University, United States
PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory
Aug 4, 2026Dawei Liu, Haixu Song, Shuang Cheng +9Memory-Augmented Language Models Long-Context QA
Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Tsinghua University +3
Zero-Mem: Zero-Token Memory Operations for LLM Agents
Jul 31, 2026Yilin Xiao, Zhehan Zhu, Yujing Zhang +8Conversational Memory Long-Context QA
The Hong Kong Polytechnic University, Hong Kong SAR · School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics · School of Artificial Intelligence, Jilin University
REFACT: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning
Jul 23, 2026Zhensheng Jin, Xin Dai, Zhenghao Liu +5LLM Grounding Long-Context QA
Northeastern University · Shenyang, China · Tsinghua University +1
TAP-RAG: Task-Aware Policy Control for Long-Document Multimodal Question Answering
Jul 21, 2026Zhong Ji, Keqi Jin, Yan Zhang +1Multimodal RAG Retrieval-Augmented Generation
School of Electrical and Information Engineering, Tianjin University · The International Joint Institute of Tianjin University, Fuzhou, Tianjin University · Department of Automation, Tsinghua University
DocAtlas: Long-Document Understanding as Mutable-State Interaction
Jul 21, 2026Hongchen Wei, Yuanzhe Wang, Bei Liu +8Document Understanding Long-Context QA
Wuhan University · Microsoft
XL-DocBench: Benchmarking Evidence-Grounded Extra-Long Document Understanding
Jul 21, 2026Hongchen Wei, Yuanzhe Wang, Bei Liu +9Long-Context Retrieval LLM Evaluation
1Wuhan University · 2Microsoft
Is Progressive Disclosure All You Need for Long-Context Agents?
Jul 20, 2026Yifeng He, Yinzhe Zhao, Jicheng Wang +1Long-Context Retrieval Long-Context QA
University of California, Davis · Zhejiang University · The University of Hong Kong
WILDTRACE: Benchmarking Natural Evidence Trails in Long-Context Reasoning
Jul 10, 2026Zixin Chen, Peng Liu, Haobo Li +7Evidence-Grounded Reasoning Long-Context QA
Hong Kong University of Science and Technology · Qwen Team, Alibaba Group · *Work done during internship at Qwen Team
What Survives Into Context: A Diagnostic for Budget-Constrained Multi-Hop RAG and When Submodular Evidence Packing Improves It
Jul 1, 2026Ananto Nayan BalaMulti-Hop QA Long-Context QA
Ahsanullah University of Science and Technology
Storyline Trees: Hierarchical Representations for Long-Form Narratives
Jun 18, 2026Litu Ou, Mirella LapataLong-Context Retrieval Long-Context QA
School of Informatics University of Edinburgh
Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
Jun 5, 2026Liuyin WangLong-Context QA LLM Agent Memory
Independent Researcher
EASE-TTT: Evidence-Aligned Selective Test-Time Training for Long-Context Question Answering
Jun 5, 2026Xiaopeng Yuan, Zebin Wang, Suwen Wang +3Long-Context Retrieval Long-Context QA
University of Illinois Urbana-Champaign · 2Harvard University · 3Brion, ASML US LP +1
Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding
Jun 4, 2026Qiuyu Tian, Fengyi Chen, Yiding Li +9Retrieval-Augmented Generation Long-Context QA
Southeast University, Nanjing, China · Nanjing Normal University, Nanjing, China · ZhuiWen Technology Co., Ltd., Beijing, China +1
SCOUT: Active Information Foraging for Long-Text Understanding with Decoupled Epistemic States
May 6, 2026Zhenliang Zhang, Wenqing Wang, Yong Hu +4Document Understanding Long-Context QA
Peking University · WeChat, Tencent · Work done during an internship at WeChat, Tencent
Learning Evidence Highlighting for Frozen LLMs
Apr 24, 2026Shaoang Li, Yanhang Shi, Yufei Li +10Long-Context QA LLM Prompting
Stony Brook University · Meta AI
InfoFlow KV: Information-Flow-Aware KV Recomputation for Long Context
Mar 5, 2026Xin Teng, Canyu Zhang, Shaoyi Zheng +3Retrieval-Augmented Generation KV Caching
New York University · New York University Shanghai · Duke University +1
STAGE: A Full-Screenplay Benchmark for Reasoning over Evolving Stories
Jan 13, 2026Qiuyu Tian, Zequn Liu, Yiding Li +9KG Construction LLM Evaluation
Southeast University, Nanjing, China · Beijing Zhongguancun Academy, Beijing, China · ZhuiWen Technology Co., Ltd., Beijing, China +1
CompLLM: Compression for Long Context Q&A
Sep 23, 2025Gabriele Berton, Jayakrishnan Unnikrishnan, Son Tran +1LLM Compression Long-Context Language Model Inference
Amazon · Center For Research in Computer Vision, University of Central Florida
LIFT: A Novel Framework for Enhancing Long-Context Understanding of LLMs via Long Input Fine-Tuning
Feb 20, 2025Yansheng Mao, Yufei Xu, Jiaqi Li +5Long-Context QA LLM Fine-Tuning
Institute for Artificial Intelligence, Peking University · School of Electronics Engineering and Computer Science, Peking University · State Key Laboratory of General Artificial Intelligence, BIGAI
SeDeM: Selective Decompression of Hidden-State Memories for Long-Context Question Answering
Date pendingMaryam Haghifam, Jason Cong, Yizhou SunMemory-Augmented Language Models Long-Context QA
University of California, Los Angeles, USA

Sep 22, 2026, cs.CLJ/K move · Enter open · S save

When Learned Context Planning Fails to Beat Strong Retrieval: A Controlled Study of Planning, Routing, and Reranking for Long-Context QA

Yingrui Li, Han Chen

Independent Researcher, United States

Long-Context Retrieval LLM Planning Long-Context QA LLM Reranking

Open paper AskPDF arXiv

Learned context planning selects evidence atoms before an answer model reasons over them. We test whether this learned selection improves long-context multiple-choice QA after strong retrieval, routing, budgeted-selector, and reranking controls. Our primary diagnostic uses all 503 LongBench-v2 MCQ questions with Qwen2.5-7B-Instruct. The planner is SFT-trained on outcome-selected traces from 140 training and 28 development questions; because the 503-question analysis includes those questions, it is partly transductive. At an 18k-character budget, anchored hybrid retrieval reaches 36.18% accuracy and BM25 reaches 35.98%, while the best direct planner-guided method reaches 34.19%. On the untouched 152-question test split, anchored hybrid remains higher (42.11% versus 36.84%). Leakage-safe routers cannot convert a large oracle gap. Under tight budgets, the best planner is ahead by only 0.40 points at 6k and loses at 9k; planner-guided reranking has a +1.79-point estimate at 6k with a paired interval crossing zero and ties the control at 9k. Packing-order and score-flatness analyses did not identify a stable mechanism. Under this setup, learned planning is a weak relevance signal rather than a replacement for strong retrieval.

Momentum

Related topics

Latest papers 22