Long-Context Reasoning in Language Models

Latest papers

51 papers9 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

You don't need long context
Nov 3, 2026Peter Belcak, Saurav Muralidharan, Jindong Jiang +9Long-Context Reasoning in Language Models Long-Context Language Model Inference
MicroMouse: Masking Harmful Supervision in Long CoT via Relative Potential
Nov 2, 2026Xiaowei Zhu, Hengzhu Tang, Zhenyu Zhang +3CoT Supervision Selective Fine-Tuning
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China · Baidu Inc., Beijing, China
GraphNIAH: A Benchmark for Long-Context Reasoning over Real-World Graphs
Oct 30, 2026Minh-Nam Tran, Abulhair SaparovLong-Context Reasoning in Language Models Language Model Reasoning Evaluation
Department of Computer Science, Purdue University, West Lafayette, IN 47907, USA
Incentivizing Self-Learning in Large Language Models via Reinforcement Learning
Oct 29, 2026Lingkai Kong, Yuzhe Gu, Haiteng Zhao +6Language Model Self-Improvement RL for Language Model Reasoning
Shanghai AI Laboratory · Shanghai Jiao Tong University · MMLab, The Chinese University of Hong Kong +2
FAD-KV: Adaptive Dictionary KV Caching for Efficient Reasoning Decoding
Oct 27, 2026Yuxuan Zhu, David H. Yang, Parisa Shiravani +5KV-Cache Compression LLM Inference Acceleration
Rensselaer Polytechnic Institute · IBM Research
When LLMs Forget What They Believe: Characterizing State Integrity Collapse in Long-Horizon Dialogues
Oct 22, 2026Yancheng Zhu, Yifan YuanLLM Reliability Behavioral Consistency of LLM Agents
School of Artificial Intelligence, Shenzhen University, Shenzhen, China
LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data
Oct 21, 2026Zhennan Wan, Jianfei ChenLong-Context Reasoning in Language Models RL for Language Model Reasoning
Dept. of Comp. Sci. and Tech., Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University
LEAPS: Long-context Evaluation of Adaptive Pattern Learning and State Tracking
Oct 19, 2026Howard Yen, Nitya Mani, Alex Renda +1State Tracking in Language Models Long-Context Language Model Evaluation
Princeton Language and Intelligence, Princeton University · Jane Street
Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning
Oct 15, 2026Shiwen Qin, Cameron Barker, Henry Gouk +4Long-Context Reasoning in Language Models Long-Context Language Model Evaluation
University of Edinburgh, Edinburgh, United Kingdom
Probing for Long-Horizon Deductive Reasoning Capabilities in Language Models with Prolog
Oct 8, 2026Hadeel Al-Negheimish, Jasna Ilieva, Yoon KimDeductive Reasoning in Language Models Long-Horizon LLM Reasoning
King Saud University · Massachusetts Institute of Technology
UNREAL: Unifying Retrieval and Long-Context with a Single Model
Oct 6, 2026Edan Kinderman, Elad Hoffer, Yochai Blau +4Retrieval-Augmented Generation Knowledge Augmentation for Language Models
NVIDIA · Technion
Periscope: Extending Frozen Language Models Beyond Their Context Window
Oct 2, 2026Mohamed Eltahir, Anas Obayd, Raed Rashid +5Long-Context Language Model Inference Long-Context Reasoning in Language Models
King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia · Department of Computer Science, Edge Hill University, Ormskirk, England
Trained Agentic Context Management
Oct 1, 2026Bryce SandlundLong-Context Language Modeling Long-Context Reasoning in Language Models
LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation
Sep 30, 2026Xiaoqiang Wang, Suyuchen Wang, Bang LiuLong-Context Reasoning in Language Models Efficient Language Model Reasoning
Université de Montréal · Mila – Quebec AI Institute
Targeted Retrieval, Compact Representations: How CoT Reasoning Improves Long-Context Counting
Sep 30, 2026Liang Twist Shan, Tianyu Hu, Hao Yan +1Numerical Reasoning in Language Models Long-Context Retrieval
Department of Statistics, University of Wisconsin-Madison · Department of Computer Sciences, University of Wisconsin-Madison
StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
Sep 30, 2026Naen Xu, Wanqing Cui, Yibo Hu +5Temporal Reasoning in Language Models RL for Language Model Reasoning
Zhejiang University · Taobao & Tmall Group of Alibaba
LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning
Sep 29, 2026Quang Hieu Pham, Thuy Duong Nguyen, Jocelyn Qiaochu Chen +1Long-Context Language Model Evaluation Long-Context Language Model Inference
University of Alberta · Alberta Machine Intelligence Institute (Amii)
CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory
Sep 29, 2026Jingguang Li, Yebo Wu, Zuyi Guo +7Long-Context Reasoning in Language Models Memory-Augmented Language Models
Korea Advanced Institute of Science & Technology · University of Macau · Massachusetts Institute of Technology
Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding
Sep 25, 2026Zhaoyuan Xia, Qinghongbing Xie, Yung Xiang Hue +7Query-Focused Summarization Long-Context Reasoning in Language Models
Peking University · Baidu Inc · Baidu Inc. +1
ConvMem: Convolutional Memory for Long-Context Reasoning
Sep 9, 2026Hongming Zhang, Zhaozhen Gu, Fengshuo Bai +6Long-Context Reasoning in Language Models Memory-Augmented Language Models
Institute of Automation, Chinese Academy of Sciences
BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference
Sep 4, 2026Janghyeon Kim, Minsoo Kim, Kyuhong Shim +1Long-Context Reasoning in Language Models KV-Cache Compression
Hanyang University · Sungkyunkwan University
Do Large Language Models Play Six Degrees of Separation? Measuring Topological Compression in Long-Context Manifolds
Aug 18, 2026Md. Faiyaz Abdullah SayeediLong-Context Reasoning in Language Models Hallucination in RAG
BRAC University, Bangladesh
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning
Aug 14, 2026Haonan He, Haodi Lei, Yun Luo +13Long-Context Reasoning in Language Models On-Policy Distillation
SU-01 Team, Shanghai Artificial Intelligence Laboratory
Chained Recursive Language Models for Multi-Iteration Reasoning
Aug 5, 2026Purbesh Mitra, Sennur UlukusLong-Context Language Model Inference Language Modeling
University of Maryland
INS-ActBench: A Comprehensive Benchmark for Assessing Professional Actuarial Capability of Large Language Models
Jul 27, 2026Changyu Chen, Chenwei Lin, Xian XuNumerical Reasoning in Language Models Long-Context Reasoning in Language Models
Fudan University
ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
Jul 2, 2026Yanjun Zhao, Ruizhong Qiu, Tianxin Wei +6Long-Context Inference Long-Context Reasoning in Language Models
University of Illinois Urbana-Champaign
Randomized YaRN Improves Length Generalization for Long-Context Reasoning
Jun 22, 2026Manas Mehta, Fangcong Yin, Greg DurrettLong-Context Language Modeling LLM Fine-Tuning
New York University
Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning
Jun 17, 2026Xiaoyue Xu, Sikui Zhang, Xiaorong Wang +2Training Data Curation RL for Language Model Reasoning
OpenBMB · Tsinghua University
LISA: Linear-Indexed Sparse Attention for Efficient Long-Context Reasoning
May 29, 2026Yu Zhao, Zekun Zhang, Fan Jiang +6Long-Context Reasoning in Language Models Long-Context Language Model Inference
Alibaba International Digital Commerce · School of Software Technology, Dalian University of Technology · Amazon
LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
Apr 15, 2026Sumeet Ramesh Motwani, Daniel Nichols, Charles London +17Long-Horizon LLM Reasoning CoT Reasoning
University of Oxford · Lawrence Livermore National Laboratory (LLNL) · MBZUAI +4

Nov 3, 2026J/K move · Enter open · S save

You don't need long context

Peter Belcak, Saurav Muralidharan, Jindong Jiang, Yonggan Fu+8

Long-Context Reasoning in Language Models Long-Context Language Model Inference LLM Context Compression Long-Context Language Model Evaluation

Open paper AskPDF arXiv

Later tokens are costlier to generate than earlier tokens. On frontier open weight models, the disparity in cost may rise to as much as 7x. Through frequent compaction, we show across a broad range of long-horizon and long-input tasks that frontier language models sacrifice little to no task accuracy when maintaining short contexts. We further demonstrate that LLM performance does not collapse on long-horizon software engineering tasks even when taking at most one action per context, and based on that we outline the concept of semantic state space models (SSSMs). Our findings question the need for long-context language models.