Long-Horizon LLM Reasoning

LLM: Large Language Model

Follow this topic Ask about this topic

Latest papers

24 papers7 papers in the last four weeks, up 40% on the four weeks before. 0.0% of all new papers.

Adversarial Speculative Reasoning Improves Long Horizon Agents
Nov 3, 2026Hongyin Luo, Wei Fang, Lijie Yang +5Speculative Decoding Long-Horizon LLM Reasoning
Subconscious Systems Technologies, Inc. · Massachusetts Institute of Technology · Princeton University +1
MemRole: From Memories to Decisions for Long-Horizon Reasoning in Role-Playing Agents
Nov 1, 2026Mengting Li, Xilong Cheng, Zhihao Xiao +6Large Language Model-Based Role-Play Simulation Memory-Augmented Language Model Agents
Beihang University · Communication University of China · Zhejiang University +2
Enhancing Language Model Reasoning with Structured Multi-Level Modeling
Oct 31, 2026Siheng Xiong, Ali Payani, Faramarz FekriStructured Reasoning in Language Models Long-Horizon LLM Reasoning
Georgia Institute of Technology · Cisco Research
Solvent: Long-Horizon Reasoning for Multi-Step Retrosynthesis
Oct 23, 2026Yifei Wang, Botian Wang, YiFei Wang +8Chemical Reasoning in LLMs Long-Horizon LLM Reasoning
Fudan University · Shanghai Artificial Intelligence Laboratory · Generative Symbolic Intelligence Lab (GenSI), Tsinghua University
Right On Q: Recovering Reasoning under Quantization via Self-Generated Trajectories
Oct 21, 2026Boyuan Zheng, Jing Xiong, Chenwei Wu +8LLM Quantization Quantization-Aware Training
University of Michigan, Ann Arbor · University of California, Santa Barbara · Meta AI
Curriculum Learning Teaches LLMs Long-Horizon Implicit Reasoning, Up To A Limit
Oct 19, 2026Jimson Huang, Maxwell Nickell, Ruowang Zhang +1Long-Horizon LLM Reasoning Implicit Reasoning in Language Models
Purdue University West Lafayette, IN 47907, USA
Probing for Long-Horizon Deductive Reasoning Capabilities in Language Models with Prolog
Oct 8, 2026Hadeel Al-Negheimish, Jasna Ilieva, Yoon KimDeductive Reasoning in Language Models Long-Horizon LLM Reasoning
King Saud University · Massachusetts Institute of Technology
EdgeRock: Strong Reasoning at Constant Memory
Oct 7, 2026Huishan Ji, Weiming Zhang, Qirui Ye +3Long-Horizon LLM Reasoning Long-Horizon Reasoning
Rocore Matrix
StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
Sep 30, 2026Naen Xu, Wanqing Cui, Yibo Hu +5Temporal Reasoning in Language Models RL for Language Model Reasoning
Zhejiang University · Taobao & Tmall Group of Alibaba
Provable Test-Time Scaling for Beam Search in LLM Reasoning
Sep 29, 2026Qijia He, Yu Huang, Yuan Cheng +2Long-Horizon LLM Reasoning Inference-Time Search
The Ohio State University · University of Pennsylvania · National University of Singapore
SAGE: Mitigating Long-Horizon Reasoning Biases via Topological Guidance
Sep 24, 2026Xinyue Zeng, Jiawei Zhang, Yujun Yan +1Long-Horizon LLM Reasoning Sparse-Reward RL
CS Department, Virginia Tech · CS Department, University of Wisconsin Madison · CS Department, Dartmouth College
QART: A Quantum-Classical Hybrid Architecture for Long-Horizon Reasoning -- Exploring a Conditional Path toward Quantum Scaling
Sep 15, 2026Lehao Lin, Yuheng Cheng, Guolong Liu +9Long-Horizon LLM Reasoning Hybrid Quantum-Classical ML
QuantumMind · Shenzhen Institute of Artificial Intelligence and Robotics for Society · The Chinese University of Hong Kong, Shenzhen +3
Tasks over Application Manuals: Revealing Gaps in Long-Horizon Procedural Reasoning for Language Models
Sep 11, 2026Utkarsh Soni, Syed Shariyar Murtaza, Yifan Nie +2Long-Horizon LLM Reasoning Long-Context Language Model Evaluation
Manulife Pittsburgh, United States · Manulife Toronto, Canada · Manulife Bangalore, India
SKILL.state: Scalable Long-Horizon Agent Skills
Aug 26, 2026Sanket Badhe, Priyanka Tiwari, Jonghyun ChungLong-Horizon Agent Tasks Long-Horizon LLM Agents
Google LLC · Purdue University
The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents
Aug 7, 2026Mingguang Chen, Licheng Wang, Bo QuMemory-Augmented Language Model Agents Long-Horizon Planning
1DeepGrounding · 2AlphaAvatar
Toward Skill-Native LLMs: Skill Entropy for Benchmarking and Training Long-Horizon Reasoning
Aug 5, 2026Yinghui He, Ling Yang, Jiarui Liu +6LLM Evaluation Long-Horizon LLM Reasoning
Princeton University · Carnegie Mellon University · University of Toronto +3
PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
Jul 22, 2026Alexis Fox, Junlin Wang, Paul Rosu +1Memory-Augmented Language Model Agents Persistent Memory for Language Models
Duke University
Can RL Teach Long-Horizon Reasoning to LLMs? Expressiveness Is Key
May 7, 2026Tianle Wang, Zhaoyang Wang, Guangchen Lan +4Logical Reasoning RL for Language Model Reasoning
Purdue University · UNC Chapel Hill · Georgia Tech +1
ReFlect: An Effective Harness System for Complex Long-Horizon LLM Reasoning
May 7, 2026Fan HuangLLM Self-Correction Long-Horizon LLM Reasoning
Indiana University Bloomington
LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
Apr 15, 2026Sumeet Ramesh Motwani, Daniel Nichols, Charles London +17Long-Horizon LLM Reasoning CoT Reasoning
University of Oxford · Lawrence Livermore National Laboratory (LLNL) · MBZUAI +4
LEAD: Breaking the No-Recovery Bottleneck in Long-Horizon Reasoning
Mar 6, 2026Denys Pushkin, Emmanuel AbbeLong-Horizon LLM Reasoning Long-Horizon Reasoning
EPFL, Apple
Recursive Models for Long-Horizon Reasoning
Mar 2, 2026Chenxiao Yang, Nathan Srebro, Zhiyuan LiRecursive Language Models Language Modeling
Toyota Technological Institute at Chicago
Limited Reasoning Space: The cage of long-horizon reasoning in LLMs
Feb 22, 2026Zhenyu Li, Guanlin Wu, Cheems Wang +1Long-Horizon LLM Reasoning Long-Horizon Reasoning
Academy of Sciences, Beijing, China · Department of Automation, Tsinghua University, Beijing, China · Department of Computer Science, Peking University, Beijing, China
How Far Are LLMs from Symbolic Planners? An NLP-Based Perspective
Aug 2, 2025Ma'ayan Armony, Albert Meroño-Peñuela, Gerard CanalLLM Planning LLM Evaluation
Department of Informatics, King’s College London

Nov 3, 2026J/K move · Enter open · S save

Adversarial Speculative Reasoning Improves Long Horizon Agents

Hongyin Luo, Wei Fang, Lijie Yang, Owen Stepan+4

Subconscious Systems Technologies, Inc. · Massachusetts Institute of Technology · Princeton University+1

Speculative Decoding Long-Horizon LLM Reasoning Long-Horizon LLM Agents AI Coding Agents

Open paper AskPDF arXiv

Speculative decoding has been treated purely as a systems optimization that speeds up large language model decoding without changing the model behavior. Under this view, the growing effort to train better draft models has been focused solely on acceptance rate. We argue that this view does not hold true for long-horizon agent reasoning. Measuring frontier open-weight models on complex agentic tasks with different speculative decoding approaches, we found that numerical noise grows within verification windows, and the draft acceptance results of the thinking process can change the output distribution of the model after 30 steps, thus noticeably influencing the reasoning accuracy of long-horizon agents in random directions. In this work, we improve the reasoning capability of target models by controlling such noise. While we cannot change the overall token distribution verified by the target model, we can encode critical reasoning with highest precision by training the draft model to be rejected. We identify these points in agent traces and train the draft model to favor adversarial preference. At inference the trained draft and the target part ways precisely at these decision points, verification restarts, so that critical thinking tokens are sampled from the target model and encoded under its least noisy conditions. This approach makes critical reasoning better indexed and more durable over a long horizon. On complex agentic coding benchmarks, our approach raises end-to-end success rate with no change to the target model or its output distribution. Our results recast the speculative decoding mechanism from a pure accelerator into an active allocator for context precision that improves the accuracy of long-horizon agents by training 0.06% to 0.28% of hosted parameters.