Contextual Reasoning

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 38

All topics

Hermes: Learning Contextual Reasoning Unlocks Test-Time Scaling
Sep 29, 2026Xinyu Li, Mononito Goswami, Hao Liu +5Test-Time Scaling Inference-Time
Carnegie Mellon University · AWS AI Labs · Washington University in St. Louis +1
ContextRender: From Execution Dependencies to Agent Context
Sep 29, 2026Savini Kashmira, Jayanaka L. Dantanarayana, Lingjia Tang +1Long-Horizon Agents Contextual Reasoning
University of Michigan, Ann Arbor, USA
MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs
Sep 28, 2026Zineddine Tighidet, Andrea Mogini, Jiali Mei +2LLM Reasoning Strategies Contextual Reasoning
BNP Paribas Paris, France · Sorbonne Université Paris, France · Criteo AI Lab
PairPref: When Should Memory Guide the Answer? A Benchmark for Contextual Preference Use
Sep 28, 2026Mingfei Lu, Mengjia Wu, Yi ZhangPreference Alignment Learning Conversational Memory
AAII, University of Technology Sydney
Learning to Learn from Context: Synthetic Training from Perturbed Public Documents
Sep 27, 2026Haoyi Wu, Yang Xiao, Yusong Sun +4LLM Reasoning Strategies Contextual Reasoning
AllSpark Team
JevOut: Natural Context Can Flip Decision Models
Sep 24, 2026Zixiang XuDecisions Contextual Reasoning
University of Southern California
Realize What Matters: Principled Context Representation for Large-Scale Reasoning
Sep 23, 2026Michael Theologitis, Dean Light, Shuyue Stella Li +3Contextual Reasoning Relevance
University of Washington
When Learned Context Planning Fails to Beat Strong Retrieval: A Controlled Study of Planning, Routing, and Reranking for Long-Context QA
Sep 22, 2026Yingrui Li, Han ChenLong-Context Reasoning Contextual Reasoning
Independent Researcher, United States
Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Making
Sep 16, 2026Yu Liu, Wenwen Li, Yifan Dou +1Multi-Agent Reasoning Contextual Reasoning
Fudan University
JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
Sep 9, 2026Zixiang Chen, Yuheng Lu, Zihao Cheng +8Graphical User Interface Agents Graphical User Interface
School of Computer Science and Engineering, Beihang University, Beijing, China · Beijing Institute of Technology, Beijing, China · Baidu Inc., Beijing, China
A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural Entities
Sep 3, 2026Anh Danh, Rick Nouwen, Massimo PoesioCoreference Resolution Entities
Utrecht University · Queen Mary University of London
DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents
Sep 2, 2026Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park +5Multimodal Documents Multi-Hop Reasoning
University of Wisconsin-Madison · Massachusetts Institute of Technology · Stanford University +2
Measuring Semantic Abstractness of SAE Features via Nonlocality
Aug 11, 2026Chuqiao Lin, Shivaji Sondhi, Xiao-Liang QiSparse Autoencoder Features Mechanistic Interpretability
Rudolf Peierls Centre for Theoretical Physics, University of Oxford · Leinweber Institute for Theoretical Physics, Stanford University
MemeMind: Reference-Guided Trace Construction for Offline Context Optimization
Aug 10, 2026Run Yang, Weihang Wang, Boheng Sheng +7Memo Contextual Reasoning
1Bilibili · 2Fudan University
Weather- and Location-Aware Agentic Dining Recommendation: Leveraging LLM World Knowledge for Region-Sensitive Contextual Reasoning
Aug 5, 2026Kadharmoideen FadurudeenContextual Reasoning Recipe
Independent Researcher
ANCHOR-RE: An Agentic Neuro-Symbolic Framework for Grounded Biomedical Relation Extraction
Aug 4, 2026Shufan Ming, Yikun Han, Gibong Hong +2Relation Extraction Clinical Reasoning Training
School of Information Sciences, University of Illinois Urbana-Champaign, 501 E Daniel St., Champaign, 61820, IL, USA · Division of Computational Health Sciences, Department of Surgery, University of Minnesota, 516 Delaware St SE, Minneapolis, 55455, MN, USA
CastFSR: A Fast--Slow--Reflect Agentic Reasoning Framework for Context-Aware Time Series Forecasting
Aug 4, 2026Xiaoyu Tao, Mingyue Cheng, Bokai Pan +6Retrieval-Augmented Forecasting Contextual Reasoning
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China, Hefei, Anhui Province, China
RCWT: Measuring Task-Budget Displacement from Coordination Content in LLM Calls
Jul 13, 2026Brenda Lelis, Rodrigo Cabral-CarvalhoLarge Language Model Tool Use Coordination
CloudWalk, Inc. · São Paulo, Brazil
Game-Theoretic Multi-Agent Control for Robust Contextual Reasoning in LLMs
Jun 9, 2026Saeid Jamshidi, Amin Nikanjam, Arghavan Moradi Dakhel +2Model Context Protocol Multi-Turn Interactions
SWAT Laboratory, Polytechnique Montréal, Montréal, QC, Canada · Huawei Distributed Scheduling and Data Engine Lab, Montr´eal, QC, Canada
Decision-Aware Memory Cards: Counterfactual-Inspired Context Selection and Compression for Tool-Using LLM Agents
Jun 6, 2026Xinyu Guan, Qianyang Zhao, Yuming DengContextual Reasoning Language-Model Agents
Alibaba Group, China
Customer-Agent: Overcoming Context Limitations in Ultra-Long Shopping Trajectories via Tool-Augmented Agents and RLVR
Jun 6, 2026Hongye Liu, Rongmei Lin, Anurag Kashyap +4Interaction History Contextual Reasoning
Amazon · Duke University
Self-Commitment Latency: A Reward-Free Probe for Prompted Implicit Hacking
Jun 4, 2026Bonan Shen, Youting Wang, Dingyan Shang +1Commitment Contextual Reasoning
Independent Researcher · Northeastern University · Syracuse University
HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning
Jun 3, 2026Zeju Li, Ziyang Zheng, Yizhou Zhou +1Long-Context Reasoning Contextual Reasoning
The Chinese University of Hong Kong · Independent Researcher
Beyond Static Dialogues: Benchmarking Realistic, Heterogeneous, and Evolving Long-Term Memory
May 29, 2026Han Zhang, Zihao Tang, Xin Yu +8Dialogue Benchmarks Conversational Memory
Center for Applied Statistics, Renmin University of China · School of Statistics, Renmin University of China · Microsoft
ContextGuard: Structured Self-Auditing for Context Learning in Language Models
May 26, 2026Hongbo Jin, Chi Wang, Haoran Tang +5Contextual Reasoning In-Context Learning
Peking University · SCUT · Tsinghua University
Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
May 25, 2026Yusong Lin, Xinyuan Liang, Haiyang Wang +8Agentic Benchmarks Large Language Model Agents
Beijing Institute of Technology · Huawei Technologies Co., Ltd · Peking University +1
RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations
May 25, 2026Hanyu Li, Yichi Zhang, Speed Zhu +3Repository-Level Code Understanding Coding Agents
Beijing University of Posts and Telecommunications · Tsinghua University · Tencent
Context-CoT: Enhancing Context Learning via High-Quality Reasoning Synthesis
May 25, 2026Hongbo Jin, Mingnan Zhu, Jingqi Tian +6Contextual Reasoning LLM Reasoning Strategies
Peking University · Xiamen University · Tsinghua University
CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection
May 22, 2026Hyeongmuk Lim, Youngbum HurTraining-Free Video Anomaly Detection Fine-Grained Video Understanding
Department of Industrial Engineering, Inha University, Incheon, Republic of Korea
PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
May 19, 2026Zhuohan Gu, Qizheng Zhang, Omar Khattab +1Contextual Reasoning Large Language Model Agents
MIT CSAIL · Stanford University
SOM: Structured Opponent Modeling for LLM-based Agents via Structural Causal Model
May 8, 2026Shiyue Cao, Pei Xu, Likun Yang +3Contextual Reasoning
School of Artificial Intelligence, University of Chinese Academy of Sciences & Institute of Automation, Chinese Academy of Sciences Beijing, China · National Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences Beijing, China +1
From Context to Skills: Can Language Models Learn from Context Skillfully?
Apr 30, 2026Shuzheng Si, Haozhe Zhao, Yu Lei +10In-Context Learning Contextual Reasoning
THU · UIUC · DeepLang AI +2
CL-bench Life: Can Language Models Learn from Real-Life Context?
Apr 29, 2026Shihan Dou, Yujiong Shen, Chenhao Huang +35Large Language Model Benchmarks Contextual Reasoning
Hunyuan Team, Tencent · Fudan University
CoGReV: A Confidence-Gated Post-Hoc Non-Monotonic Belief Revision Framework for Phishing Website Classification
Apr 28, 2026Mainak Sen, Kumar Sankar Ray, Amlan ChakrabartiPhishing Contextual Reasoning
Techno India University, West Bengal, India · A. K. Choudhury School of Information Technology, University of Calcutta, Kolkata, India · Electronics and Communication Sciences Unit (ECSU), Indian Statistical Institute, Kolkata, India +1
ContextWeaver: Selective and Dependency-Structured Memory Construction for LLM Agents
Apr 24, 2026Yating Wu, Yuhao Zhang, Sayan Ghosh +4Large Language Model Agents Contextual Reasoning
UT Austin · AWS AI Labs
AlphaContext: An Evolutionary Tree-based Psychometric Context Generator for Creativity Assessment
Apr 20, 2026Yixuan Wang, Yue Huang, Hong Qian +7Creativity Computerized Adaptive Testing
East China Normal University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China
On the Context Sensitivity of LLM Moral Judgment
Mar 24, 2026Adrian Sauter, Mona SchirmerMoral Reasoning Large Language Model Decisions
Helmholtz Munich · University of Amsterdam
NRR-Core: Non-Resolution Reasoning as a Computational Framework for Contextual Identity and Ambiguity Preservation
Dec 15, 2025Kei SaitoAmbiguity Disambiguation
Independent Researcher, Japan

Sep 29, 2026, cs.LGJ/K move · Enter open · S save

Hermes: Learning Contextual Reasoning Unlocks Test-Time Scaling

Xinyu Li, Mononito Goswami, Hao Liu, Nikos Kanakaris+4

Carnegie Mellon University · AWS AI Labs · Washington University in St. Louis+1

Test-Time Scaling Inference-Time Contextual Reasoning

Open paper AskPDF arXiv

Test-time scaling improves model performance by allocating additional compute during inference. Using this compute effectively across multiple context windows requires deciding how to allocate fresh contexts and what information to carry between them. We call a model's ability to make these decisions contextual reasoning. Existing approaches largely prescribe these decisions through their harness; we instead shift them to the model. We introduce 1) Hermes, a family of simple, configurable harnesses that progressively varies model control over context allocation and reuse, and 2) Hermes-Learn, a two-stage framework for learning these capabilities. We find that capable models can exploit this flexibility to scale with additional inference-time compute, while smaller open-source models initially struggle to do so. Training with Hermes-Learn closes this gap, inducing adaptive contextual reasoning strategies that vary with both the problem and the progress of reasoning. These gains generalize across benchmarks and models, extrapolate beyond the inference-time compute seen during training, and transfer to complementary test-time scaling methods beyond Hermes.

Momentum

Related topics

Latest papers 38