cs.AISep 27, 2026

The Error You See Is Not the Error You Made: Progression-aware Reasoning Origin for Reasoning Error Localization

Authors: Yiguo Wang, Ziyuan Yang, Yi Zou, Dan Lin, Rongsheng Li, Yi Zhang

Organizations: Xiaopeng Honors College, Nanchang Hangkong University, China · School of Cyber Science and Engineering, Sichuan University, China · School of Software, Nanchang Hangkong University, China · School of Computer Science and Technology, Harbin Engineering University, China

Abstract

Verifying multi-step LLM reasoning requires more than determining whether a trace is correct: a useful verifier should identify where the reasoning first goes wrong. However, existing holistic methods provide little positional evidence, while forward sequential verification often treats the first rejected step as the error source. Under error propagation, this assumption can fail, since an earlier mistake may remain locally plausible and become observable only through its downstream consequences. We therefore rethink reasoning verification as a progression-aware error-source localization problem: rather than asking only where a reasoning trace first appears inconsistent, we ask which earlier step best explains how that inconsistency emerges along the trajectory. Based on this view, we propose Progression-aware Reasoning Origin (PRO), a training-free framework for first-error localization. PRO jointly models incoming support from the preceding context and outgoing compatibility with subsequent reasoning, selectively refines regions where these signals disagree, and finally performs detector-conditioned source attribution with intervention-based evidence to distinguish the true error origin from its propagated manifestations. We further formalize the gap between forward rejection and structural exposure, showing why incoming-side evidence alone is insufficient for reliable localization under error propagation. Experiments across open-form, medical, and structured reasoning tasks demonstrate consistent improvements over strong verification baselines, supporting progression-aware source attribution as a more faithful formulation of reasoning verification.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. VeryTrace: Verifying Reasoning Traces through Compilable Formalism and Structured Verification

    Jun 23, 2026Ninghan Zhong, Ahmet Ege Tanriverdi, Kaan Kale +1Reasoning TracesTraces

  2. Diagnosing Multi-step Reasoning Failures in Black-box LLMs via Stepwise Confidence Attribution

    May 19, 2026Xiaoou Liu, Tiejin Chen, Dengjia Zhang +3LLM Reasoning StrategiesReasoning Traces

  3. Verify to Amplify: Improving Reasoning via Learned Chain-of-Thought Verification

    Mar 3, 2026Maria-Florina Balcan, Avrim Blum, Kiriaki Fragkia +2Chain-of-Thought ReasoningVerification Framework