Reasoning Consistency in Language Models

Overview

The field studies whether language models preserve conclusions and sound reasoning when prompts are paraphrased, evidence changes, answers are resampled, or conversations continue. Evaluations use controlled reformulations and multi-turn tests, repeated-sample agreement, and checks of reasoning traces with formal solvers, causal interventions, or evidence-grounded verifiers across math, logic, coding, and medical tasks. Methods include self-consistency and uncertainty-based answer selection, consistency-aware training and rewards, and test-time verification, repair, or early-exit systems. A central tension is that consistency can signal stability without correctness or faithful reasoning: models may repeat the same error, abstain, or agree while relying on invalid reasoning, so reliability must be assessed alongside accuracy, faithfulness, and cost.

Latest papers

CardsList

132 papers11 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. What If Chain-of-Thought Is Not Enough?

    Nov 19, 2026Marc JansenStructured Reasoning in Language ModelsLLM Decision-Making

  2. The Logic Chain Breaking Point: A Controlled-Variable Benchmark for Reasoning Degradation in Open-Weight Language Models

    Nov 16, 2026Akif Islam, Mohd. Ruhul Ameen, Md. Ekramul HamidLanguage Model Reasoning EvaluationLogical Reasoning

  3. Logically Consistent Accurate Forecasts

    Nov 13, 2026Kate Yuan, Rohan Alur, Manish Raghavan +1Probabilistic ForecastingReasoning Consistency in Language Models

  4. Do large language models rank moral values? A transitivity test of moral competence

    Nov 6, 2026Katelyn A. Wasson, Kiwon Song, James M. Jennings +3Moral Reasoning in Language ModelsLLM Evaluation

  5. Does Reasoning Make Language Models Agree?

    Oct 30, 2026Mila Gorecki, Moritz HardtReasoning Consistency in Language Models

  6. STEP: Soft Trajectory Estimation of Prediction Correctness via Per-Step Probability Scoring

    Oct 25, 2026Chenyang Yu, Zifan Zeng, Qunli Zhang +1Confidence Estimation in Language ModelsLanguage Model Performance Prediction

  7. Scoped Semantic Invariance as a Foundation for LLM Reliability

    Oct 23, 2026Rosario Uceda-Sosa, Maria Chang, Karthikeyan Natesan Ramamurthy +1Reasoning Consistency in Language ModelsLLM Reliability

  8. LGMT: A Tool for Testing the Logical Reasoning Reliability of LLMs

    Oct 23, 2026Zenghui Zhou, Xiaoke Fang, Zheng ZhengReasoning Consistency in Language ModelsLanguage Model Reasoning Evaluation

  9. Same Answer, Different Reasons: Trace-Level Divergence in Multilingual Large Language Models

    Oct 21, 2026Rui Sun, Peizhao Mei, Xiewei Cheng +4Multilingual Language Model EvaluationReasoning Consistency in Language Models

  10. CALM: Consistency-Aware Logit Masking in Decoding Space for Mitigating Overthinking of Large Reasoning Models

    Oct 19, 2026Shengjing Liu, Feiyang Li, Yuxuan Yang +2Overthinking in Language ModelsEfficient Language Model Reasoning

  11. Consistency Training Suppresses Cue Following Without Teaching Cue Selectivity

    Oct 19, 2026Prakhar Gupta, Terry Jingchen Zhang, Zhijing JinReasoning Consistency in Language ModelsCognitive Bias in Language Models

  12. When Form Changes but Logic Doesn't: Building Logic-invariant LLMs through Logical Structure

    Oct 18, 2026Xuyuan Liu, Xinshuai Dong, Elynn Chen +1LLM ReasoningStructured Reasoning in Language Models

  13. Not All Test-Time Compute Is Evidence: Model-Specific Bias in LLM Reasoning

    Oct 16, 2026Ming Shen, Tianjun YaoTest-Time ScalingEfficient Language Model Reasoning

  14. Competence-Based Evaluation of Logical Reasoning in Large Language Models

    Oct 16, 2026Jize Jiang, Chengxiang ZhaiLLM EvaluationLLM Reasoning

  15. When Protection Overrides Consequences: Understanding Protection Mode in Large Language Model Decision-Making

    Oct 14, 2026Yuanfan Li, Junyi Chen, Qi Zhou +3LLM Decision-MakingRisky Decision-Making

  16. Lost in the Fallback: How Reliably Do Typed Decision Models Use Fallback Options?

    Oct 14, 2026Yuanbo Xie, Mingli Zhu, Tianyun Liu +3Typed Decision ModelsLLM Reliability

  17. Evaluating Temporal Reasoning in Large Language Models: Event Temporal Relation Extraction with Allen's Interval Algebra, Logical Consistency, and Relative Time in Narratives

    Oct 12, 2026Adib Sakhawat, Fardeen Sadab, Tamjid Hasan Fahim +9Temporal Reasoning in Language ModelsTemporal Information Extraction

  18. Training Language Models To Be Coherent Decision-Makers

    Oct 6, 2026Khurram Yamin, Xavier Fernandes, Paul Koch +2LLM Decision-MakingDecision-Making under Uncertainty

  19. TCMClinicalReason-Bench: Can Language Models Reason from Pathogenesis to Prescription over Real-World Clinical Cases?

    Oct 3, 2026Jirui Dai, Chenkai Zhang, Yan Jia +4Traditional Chinese MedicineClinical Language Model Evaluation

  20. Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

    Oct 2, 2026Samuel Lewis-Lim, Xingwei Tan, Mario Sanger +2Faithfulness of Language Model ReasoningEfficient Language Model Reasoning

  21. Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding

    Sep 30, 2026Guang Yang, Homa Hosseinmardi, Fengchen Liu +1LLM SycophancyLLM Reliability

  22. ACTR: Aligning Thoughts and Responses for Multilingual Safety in Reasoning LLMs

    Sep 29, 2026Xianhui Zhang, Jian Yu, Chengyu Xie +6Adversarial Attacks on LLMsLLM Safety Alignment