CoT Faithfulness
CoT: Chain-of-Thought
Overview
Chain-of-thought faithfulness studies whether a model actually uses its visible reasoning to reach an answer, rather than producing a plausible explanation after deciding. Researchers test this with counterfactual hints, edits or deletions of reasoning steps, causal activation patching, and probes of hidden states across settings such as math, medical question answering, and vision. Training approaches include rewards for causal dependence and sufficient evidence, preference learning, and structural constraints on shortcuts. A central challenge is that accuracy and plausible explanations do not establish faithfulness, while measurements vary by task and method and often transfer poorly across models or settings.
Latest papers
73 papers4 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.