cs.AINov 16, 2026

Right Reason, Wrong Advice: Evaluating Recourse in LLM Explanations of Denied Requests

Authors: Arunkumar V

Organizations: University College of Engineering, BIT Campus, Anna University, Tiruchirappalli, India

Abstract

Language models increasingly write the explanations people receive when a rule system denies their request. If several rules deny the request independently, an explanation can name a true reason and still leave the person denied after they fix it. We call the missing property recourse validity: changing what the explanation cites, without changing what was asked for, can flip the decision. We compute it exactly, and a hitting-set argument predicts from the policy alone when a correct reason fails. In six of seven rule systems ported from access control and US benefit eligibility, a single correct reason almost never gives recourse when several reasons apply. Across 20 LLMs, checks of whether the cited reasons are correct, computed or asked of an LLM judge, are close to chance at spotting this failure, as the argument predicts. A strong judge asked whether acting on the explanation would work does spot it. Stronger and reasoning models do better but still fail on many denials with four or more independent reasons. Asking for every rule helps every open model with room to improve. Explanations of eligibility decisions should be built from the decision function and judged by whether acting on them works.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Blind Refusal: Language Models Refuse to Help Users Evade Unjust, Absurd, and Illegitimate Rules

    Apr 3, 2026Cameron Pattison, Lorenzo Manuali, Seth LazarRefusal Behavior in Language ModelsRefusal Mechanisms in Language Models

  2. Commit or Abstain? System One Decision Models, LLMs, and Missing Legal Authority

    Oct 21, 2026M. Mikail DemirLegal Citation VerificationLLM Abstention