cs.AIJun 4, 2026

Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization

Authors: Ayano HiranakaYa-Chuan HsuStefanos NikolaidisErdem BıyıkDaniel Seita

Abstract

AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action- or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting 90%90\% of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.

Explore similar work

CardsList
  1. AI Assistants Overassist

    Jul 23, 2026Verona Teo, Raghav Jain, Tobias Gerstenberg +1TutorsArtificial Intelligence Assistants

  2. Alignment has a Fantasia Problem

    Apr 23, 2026Nathanael Jo, Zoe De Simone, Mitchell Gordon +1Human-Ai InteractionArtificial Intelligence Alignment