mlsanityData to 14 Oct 2026

Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization

arXiv 2606.05602 ↗First posted 4 Jun 2026cs.AI cs.HC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action- or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting 90% of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

18 of 44 references.

References · 18

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2016Layer Normalizationcited by 5,669
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  5. 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
  6. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
  7. 2015Deep Knowledge Tracingcited by 332
  8. 2018Shared Autonomy via Deep Reinforcement Learningcited by 66
  9. 2018Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behaviorcited by 30
  10. 2024Learning to Cooperate with Humans using Generative Agentscited by 24
  11. 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
  12. 2022Assistive Teaching of Motor Control Tasks to Humanscited by 8
6 more
  1. 2024Computational Teaching for Driving via Multi-Task Imitation Learningcited by 6
  2. 2018Hierarchical Expertise-Level Modeling for User Specific Robot-Behavior Explanationscited by 4
  3. 2019Robots that Take Advantage of Human Trustcited by 3
  4. 2025The Invisible Mentor: Inferring User Actions from Screen Recordings to Recommend Better Workflowscited by 3
  5. 2025Timing the Message: Language-Based Notifications for Time-Critical Assistive Settingscited by 2
  6. 2025Integrating Field of View in Human-Aware Collaborative Planningcited by 1

Built on by

Not cited yet.