Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization
Not on the map. Why?
Abstract (arXiv)
AI assistants in human-AI collaboration often correct suboptimal human actions through behavioral feedback (e.g., alerts or steering-wheel nudges in assistive driving). Such interventions can mitigate immediate errors, but long-term improvement requires addressing the underlying misconceptions that cause repeated mistakes. We introduce SENSEI, a framework that infers user misconceptions from interaction behavior and provides targeted, minimal yet sufficient suggestions to correct them. Our approach departs from action- or trajectory-level interventions by operating over a structured knowledge representation to localize and correct the sources of erroneous behavior. Across three long-horizon tasks with diverse misconceptions and corresponding behaviors, SENSEI demonstrates zero-shot compositional generalization, disentangling multiple overlapping misconceptions despite training only on single-misconception cases. A user study further shows that our method identifies real human misconceptions and provides effective guidance that improves long-horizon task performance, successfully correcting 90% of student misconceptions. Code and project page are available at https://misoshiruseijin.github.io/SENSEI/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 44 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
18 of 44 references.
References · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2016Layer Normalizationcited by 5,669
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
- 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
- 2015Deep Knowledge Tracingcited by 332
- 2018Shared Autonomy via Deep Reinforcement Learningcited by 66
- 2018Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behaviorcited by 30
- 2024Learning to Cooperate with Humans using Generative Agentscited by 24
- 2023InteRACT: Transformer Models for Human Intent Prediction Conditioned on Robot Actionscited by 11
- 2022Assistive Teaching of Motor Control Tasks to Humanscited by 8
6 more
- 2024Computational Teaching for Driving via Multi-Task Imitation Learningcited by 6
- 2018Hierarchical Expertise-Level Modeling for User Specific Robot-Behavior Explanationscited by 4
- 2019Robots that Take Advantage of Human Trustcited by 3
- 2025The Invisible Mentor: Inferring User Actions from Screen Recordings to Recommend Better Workflowscited by 3
- 2025Timing the Message: Language-Based Notifications for Time-Critical Assistive Settingscited by 2
- 2025Integrating Field of View in Human-Aware Collaborative Planningcited by 1
Built on by
Not cited yet.