MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
Not on the map. Why?
Abstract (arXiv)
Theory-of-Mind (ToM) reasoning enables embodied agents to understand human beliefs, goals, and intentions, but existing benchmarks mainly evaluate this ability through offline question answering or scenario-level action prediction. MindPower advances embodied ToM by introducing robot-centric reasoning from perception to action; however, it does not evaluate whether an agent can continuously interact with a changing environment and intervene only when assistance is needed. Building on MindPower, we introduce the MindHelper Challenge, which extends embodied ToM evaluation to real-time closed-loop precision intervention. An agent must continuously observe the environment, maintain actor-specific beliefs, identify when a human requires assistance, generate executable actions, and remain silent when intervention is unnecessary. We further propose MindClaw, a simple yet effective Claw-style framework that integrates an actor-specific Belief Table, embodied cognitive skills, and a Trigger-based cognitive dispatcher. Experiments show that MindClaw achieves 36.63% precise intervention rate and 14.36% task accuracy, substantially outperforming direct VLM baselines, whose corresponding results remain below 12.05% and 3.80%.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
31 of 42 references.
References · 31
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2020ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulationcited by 249
- 2023Understanding Social Reasoning in Language Models with Language Modelscited by 166
- 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactionscited by 162
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 84
- 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 70
- 2023HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Modelscited by 61
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 52
19 more
- 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
- 2024Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoningcited by 30
- 2026RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Taskscited by 30
- 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
- 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 19
- 2025SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoningcited by 18
- 2025SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactionscited by 16
- 2025MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mindcited by 11
- 2026AEROS: A Single-Agent Operating Architecture with Embodied Capability Modulescited by 6
- 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agentscited by 6
- 2024BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mindcited by 5
- 2024CHARTOM: A Visual Theory-of-Mind Benchmark for LLMs on Misleading Chartscited by 5
- 2025From Black Boxes to Transparent Minds: Evaluating and Enhancing the Theory of Mind in Multimodal Large Language Modelscited by 5
- 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agentscited by 4
- 2026StreamingClaw Technical Reportcited by 4
- 2026ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interactioncited by 3
- 2026EnactToM: An Evolving Benchmark for Functional Theory of Mind in Embodied Agentscited by 3
- 2025Modeling the Mental World for Embodied AI: A Comprehensive Reviewcited by 1
- 2026OpenGo: An OpenClaw-Based Robotic Dog with Real-Time Skill Switchingcited by 1
Built on by
Not cited yet.