mlsanityData to 7 Oct 2026

MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention

arXiv 2606.01063 ↗First posted 31 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Theory-of-Mind (ToM) reasoning enables embodied agents to understand human beliefs, goals, and intentions, but existing benchmarks mainly evaluate this ability through offline question answering or scenario-level action prediction. MindPower advances embodied ToM by introducing robot-centric reasoning from perception to action; however, it does not evaluate whether an agent can continuously interact with a changing environment and intervene only when assistance is needed. Building on MindPower, we introduce the MindHelper Challenge, which extends embodied ToM evaluation to real-time closed-loop precision intervention. An agent must continuously observe the environment, maintain actor-specific beliefs, identify when a human requires assistance, generate executable actions, and remain silent when intervention is unnecessary. We further propose MindClaw, a simple yet effective Claw-style framework that integrates an actor-specific Belief Table, embodied cognitive skills, and a Trigger-based cognitive dispatcher. Experiments show that MindClaw achieves 36.63% precise intervention rate and 14.36% task accuracy, substantially outperforming direct VLM baselines, whose corresponding results remain below 12.05% and 3.80%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

31 of 42 references.

References · 31

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  3. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  4. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  5. 2020ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulationcited by 249
  6. 2023Understanding Social Reasoning in Language Models with Language Modelscited by 166
  7. 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactionscited by 162
  8. 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 84
  9. 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 70
  10. 2023HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Modelscited by 61
  11. 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
  12. 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 52
19 more
  1. 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
  2. 2024Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoningcited by 30
  3. 2026RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Taskscited by 30
  4. 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
  5. 2026VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twicecited by 19
  6. 2025SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoningcited by 18
  7. 2025SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactionscited by 16
  8. 2025MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mindcited by 11
  9. 2026AEROS: A Single-Agent Operating Architecture with Embodied Capability Modulescited by 6
  10. 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agentscited by 6
  11. 2024BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mindcited by 5
  12. 2024CHARTOM: A Visual Theory-of-Mind Benchmark for LLMs on Misleading Chartscited by 5
  13. 2025From Black Boxes to Transparent Minds: Evaluating and Enhancing the Theory of Mind in Multimodal Large Language Modelscited by 5
  14. 2025MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agentscited by 4
  15. 2026StreamingClaw Technical Reportcited by 4
  16. 2026ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interactioncited by 3
  17. 2026EnactToM: An Evolving Benchmark for Functional Theory of Mind in Embodied Agentscited by 3
  18. 2025Modeling the Mental World for Embodied AI: A Comprehensive Reviewcited by 1
  19. 2026OpenGo: An OpenClaw-Based Robotic Dog with Real-Time Skill Switchingcited by 1

Built on by

Not cited yet.