mlsanityData to 14 Oct 2026

When Robots Do the Chores: A Benchmark and Agent for Long-Horizon Household Task Execution

arXiv 2605.14504 ↗First posted 14 May 2026cs.AIcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Long-horizon household tasks demand robust high-level planning and sustained reasoning capabilities, which are largely overlooked by existing embodied AI benchmarks that emphasize short-horizon navigation or manipulation and rely on fixed task categories. We introduce LongAct, a benchmark designed to evaluate planning-level autonomy in long-horizon household tasks specified through free-form instructions. By abstracting away embodiment-specific low-level control, LongAct isolates high-level cognitive capabilities such as instruction understanding, dependency management, memory maintenance, and adaptive planning. We further propose HoloMind, a VLM-driven agent with a DAG-based long-horizon hierarchical planner, a Multimodal Spatial Memory for persistent world modeling, an Episodic Memory for experience reuse, and a global Critic for reflective supervision. Experiments with GPT-5 and Qwen3-VL models show that HoloMind substantially improves long-horizon performance while reducing reliance on model scale. Even top models achieve only 59% goal completion and 16% full-task success, underscoring the difficulty of LongAct and the need for stronger long-horizon planning in embodied agents.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 38 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

32 of 38 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2023Qwen Technical Reportcited by 3,344
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  8. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  9. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  10. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  11. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  12. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
20 more
  1. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  2. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  3. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
  4. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
  5. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  6. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  7. 2020Rearrangement: A Challenge for Embodied AIcited by 155
  8. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
  9. 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 133
  10. 2021FILM: Following Instructions in Language with Modular Methodscited by 121
  11. 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 94
  12. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  13. 2024RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version)cited by 69
  14. 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 65
  15. 2024LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agentscited by 51
  16. 2023Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agentscited by 33
  17. 2023Audio Visual Language Maps for Robot Navigationcited by 30
  18. 2024EPO: Hierarchical LLM Agents with Environment Preference Optimizationcited by 28
  19. 2025C-NAV: Towards Self-Evolving Continual Object Navigation in Open Worldcited by 9
  20. 2025FlowPlan: Zero-Shot Task Planning with LLM Flow Engineering for Robotic Instruction Followingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics
  2. 2026TGPO: Trace-Guided Policy Optimization for Robot Task Planning via Verifiable Subgoal Generation ↗
  3. 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systems
  4. 2026CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks
  5. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments
  6. 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks
  7. 2026Neurosymbolic Embodied Agents
  8. 2024Embodied Instruction Following in Unknown Environments