mlsanityData to 7 Oct 2026

OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft

arXiv 2509.13347 ↗First posted 13 Sep 2025cs.AIcited by 9

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

The choice of action spaces is a critical yet unresolved challenge in developing capable, end-to-end trainable agents. This paper first presents a large-scale, systematic comparison of prominent abstracted action spaces and tokenizers for Vision-Language-Action (VLA) or hierarchical agent models in the open-ended Minecraft. Our analysis reveals that no single action space is universally optimal; instead, the most effective abstraction is highly task-dependent, creating a dilemma for building generalist agents. To resolve this, we introduce Chain of Action (CoA), a novel framework that unifies high-level planning and low-level control within a single, monolithic VLA model. CoA treats an abstracted action not as a command for a separate policy, but as an intermediate reasoning step--akin to a chain of thought--that guides the generation of the final, executable action. Furthermore, we demonstrate that an All-in-One agent trained on a diverse mixture of action spaces using the CoA paradigm learns a more robust and generalizable policy. This unified agent achieves a new state-of-the-art, improving the overall task success rate over strong, specialized baselines. To foster reproducible research, we release the OpenHA (Open Hierarchical Agents) suite, which includes our comprehensive benchmark of over 800 distinct tasks, curated datasets, source code, and all pretrained model checkpoints at https://github.com/CraftJarvis/OpenHA

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 65 references that are in the map. First posted on arXiv 13 Sep 2025.

Builds on

57 of 65 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr
  2. 2024OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents27 Jun
  3. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models10 Nov
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May
  5. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun

Other references · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2025Qwen3 Technical Reportcited by 8,195
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2023Qwen Technical Reportcited by 3,273
  11. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  12. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
38 more
  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  5. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  10. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  11. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  12. 2025Seed1.5-VL Technical Reportcited by 367
  13. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  14. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
  15. 2022Behavior Transformers: Cloning k modes with one stonecited by 299
  16. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  17. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  18. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
  19. 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 210
  20. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
  21. 2024RT-H: Action Hierarchies Using Languagecited by 204
  22. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  23. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
  24. 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
  25. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
  26. 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
  27. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  28. 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
  29. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  30. 2023STEVE-1: A Generative Model for Text-to-Behavior in Minecraftcited by 95
  31. 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
  32. 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generationcited by 75
  33. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
  34. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 72
  35. 2023GROOT: Learning to Follow Instructions by Watching Gameplay Videoscited by 42
  36. 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 27
  37. 2024ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Promptingcited by 20
  38. 2025VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoocited by 20

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraft
  2. 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy
  3. 2024STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft
  4. 2024Odyssey: Empowering Minecraft Agents with Open-World Skills
  5. 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
  6. 2025CrafterDojo: A Suite of Foundation Models for Building Open-Ended Embodied Agents in Crafter
  7. 2025Parallelized Planning-Acting for Efficient LLM-based Multi-Agent Systems in Minecraft
  8. 2023See and Think: Embodied Agent in Virtual Environment