OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
The choice of action spaces is a critical yet unresolved challenge in developing capable, end-to-end trainable agents. This paper first presents a large-scale, systematic comparison of prominent abstracted action spaces and tokenizers for Vision-Language-Action (VLA) or hierarchical agent models in the open-ended Minecraft. Our analysis reveals that no single action space is universally optimal; instead, the most effective abstraction is highly task-dependent, creating a dilemma for building generalist agents. To resolve this, we introduce Chain of Action (CoA), a novel framework that unifies high-level planning and low-level control within a single, monolithic VLA model. CoA treats an abstracted action not as a command for a separate policy, but as an intermediate reasoning step--akin to a chain of thought--that guides the generation of the final, executable action. Furthermore, we demonstrate that an All-in-One agent trained on a diverse mixture of action spaces using the CoA paradigm learns a more robust and generalizable policy. This unified agent achieves a new state-of-the-art, improving the overall task success rate over strong, specialized baselines. To foster reproducible research, we release the OpenHA (Open Hierarchical Agents) suite, which includes our comprehensive benchmark of over 800 distinct tasks, curated datasets, source code, and all pretrained model checkpoints at https://github.com/CraftJarvis/OpenHA
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 65 references that are in the map. First posted on arXiv 13 Sep 2025.
Builds on
57 of 65 references.
Closest ancestors · 5
Same direction, newest first
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr
- 2024OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents27 Jun
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models10 Nov
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Models25 May
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun
Other references · 52
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Qwen Technical Reportcited by 3,273
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
38 more
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2025Seed1.5-VL Technical Reportcited by 367
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2022Behavior Transformers: Cloning k modes with one stonecited by 299
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
- 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 210
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 205
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 183
- 2023RT-Trajectory: Robotic Task Generalization via Hindsight Trajectory Sketchescited by 131
- 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 130
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2023ProAgent: Building Proactive Cooperative Agents with Large Language Modelscited by 97
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2023STEVE-1: A Generative Model for Text-to-Behavior in Minecraftcited by 95
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
- 2024RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generationcited by 75
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 72
- 2023GROOT: Learning to Follow Instructions by Watching Gameplay Videoscited by 42
- 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 27
- 2024ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Promptingcited by 20
- 2025VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoocited by 20
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 7.
9 papers.
- 2025Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agentscited by 23
- 2026MAIN-VLA: Modeling Abstraction of Intention and eNvironment for Vision-Language-Action Modelscited by 2
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 2
- 2026MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?cited by 2
- 2026MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraftcited by 1
- 2025Training One Model to Master Cross-Level Agentic Actions via Reinforcement Learningcited by 0
- 2026GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agentscited by 0
- 2026Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibrationcited by 0
- 2026GameWAM: A World Action Model for Video Gamescited by 0
- 2026GameWAM: A World Action Model for Video Games25 Aug 2026
- 2026MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraft31 Jul 2026
- 2026MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?1 Jun 2026
- 2026Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibration29 May 2026
- 2026GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents18 May 2026
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse11 May 2026
- 2026MAIN-VLA: Modeling Abstraction of Intention and eNvironment for Vision-Language-Action Models2 Feb 2026
- 2025Training One Model to Master Cross-Level Agentic Actions via Reinforcement Learning10 Dec 2025
- 2025Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agents27 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraft
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy
- 2024STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft
- 2024Odyssey: Empowering Minecraft Agents with Open-World Skills
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
- 2025CrafterDojo: A Suite of Foundation Models for Building Open-Ended Embodied Agents in Crafter
- 2025Parallelized Planning-Acting for Efficient LLM-based Multi-Agent Systems in Minecraft
- 2023See and Think: Embodied Agent in Virtual Environment