CraftAssist: A Framework for Dialogue-enabled Interactive Agents
Not on the map. Why?
Abstract (arXiv)
This paper describes an implementation of a bot assistant in Minecraft, and the tools and platform allowing players to interact with the bot and to record those interactions. The purpose of building such an assistant is to facilitate the study of agents that can complete tasks specified by dialogue, and eventually, to learn from dialogue interactions.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 5; 2024: 4; 2025: 3; 2026: 3.
28 papers.
Sort:
By area:
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 32
- 2021The MineRL BASALT Competition on Learning from Human Feedbackcited by 24
- 2023Creative Agents: Empowering Agents with Imagination for Creative Taskscited by 24
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
- 2024S-Agents: Self-organizing Agents in Open-ended Environmentscited by 22
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2021NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environmentcited by 15
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competitioncited by 15
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2025AssistanceZero: Scalably Solving Assistance Gamescited by 10
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
16 more
- 2022The slurk Interaction Server Framework: Better Data for Better Dialog Modelscited by 7
- 2024Large Language Models as Minecraft Agentscited by 7
- 2022Retrospective on the 2021 BASALT Competition on Learning from Human Feedbackcited by 5
- 2024A LLM Benchmark based on the Minecraft Builder Dialog Agent Taskcited by 4
- 2021droidlet: modular, heterogenous, multi-modal agentscited by 2
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended Worldcited by 2
- 2021Modular Procedural Generation for Voxel Mapscited by 1
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agentscited by 1
- 2025Enabling Rapid Shared Human-AI Mental Model Alignment via the After-Action Reviewcited by 1
- 2026Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraftcited by 1
- 2021Mind Reading at Work: Cooperation without common groundcited by 0
- 2021Using reinforcement learning to design an AI assistantfor a satisfying co-op experiencecited by 0
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learningcited by 0
- 2021Feudal Reinforcement Learning by Reading Manualscited by 0
- 2026Self-Guided Plan Extraction for Instruction-Following Tasks with Goal-Conditional Reinforcement Learningcited by 0
- 2026MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraftcited by 0
- 2026MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraft28 Aug 2026
- 2026Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraft27 Apr 2026
- 2026Self-Guided Plan Extraction for Instruction-Following Tasks with Goal-Conditional Reinforcement Learning22 Apr 2026
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended World17 May 2025
- 2025AssistanceZero: Scalably Solving Assistance Games9 Apr 2025
- 2025Enabling Rapid Shared Human-AI Mental Model Alignment via the After-Action Review25 Mar 2025
- 2024A LLM Benchmark based on the Minecraft Builder Dialog Agent Task17 Jul 2024
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents12 Jul 2024
- 2024Large Language Models as Minecraft Agents13 Feb 2024
- 2024S-Agents: Self-organizing Agents in Open-ended Environments7 Feb 2024
- 2023Creative Agents: Empowering Agents with Imagination for Creative Tasks5 Dec 2023
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
16 more
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition23 Mar 2023
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun 2022
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 20215 May 2022
- 2022Retrospective on the 2021 BASALT Competition on Learning from Human Feedback14 Apr 2022
- 2022The slurk Interaction Server Framework: Better Data for Better Dialog Models2 Feb 2022
- 2021NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment13 Oct 2021
- 2021Feudal Reinforcement Learning by Reading Manuals13 Oct 2021
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learning20 Jul 2021
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environments8 Jul 2021
- 2021The MineRL BASALT Competition on Learning from Human Feedback5 Jul 2021
- 2021Using reinforcement learning to design an AI assistantfor a satisfying co-op experience7 May 2021
- 2021Mind Reading at Work: Cooperation without common ground5 May 2021
- 2021Modular Procedural Generation for Voxel Maps18 Apr 2021
- 2021droidlet: modular, heterogenous, multi-modal agents25 Jan 2021
- 2023Creative Agents: Empowering Agents with Imagination for Creative Taskscited by 24
- 2024S-Agents: Self-organizing Agents in Open-ended Environmentscited by 22
- 2024Large Language Models as Minecraft Agentscited by 7
- 2024A LLM Benchmark based on the Minecraft Builder Dialog Agent Taskcited by 4
- 2026Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraftcited by 1
- 2026Can Current Agents Close the Discovery-to-Application Gap? A Case Study in Minecraft27 Apr 2026
- 2024A LLM Benchmark based on the Minecraft Builder Dialog Agent Task17 Jul 2024
- 2024Large Language Models as Minecraft Agents13 Feb 2024
- 2024S-Agents: Self-organizing Agents in Open-ended Environments7 Feb 2024
- 2023Creative Agents: Empowering Agents with Imagination for Creative Tasks5 Dec 2023
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competitioncited by 15
- 2025AssistanceZero: Scalably Solving Assistance Gamescited by 10
- 2022Retrospective on the 2021 BASALT Competition on Learning from Human Feedbackcited by 5
- 2025Enabling Rapid Shared Human-AI Mental Model Alignment via the After-Action Reviewcited by 1
- 2025AssistanceZero: Scalably Solving Assistance Games9 Apr 2025
- 2025Enabling Rapid Shared Human-AI Mental Model Alignment via the After-Action Review25 Mar 2025
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition23 Mar 2023
- 2022Retrospective on the 2021 BASALT Competition on Learning from Human Feedback14 Apr 2022
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 32
- 2021The MineRL BASALT Competition on Learning from Human Feedbackcited by 24
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2021NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environmentcited by 15
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
- 2022The slurk Interaction Server Framework: Better Data for Better Dialog Modelscited by 7
- 2021droidlet: modular, heterogenous, multi-modal agentscited by 2
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended Worldcited by 2
- 2021Modular Procedural Generation for Voxel Mapscited by 1
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agentscited by 1
12 most cited of 17 All 17 (JSON)
- 2026MineCEraft: Evaluating Language Models as Construction Engineers in the World of Minecraft28 Aug 2026
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended World17 May 2025
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents12 Jul 2024
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 20215 May 2022
- 2022The slurk Interaction Server Framework: Better Data for Better Dialog Models2 Feb 2022
- 2021NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment13 Oct 2021
- 2021Feudal Reinforcement Learning by Reading Manuals13 Oct 2021
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learning20 Jul 2021
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environments8 Jul 2021
12 newest of 17 All 17 (JSON)