NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment
Not on the map. Why?
Abstract (arXiv)
Human intelligence has the remarkable ability to adapt to new tasks and environments quickly. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by following provided natural language instructions. To facilitate research in this direction, we propose IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. The primary goal of the competition is to approach the problem of how to build interactive agents that learn to solve a task while provided with grounded natural language instructions in a collaborative environment. Understanding the complexity of the challenge, we split it into sub-tasks to make it feasible for participants. This research challenge is naturally related, but not limited, to two fields of study that are highly relevant to the NeurIPS community: Natural Language Understanding and Generation (NLU/G) and Reinforcement Learning (RL). Therefore, the suggested challenge can bring two communities together to approach one of the important challenges in AI. Another important aspect of the challenge is the dedication to perform a human-in-the-loop evaluation as a final evaluation for the agents developed by contestants.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 34 of its 81 references that are in the map. First posted on arXiv 13 Oct 2021.
Builds on
34 of 81 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 786
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2020Recipes for building an open-domain chatbotcited by 593
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
- 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
22 more
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 115
- 2017Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learningcited by 77
- 2021Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questionscited by 63
- 2020ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)cited by 58
- 2017RLlib: Abstractions for Distributed Reinforcement Learningcited by 54
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2015Program Synthesis using Natural Languagecited by 41
- 2019Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Studycited by 40
- 2020Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learningcited by 32
- 2019Hierarchical Decision Making by Generating and Following Natural Language Instructionscited by 30
- 2019ConvLab: Multi-Domain End-to-End Dialog System Platformcited by 29
- 2019CraftAssist: A Framework for Dialogue-enabled Interactive Agentscited by 28
- 2017Iterative Policy Learning in End-to-End Trainable Task-Oriented Neural Dialog Modelscited by 26
- 2019The MineRL 2019 Competition on Sample Efficient Reinforcement Learning using Human Priorscited by 26
- 2019The Eighth Dialog System Technology Challengecited by 25
- 2020An Imitation Game for Learning Semantic Parsers from User Interactioncited by 23
- 2017Iris: A Conversational Agent for Complex Taskscited by 22
- 2019Interactive Language Learning by Question Answeringcited by 19
- 2018Adversarial Learning of Task-Oriented Neural Dialog Modelscited by 17
- 2019Why Build an Assistant in Minecraft?cited by 14
- 2019HIGhER : Improving instruction following with Hindsight Generation for Experience Replaycited by 13
- 2019SIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platformcited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 5; 2024: 2; 2025: 0; 2026: 1.
15 papers.
Sort:
By area:
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 32
- 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learnedcited by 26
- 2024S-Agents: Self-organizing Agents in Open-ended Environmentscited by 22
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competitioncited by 15
- 2022IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022cited by 14
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Datasetcited by 11
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understandingcited by 10
- 2022IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agentscited by 9
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
- 2021Towards Interactive Language Modelingcited by 4
- 20262.5-D Decomposition for LLM-Based Spatial Construction8 May 2026
- 2024Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual Environments12 Jul 2024
- 2024S-Agents: Self-organizing Agents in Open-ended Environments7 Feb 2024
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition23 Mar 2023
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset28 Feb 2023
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understanding12 Nov 2022
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun 2022
- 2022IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agents31 May 2022
- 2022IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 202227 May 2022
3 more
- 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learned17 Feb 2022
- 2021Towards Interactive Language Modeling14 Dec 2021
- 2021Learning to Guide and to Be Guided in the Architect-Builder Problem14 Dec 2021
- 2024S-Agents: Self-organizing Agents in Open-ended Environmentscited by 22
- 20262.5-D Decomposition for LLM-Based Spatial Constructioncited by 0
- 20262.5-D Decomposition for LLM-Based Spatial Construction8 May 2026
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 32
- 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learnedcited by 26
- 2022IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022cited by 14
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Datasetcited by 11
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understandingcited by 10
- 2022IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agentscited by 9
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
- 2021Towards Interactive Language Modelingcited by 4
- 2021Learning to Guide and to Be Guided in the Architect-Builder Problemcited by 3
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset28 Feb 2023
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understanding12 Nov 2022
- 2022IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agents31 May 2022
- 2022IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 202227 May 2022
- 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learned17 Feb 2022
- 2021Towards Interactive Language Modeling14 Dec 2021
- 2021Learning to Guide and to Be Guided in the Architect-Builder Problem14 Dec 2021