IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022
Not on the map. Why?
Abstract (arXiv)
Human intelligence has the remarkable ability to adapt to new tasks and environments quickly. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by following provided natural language instructions. To facilitate research in this direction, we propose IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. The primary goal of the competition is to approach the problem of how to develop interactive embodied agents that learn to solve a task while provided with grounded natural language instructions in a collaborative environment. Understanding the complexity of the challenge, we split it into sub-tasks to make it feasible for participants. This research challenge is naturally related, but not limited, to two fields of study that are highly relevant to the NeurIPS community: Natural Language Understanding and Generation (NLU/G) and Reinforcement Learning (RL). Therefore, the suggested challenge can bring two communities together to approach one of the crucial challenges in AI. Another critical aspect of the challenge is the dedication to perform a human-in-the-loop evaluation as a final evaluation for the agents developed by contestants.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 28 of its 59 references that are in the map. First posted on arXiv 27 May 2022.
Builds on
28 of 59 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
- 2020Recipes for building an open-domain chatbotcited by 593
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
16 more
- 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 84
- 2017Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learningcited by 77
- 2021Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questionscited by 63
- 2020ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)cited by 55
- 2020Imitating Interactive Intelligencecited by 55
- 2022Improving Intrinsic Exploration with Language Abstractionscited by 49
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2019Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Studycited by 40
- 2020Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learningcited by 32
- 2019Hierarchical Decision Making by Generating and Following Natural Language Instructionscited by 30
- 2017Iterative Policy Learning in End-to-End Trainable Task-Oriented Neural Dialog Modelscited by 26
- 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learnedcited by 26
- 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
- 2018Adversarial Learning of Task-Oriented Neural Dialog Modelscited by 17
- 2021NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environmentcited by 15
- 2019HIGhER : Improving instruction following with Hindsight Generation for Experience Replaycited by 13
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 4; 2025: 1.
14 papers.
Sort:
By area:
- 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solvingcited by 38
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2023Interactive Natural Language Processingcited by 31
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Datasetcited by 11
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understandingcited by 10
- 2022Learning to Solve Voxel Building Embodied Tasks from Pixels and Natural Language Instructionscited by 9
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
- 2025AmbiK: Dataset of Ambiguous Tasks in Kitchen Environmentcited by 8
- 2023When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solutioncited by 5
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requestscited by 4
- 2025AmbiK: Dataset of Ambiguous Tasks in Kitchen Environment4 Jun 2025
- 2024Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual Environments12 Jul 2024
- 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solving20 Feb 2024
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions9 Feb 2024
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests30 Jan 2024
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
- 2023Interactive Natural Language Processing22 May 2023
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution9 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023CB2: Collaborative Natural Language Interaction Research Platform14 Mar 2023
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset28 Feb 2023
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2023Interactive Natural Language Processingcited by 31
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructionscited by 13
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Datasetcited by 11
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understandingcited by 10
- 2022Learning to Solve Voxel Building Embodied Tasks from Pixels and Natural Language Instructionscited by 9
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Taskscited by 8
- 2025AmbiK: Dataset of Ambiguous Tasks in Kitchen Environmentcited by 8
- 2023When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solutioncited by 5
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requestscited by 4
- 2023CB2: Collaborative Natural Language Interaction Research Platformcited by 1
12 most cited of 13 All 13 (JSON)
- 2025AmbiK: Dataset of Ambiguous Tasks in Kitchen Environment4 Jun 2025
- 2024Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual Environments12 Jul 2024
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions9 Feb 2024
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests30 Jan 2024
- 2023BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks5 Dec 2023
- 2023Interactive Natural Language Processing22 May 2023
- 2023Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions18 May 2023
- 2023When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solution9 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023CB2: Collaborative Natural Language Interaction Research Platform14 Mar 2023
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset28 Feb 2023
- 2022Collecting Interactive Multi-modal Datasets for Grounded Language Understanding12 Nov 2022
12 newest of 13 All 13 (JSON)