CHALET: Cornell House Agent Learning Environment
Not on the map. Why?
Abstract (arXiv)
We present CHALET, a 3D house simulator with support for navigation and manipulation. CHALET includes 58 rooms and 10 house configuration, and allows to easily create new house and room layouts. CHALET supports a range of common household activities, including moving objects, toggling appliances, and placing objects inside closeable containers. The environment and actions available are designed to create a challenging domain to train and evaluate autonomous agents, including for tasks that combine language, vision, and planning in a dynamic environment.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 5; 2023: 5; 2024: 8; 2025: 2; 2026: 1.
38 papers.
Sort:
By area:
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
- 2022Habitat-Matterport 3D Semantics Datasetcited by 109
- 2023Octopus: Embodied Vision-Language Programmer from Environmental Feedbackcited by 73
- 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 36
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environmentscited by 32
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
26 more
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collectionscited by 13
- 2025Virtual Community: An Open World for Humans, Robots, and Societycited by 13
- 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challengescited by 12
- 2024LEGENT: Open Platform for Embodied Agentscited by 12
- 2021MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigationcited by 11
- 2023CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigationcited by 10
- 2021Are We There Yet? Learning to Localize in Embodied Instruction Followingcited by 7
- 2021Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scenecited by 7
- 2024A call for embodied AIcited by 7
- 2021Embodied AI-Driven Operation of Smart Cities: A Concise Reviewcited by 6
- 2021Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Methodcited by 4
- 2021UnrealROX+: An Improved Tool for Acquiring Synthetic Data from Virtual 3D Environmentscited by 3
- 2024Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptionscited by 3
- 2024Learning to Build by Building Your Own Instructionscited by 3
- 2021Deep Learning for Embodied Vision Navigation: A Surveycited by 2
- 2021Evaluating Continual Learning Algorithms by Generating 3D Virtual Environmentscited by 2
- 2021Messing Up 3D Virtual Environments: Transferable Adversarial 3D Objectscited by 2
- 2024Segment Any Object Model (SAOM): Real-to-Simulation Fine-Tuning Strategy for Multi-Class Multi-Instance Segmentationcited by 2
- 2025Vision Language Models Cannot Plan, but Can They Formalize?cited by 2
- 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behaviorcited by 2
- 2021Roominoes: Generating Novel 3D Floor Plans From Existing 3D Roomscited by 1
- 2023Multimodal Contextualized Plan Prediction for Embodied Task Completioncited by 1
- 2024Into the Unknown: Generating Geospatial Descriptions for New Environmentscited by 1
- 2023Core Challenges in Embodied Vision-Language Planningcited by 0
- 2024VR-based generation of photorealistic synthetic data for training hand-object tracking modelscited by 0
- 2026LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior26 Jun 2026
- 2025Vision Language Models Cannot Plan, but Can They Formalize?25 Sep 2025
- 2025Virtual Community: An Open World for Humans, Robots, and Society20 Aug 2025
- 2024Learning to Build by Building Your Own Instructions1 Oct 2024
- 2024Into the Unknown: Generating Geospatial Descriptions for New Environments28 Jun 2024
- 2024LEGENT: Open Platform for Embodied Agents28 Apr 2024
- 2024Segment Any Object Model (SAOM): Real-to-Simulation Fine-Tuning Strategy for Multi-Class Multi-Instance Segmentation16 Mar 2024
- 2024Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptions26 Feb 2024
- 2024A call for embodied AI6 Feb 2024
- 2024VR-based generation of photorealistic synthetic data for training hand-object tracking models31 Jan 2024
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments23 Jan 2024
- 2023Octopus: Embodied Vision-Language Programmer from Environmental Feedback12 Oct 2023
26 more
- 2023CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation17 Jun 2023
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May 2023
- 2023Multimodal Contextualized Plan Prediction for Embodied Task Completion10 May 2023
- 2023Core Challenges in Embodied Vision-Language Planning5 Apr 2023
- 2022Habitat-Matterport 3D Semantics Dataset11 Oct 2022
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections17 Jun 2022
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers19 May 2022
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation20 Mar 2022
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation5 Mar 2022
- 2021Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms10 Dec 2021
- 2021Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method28 Nov 2021
- 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challenges10 Nov 2021
- 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agents19 Oct 2021
- 2021Messing Up 3D Virtual Environments: Transferable Adversarial 3D Objects17 Sep 2021
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI16 Sep 2021
- 2021Evaluating Continual Learning Algorithms by Generating 3D Virtual Environments16 Sep 2021
- 2021Embodied AI-Driven Operation of Smart Cities: A Concise Review22 Aug 2021
- 2021Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene5 Aug 2021
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environments8 Jul 2021
- 2021Deep Learning for Embodied Vision Navigation: A Survey7 Jul 2021
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitat28 Jun 2021
- 2021Core Challenges in Embodied Vision-Language Planning26 Jun 2021
- 2021UnrealROX+: An Improved Tool for Acquiring Synthetic Data from Virtual 3D Environments23 Apr 2021
- 2021MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation21 Mar 2021
- 2021A Survey of Embodied AI: From Simulators to Research Tasks8 Mar 2021
- 2021Are We There Yet? Learning to Localize in Embodied Instruction Following9 Jan 2021
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
- 2024LEGENT: Open Platform for Embodied Agentscited by 12
- 2024LEGENT: Open Platform for Embodied Agents28 Apr 2024
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May 2023
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2022Habitat-Matterport 3D Semantics Datasetcited by 109
- 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 36
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environmentscited by 32
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collectionscited by 13
12 most cited of 32 All 32 (JSON)
- 2025Virtual Community: An Open World for Humans, Robots, and Society20 Aug 2025
- 2024Learning to Build by Building Your Own Instructions1 Oct 2024
- 2024Into the Unknown: Generating Geospatial Descriptions for New Environments28 Jun 2024
- 2024Segment Any Object Model (SAOM): Real-to-Simulation Fine-Tuning Strategy for Multi-Class Multi-Instance Segmentation16 Mar 2024
- 2024Where Do We Go from Here? Multi-scale Allocentric Relational Inference from Natural Spatial Descriptions26 Feb 2024
- 2024A call for embodied AI6 Feb 2024
- 2024VR-based generation of photorealistic synthetic data for training hand-object tracking models31 Jan 2024
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments23 Jan 2024
- 2023Multimodal Contextualized Plan Prediction for Embodied Task Completion10 May 2023
- 2023Core Challenges in Embodied Vision-Language Planning5 Apr 2023
- 2022Habitat-Matterport 3D Semantics Dataset11 Oct 2022
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections17 Jun 2022
12 newest of 32 All 32 (JSON)