mlsanityData to 14 Oct 2026

HoME: a Household Multimodal Environment

arXiv 1711.11017 ↗First posted 29 Nov 2017cs.AI cs.CL cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

We introduce HoME: a Household Multimodal Environment for artificial agents to learn from vision, audio, semantics, physics, and interaction with objects and other agents, all within a realistic context. HoME integrates over 45,000 diverse 3D house layouts based on the SUNCG dataset, a scale which may facilitate learning, generalization, and transfer. HoME is an open-source, OpenAI Gym-compatible platform extensible to tasks in reinforcement learning, language grounding, sound-based navigation, robotics, multi-agent learning, and more. We hope HoME better enables artificial agents to learn as humans do: in an interactive, multimodal, and richly contextualized setting.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2018: 2; 2019: 0; 2020: 0; 2021: 9; 2022: 1; 2023: 4; 2024: 3; 2025: 1.

20 papers.

Sort:

By area:

  1. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
  2. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  3. 2018Learning to Understand Goal Specifications by Modelling Rewardcited by 80
  4. 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Interventioncited by 77
  5. 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 38
  6. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environmentscited by 32
  7. 2021Deep Learning Based 3D Segmentation: A Surveycited by 30
  8. 2021Core Challenges in Embodied Vision-Language Planningcited by 30
  9. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  10. 2021Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agentscited by 19
  11. 2021Collaborative Visual Navigationcited by 18
  12. 2025LLM-Powered Decentralized Generative Agents with Adaptive Hierarchical Knowledge Graph for Cooperative Planningcited by 18
8 more
  1. 2021Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scenecited by 7
  2. 2023Advancing Drug Discovery with Enhanced Chemical Understanding via Asymmetric Contrastive Multimodal Learningcited by 5
  3. 2021Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Methodcited by 4
  4. 2021UnrealROX+: An Improved Tool for Acquiring Synthetic Data from Virtual 3D Environmentscited by 3
  5. 2021VECA : A Toolkit for Building Virtual Environments to Train and Test Human-like Agentscited by 1
  6. 2024Foundations of Multisensory Artificial Intelligencecited by 1
  7. 2023Core Challenges in Embodied Vision-Language Planningcited by 0
  8. 2024VR-based generation of photorealistic synthetic data for training hand-object tracking modelscited by 0