MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
Not on the map. Why?
Abstract (arXiv)
We present MINOS, a simulator designed to support the development of multisensory models for goal-directed navigation in complex indoor environments. The simulator leverages large datasets of complex 3D environments and supports flexible configuration of multimodal sensor suites. We use MINOS to benchmark deep-learning-based navigation methods, to analyze the influence of environmental complexity on navigation performance, and to carry out a controlled study of multimodality in sensorimotor learning. The experiments show that current deep reinforcement learning approaches fail in large realistic environments. The experiments also indicate that multimodality is beneficial in learning to navigate cluttered scenes. MINOS is released open-source to the research community at http://minosworld.org . A video that shows MINOS can be found at https://youtu.be/c0mL9K64q84
Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 2; 2019: 0; 2020: 0; 2021: 18; 2022: 21; 2023: 9; 2024: 8; 2025: 4; 2026: 4.
66 papers.
Sort:
By area:
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 170
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 124
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2022Navigating to Objects in the Real Worldcited by 106
38 more
- 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
- 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Interventioncited by 77
- 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 67
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 54
- 2022Retrospectives on the Embodied AI Workshopcited by 46
- 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 38
- 2022Uncertainty-driven Planner for Exploration and Navigationcited by 33
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environmentscited by 32
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2022Cross-View Cross-Scene Multi-View Crowd Countingcited by 28
- 2021The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigationcited by 27
- 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 27
- 2021Megaverse: Simulating Embodied Agents at One Million Experiences per Secondcited by 20
- 2021Large Batch Simulation for Deep Reinforcement Learningcited by 19
- 2022Distributed Reinforcement Learning for Robot Teams: A Reviewcited by 16
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigationcited by 15
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collectionscited by 13
- 2025Virtual Community: An Open World for Humans, Robots, and Societycited by 13
- 2021MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigationcited by 11
- 2022Online Learning of Reusable Abstract Models for Object Goal Navigationcited by 9
- 2024Anything in Any Scene: Photorealistic Video Object Insertioncited by 9
- 2021360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimationcited by 8
- 2022SimVQA: Exploring Simulated Environments for Visual Question Answeringcited by 8
- 2021Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scenecited by 7
- 2021Embodied AI-Driven Operation of Smart Cities: A Concise Reviewcited by 6
- 2022GraphMapper: Efficient Visual Navigation by Scene Graph Generationcited by 6
- 2023Modality-invariant Visual Odometry for Embodied Visioncited by 6
- 2023360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perceptioncited by 5
- 2022360-MLC: Multi-view Layout Consistency for Self-training and Hyper-parameter Tuningcited by 4
- 2022Self-Supervised Object Goal Navigation with In-Situ Finetuningcited by 4
- 2025VL-Nav: Neuro-Symbolic Reasoning-based Vision-Language Navigationcited by 4
- 2025VPN: Visual Prompt Navigationcited by 4
- 2025TongSIM: A General Platform for Simulating Intelligent Machinescited by 4
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Researchcited by 4
- 2021Robust 360-8PA: Redesigning The Normalized 8-point Algorithm for 360-FoV Imagescited by 3
50 most cited of 66 All 66 (JSON)
- 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents9 Aug 2026
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Research7 Jul 2026
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026Insect-inspired Visual Point-goal Navigation23 Jan 2026
- 2025TongSIM: A General Platform for Simulating Intelligent Machines23 Dec 2025
- 2025Virtual Community: An Open World for Humans, Robots, and Society20 Aug 2025
- 2025VPN: Visual Prompt Navigation3 Aug 2025
- 2025VL-Nav: Neuro-Symbolic Reasoning-based Vision-Language Navigation2 Feb 2025
- 2024TANGO: Training-free Embodied AI Agents for Open-world Tasks5 Dec 2024
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2024Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation21 Mar 2024
- 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation25 Feb 2024
38 more
- 2024VR-based generation of photorealistic synthetic data for training hand-object tracking models31 Jan 2024
- 2024Anything in Any Scene: Photorealistic Video Object Insertion30 Jan 2024
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments23 Jan 2024
- 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan 2024
- 2023360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception26 Dec 2023
- 2023A Unified Simulation Framework for Visual and Behavioral Fidelity in Crowd Analysis5 Dec 2023
- 2023Learning to Terminate in Object Navigation28 Sep 2023
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers26 May 2023
- 2023L-SA: Learning Under-Explored Targets in Multi-Target Reinforcement Learning23 May 2023
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May 2023
- 2023Modality-invariant Visual Odometry for Embodied Vision29 Apr 2023
- 2023Core Challenges in Embodied Vision-Language Planning5 Apr 2023
- 2023Analyzing Effects of Fake Training Data on the Performance of Deep Learning Systems2 Mar 2023
- 2022Self-Supervised Object Goal Navigation with In-Situ Finetuning9 Dec 2022
- 2022Navigating to Objects in the Real World2 Dec 2022
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracing6 Nov 2022
- 2022360-MLC: Multi-view Layout Consistency for Self-training and Hyper-parameter Tuning24 Oct 2022
- 2022Retrospectives on the Embodied AI Workshop13 Oct 2022
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action10 Jul 2022
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections17 Jun 2022
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers19 May 2022
- 2022GraphMapper: Efficient Visual Navigation by Scene Graph Generation17 May 2022
- 2022Cross-View Cross-Scene Multi-View Crowd Counting3 May 2022
- 2022Distributed Reinforcement Learning for Robot Teams: A Review7 Apr 2022
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale7 Apr 2022
- 2022SimVQA: Exploring Simulated Environments for Visual Question Answering31 Mar 2022
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation20 Mar 2022
- 2022Online Learning of Reusable Abstract Models for Object Goal Navigation4 Mar 2022
- 2022Uncertainty-driven Planner for Exploration and Navigation24 Feb 2022
- 2022Ditto: Building Digital Twins of Articulated Objects from Interaction16 Feb 2022
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigation5 Feb 2022
- 2022Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation2 Feb 2022
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learning25 Jan 2022
- 2022Test and Evaluation of Quadrupedal Walking Gaits through Sim2Real Gap Quantification4 Jan 2022
- 2021Online Grounding of Symbolic Planning Domains in Unknown Environments18 Dec 2021
- 2021360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimation12 Dec 2021
- 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation19 Nov 2021
- 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agents19 Oct 2021
50 newest of 66 All 66 (JSON)
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Interventioncited by 77
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale7 Apr 2022
- 2018Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention10 Dec 2018
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation25 Nov 2018
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 170
- 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 27
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
- 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 119
- 2022Navigating to Objects in the Real Worldcited by 106
- 2021ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentationcited by 93
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
- 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 67
12 most cited of 58 All 58 (JSON)
- 2026360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents9 Aug 2026
- 2026SPEAR: A Simulator for Photorealistic Embodied AI Research7 Jul 2026
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026Insect-inspired Visual Point-goal Navigation23 Jan 2026
- 2025Virtual Community: An Open World for Humans, Robots, and Society20 Aug 2025
- 2025VPN: Visual Prompt Navigation3 Aug 2025
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2024Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation21 Mar 2024
- 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation25 Feb 2024
- 2024VR-based generation of photorealistic synthetic data for training hand-object tracking models31 Jan 2024
- 2024Anything in Any Scene: Photorealistic Video Object Insertion30 Jan 2024
- 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments23 Jan 2024
12 newest of 58 All 58 (JSON)