FOM-Nav: Frontier-Object Maps for Object Goal Navigation
Not on the map. Why?
Abstract (arXiv)
This paper addresses the Object Goal Navigation problem, where a robot must efficiently find a target object in an unknown environment. Existing implicit memory-based methods struggle with long-term memory retention and planning, while explicit map-based approaches lack rich semantic information. To address these challenges, we propose FOM-Nav, a modular framework that enhances exploration efficiency through Frontier-Object Maps and vision-language models. Our Frontier-Object Maps are built online and jointly encode spatial frontiers and fine-grained object information. Using this representation, a vision-language model performs multimodal scene understanding and high-level goal prediction, which is executed by a low-level planner for efficient trajectory generation. To train FOM-Nav, we automatically construct large-scale navigation datasets from real-world scanned environments. Extensive experiments validate the effectiveness of our model design and constructed dataset. FOM-Nav achieves state-of-the-art performance on the MP3D and HM3D benchmarks, particularly in navigation efficiency metric SPL, and yields promising results on a real robot.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
53 of 69 references.
References · 53
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
38 more
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2023Vision Transformers Need Registerscited by 844
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2022Visual Language Maps for Robot Navigationcited by 362
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2023Scaling Open-Vocabulary Object Detectioncited by 335
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
- 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
- 2022Habitat-Matterport 3D Semantics Datasetcited by 109
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 96
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 72
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 68
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 50
- 20223D-Aware Object Goal Navigation via Simultaneous Exploration and Identificationcited by 46
- 2022Stubborn: A Strong Baseline for Indoor Object Navigationcited by 31
- 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigationcited by 25
- 2022PEANUT: Predicting and Navigating to Unseen Targetscited by 22
- 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
- 2022Navigating to Objects in Unseen Environments by Distance Predictioncited by 15
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Balancing Performance and Efficiency in Zero-shot Robotic Navigation
- 2025osmAG-LLM: Zero-Shot Open-Vocabulary Object Navigation via Semantic Maps and Large Language Models Reasoning
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers
- 2025EfficientNav: Towards On-Device Object-Goal Navigation with Navigation Map Caching and Retrieval
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 2024Open Scene Graphs for Open World Object-Goal Navigation
- 2024Cognitive Planning for Object Goal Navigation using Generative AI Models