PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Embodied visual navigation, where an agent perceives a complex environment and acts to reach a goal from raw sensory input, underpins a wide range of applications such as household service robotics, assistive robotics, and large-scale autonomous exploration. However, recent attempts to unify vision-and-language navigation (VLN) and object goal navigation (ObjNav) remain at the level of architectural fusion, mixed-task training, and large vision-language pretraining, without examining whether independently trained vision and language encoders may already share a common semantic structure. Moreover, even object-centric topological maps still ground language goals through explicit cross-modal supervision such as CLIP or large vision-language models, leaving open whether such grounding is possible from a purely vision-built map. To address these challenges, we extend the Platonic Representation Hypothesis to embodied navigation and recast vision-only ObjNav, cross-modal ObjNav, and VLN as three different interfaces to the same object-centric semantic manifold. We further introduce PlatonicNav, a training-free framework whose Platonic Topological Map fuses geometric and semantic node distances from a self-supervised visual encoder, and grounds language goals via blind matching without any paired vision-language data. Extensive experiments on simulation benchmarks including HM3D-IIN, OVON, and R2R-CE on MP3D, together with deployment on Unitree Go2, demonstrate that PlatonicNav generalizes across tasks, modalities, and embodiments without explicit cross-modal training. Code: https://github.com/AIGeeksGroup/PlatonicNav. Website: https://aigeeksgroup.github.io/PlatonicNav.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 69 of its 75 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
69 of 75 references.
Closest ancestors · 2
Same direction, newest first
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation6 Dec
- 2022Visual Language Maps for Robot Navigation11 Oct
Other references · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025DINOv3cited by 1,414
38 more
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2024The Platonic Representation Hypothesiscited by 382
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 304
- 2023Fast Segment Anythingcited by 290
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2018Semi-parametric Topological Memory for Navigationcited by 209
- 2020Neural Topological SLAM for Visual Navigationcited by 195
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
50 most cited of 67 All 67 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
- 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation
- 2025Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
- 2024Open-Vocabulary Object-Goal Navigation by Generalizing Semantic Mapping with Dense CLIP
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
- 2025Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation