mlsanityData to 14 Oct 2026

PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps

arXiv 2606.01788 ↗First posted 1 Jun 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Embodied visual navigation, where an agent perceives a complex environment and acts to reach a goal from raw sensory input, underpins a wide range of applications such as household service robotics, assistive robotics, and large-scale autonomous exploration. However, recent attempts to unify vision-and-language navigation (VLN) and object goal navigation (ObjNav) remain at the level of architectural fusion, mixed-task training, and large vision-language pretraining, without examining whether independently trained vision and language encoders may already share a common semantic structure. Moreover, even object-centric topological maps still ground language goals through explicit cross-modal supervision such as CLIP or large vision-language models, leaving open whether such grounding is possible from a purely vision-built map. To address these challenges, we extend the Platonic Representation Hypothesis to embodied navigation and recast vision-only ObjNav, cross-modal ObjNav, and VLN as three different interfaces to the same object-centric semantic manifold. We further introduce PlatonicNav, a training-free framework whose Platonic Topological Map fuses geometric and semantic node distances from a self-supervised visual encoder, and grounds language goals via blind matching without any paired vision-language data. Extensive experiments on simulation benchmarks including HM3D-IIN, OVON, and R2R-CE on MP3D, together with deployment on Unitree Go2, demonstrate that PlatonicNav generalizes across tasks, modalities, and embodiments without explicit cross-modal training. Code: https://github.com/AIGeeksGroup/PlatonicNav. Website: https://aigeeksgroup.github.io/PlatonicNav.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 69 of its 75 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

69 of 75 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation6 Dec
  2. 2022Visual Language Maps for Robot Navigation11 Oct

Other references · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2023Segment Anythingcited by 8,234
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2025Qwen3-VL Technical Reportcited by 2,793
  12. 2025DINOv3cited by 1,414
38 more
  1. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  2. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  3. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  4. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  5. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  6. 2018On Evaluation of Embodied Navigation Agentscited by 547
  7. 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
  8. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  9. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  10. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  11. 2024The Platonic Representation Hypothesiscited by 382
  12. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
  13. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 304
  14. 2023Fast Segment Anythingcited by 290
  15. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  16. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  17. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  18. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  19. 2018Semi-parametric Topological Memory for Navigationcited by 209
  20. 2020Neural Topological SLAM for Visual Navigationcited by 195
  21. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  22. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
  23. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
  24. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  25. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  26. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
  27. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
  28. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
  29. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
  30. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  31. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
  32. 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
  33. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
  34. 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
  35. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  36. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
  37. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  38. 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86

50 most cited of 67 All 67 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
  2. 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
  3. 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation
  4. 2025Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?
  5. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
  6. 2024Open-Vocabulary Object-Goal Navigation by Generalizing Semantic Mapping with Dense CLIP
  7. 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
  8. 2025Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation