Beyond the Remembered World: Predictive 4D Belief for Persistent Navigation in Evolving Worlds
Not on the map. Why?
Abstract (arXiv)
Persistent spatial memory enables embodied agents to navigate familiar environments across repeated visits. However, targets may move while unobserved, including during navigation, making remembered locations unreliable by the time an agent arrives. Despite advances in memory retrieval and state prediction, accounting for continued hidden world evolution and revising beliefs under limited visibility remain challenging. We study Evolving-World Navigation, where agents infer target locations from intermittent observations, predict their states at inspection time, and revise beliefs using visual evidence. We propose EvolvingNav, which constructs a time-indexed belief from timestamped 3D object histories through a structured persistence-relocation model. The belief distinguishes persistence at the last observed location from relocation to alternative locations and retains probability mass outside the known candidate set. An event-driven filter propagates the current belief as time elapses, forecasts target occupancy at candidate inspection times, and incorporates new RGB-D evidence. Negative observations downweight location hypotheses according to calibrated, visibility-conditioned detection probabilities, while evidence tracking prevents repeated use of the same observations. A frozen, zero-shot vision-language controller uses the updated belief to choose actions and replan. We further introduce EvoWorld-Bench, a benchmark grounded in human activity traces, comprising 54 scenes and 803,680 tasks with controlled changes before and during navigation. In simulation and real-robot experiments, EvolvingNav improves navigation success and search efficiency over the evaluated baselines. Paired experiments show the clearest gains under learnable temporal patterns, while ablations demonstrate the value of preserving uncertainty and incorporating visibility-aware evidence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
49 of 60 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2022Visual Language Maps for Robot Navigationcited by 362
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
37 more
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 162
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2023Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructionscited by 76
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
- 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 54
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 50
- 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulationcited by 32
- 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 29
- 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 26
- 2024HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Modelscited by 19
- 2025Describe Anything Anywhere At Any Momentcited by 19
- 2022Proactive Robot Assistance via Spatio-Temporal Object Modelingcited by 18
- 2023Modeling Dynamic Environments with Scene Graph Memorycited by 18
- 2024SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Taskscited by 18
- 2021Towards Optimal Correlational Object Searchcited by 14
- 2025MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied Navigationcited by 13
- 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agentscited by 11
- 2024Map-based Modular Approach for Zero-shot Embodied Question Answeringcited by 9
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigationcited by 8
- 2026InstructSAM: Segment Any Instance with Any Instructionscited by 6
- 2026Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigationcited by 6
- 2026AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harnesscited by 6
- 2023Predicting Routine Object Usage for Proactive Robot Assistancecited by 5
- 2026Predictive Spatio-Temporal Scene Graphs for Semi-Static Scenescited by 4
- 2026VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policiescited by 4
- 2020Lifelong update of semantic maps in dynamic environmentscited by 3
- 2024Personalized Embodied Navigation for Portable Object Findingcited by 3
- 2026User-Centric Object Navigation: A Benchmark with Integrated User Habits for Personalized Embodied Object Searchcited by 3
- 2024Align2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction Curationcited by 2
- 2024STREAK: Streaming Network for Continual Learning of Object Relocations under Household Context Driftscited by 2
- 2025LagMemo: Language 3D Gaussian Splatting Memory for Multi-modal Open-vocabulary Multi-goal Visual Navigationcited by 2
- 2025R4: Retrieval-Augmented Reasoning for Vision-Language Models in 4D Spatio-Temporal Spacecited by 2
- 2026FlowMaps: Modeling Long-Term Multimodal Object Dynamics with Flow Matchingcited by 1
Built on by
Not cited yet.