mlsanityData to 14 Oct 2026

RAVEN: Long-Horizon Reasoning & Navigation with a Visuo-Spatio-Temporal Memory

arXiv 2606.25206 ↗First posted 23 Jun 2026cs.RO cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Long-term robot deployment requires a compact and scalable memory that preserves fine-grained visual semantics, grounds observations in space and time, and enables efficient storage and retrieval. In this paper, we propose RAVEN, an agentic memory system for long-horizon robotic question answering and navigation. RAVEN stores visual embeddings with pose and time in a vector database, and grounds retrieval in a spatial map to answer queries and navigate to goals. By operating directly on visual embeddings, RAVEN avoids lossy image-to-text captioning and enables accurate semantic, spatial, and temporal retrieval at scale. Across several simulated and real-world video question-answering benchmarks, RAVEN consistently surpasses caption-based memory systems and matches frontier VLMs on long-horizon tasks at 10× lower retrieval cost. Finally, we instantiate RAVEN on a Unitree Go1 robot for the task of long-horizon navigation for natural language goal-reaching, and show successful deployment over several large indoor environments.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 49 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

35 of 49 references.

References · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2017Billion-scale similarity search with GPUscited by 2,497
  8. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  9. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  10. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
  11. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  12. 2024The Faiss librarycited by 376
23 more
  1. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
  2. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
  3. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  4. 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 165
  5. 2023GOAT: GO to Any Thingcited by 89
  6. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
  7. 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
  8. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
  9. 2022CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigationcited by 55
  10. 2021Temporal Memory Attention for Video Semantic Segmentationcited by 50
  11. 2023Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Datasetcited by 28
  12. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
  13. 2025Improve Multi-Modal Embedding Learning via Explicit Hard Negative Gradient Amplifyingcited by 23
  14. 2024NavFormer: A Transformer Architecture for Robot Target-Driven Navigation in Unknown and Dynamic Environmentscited by 20
  15. 2018Recurrent-OctoMap: Learning State-based Map Refinement for Long-Term Semantic Mapping with 3D-Lidar Datacited by 16
  16. 2020Probabilistic Semantic Mapping for Urban Autonomous Driving Applicationscited by 15
  17. 2015Place Categorization and Semantic Mapping on a Mobile Robotcited by 12
  18. 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agentscited by 12
  19. 2025Spatially-Enhanced Recurrent Memory for Long-Range Mapless Navigation via End-to-End Reinforcement Learningcited by 11
  20. 2025Meta-Memory: Retrieving and Integrating Semantic-Spatial Memories for Robot Spatial Reasoningcited by 9
  21. 2022Efficient and Robust Semantic Mapping for Indoor Environmentscited by 5
  22. 2025Comparison of Text-Based and Image-Based Retrieval in Multimodal Retrieval Augmented Generation Large Language Model Systemscited by 5
  23. 2025osmAG-LLM: Zero-Shot Open-Vocabulary Object Navigation via Semantic Maps and Large Language Models Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026STaR: Scalable Task-Conditioned Retrieval for Long-Horizon Multimodal Robot Memory
  2. 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
  3. 2024Explore until Confident: Efficient Exploration for Embodied Question Answering
  4. 2024EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answering
  5. 2026Incentivizing Vision Language Models to Search for Long Video Question Answering
  6. 2026HIMM: Human-Inspired Long-Term Memory Modeling for Embodied Exploration and Question Answering
  7. 2026FAST-EQA: Efficient Embodied Question Answering with Global and Local Region Relevancy
  8. 2026Hierarchical Floorplan-Guided Vision-Language Exploration for Embodied Question Answering ↗