mlsanityData to 7 Oct 2026

CuriousBot: Interactive Mobile Exploration via Actionable 3D Relational Object Graph

arXiv 2501.13338 ↗First posted 23 Jan 2025cs.RO cs.CV cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Mobile exploration is a longstanding challenge in robotics, yet current methods primarily focus on active perception instead of active interaction, limiting the robot's ability to interact with and fully explore its environment. Existing robotic exploration approaches via active interaction are often restricted to tabletop scenes, neglecting the unique challenges posed by mobile exploration, such as large exploration spaces, complex action spaces, and diverse object relations. In this work, we introduce a 3D relational object graph that encodes diverse object relations and enables exploration through active interaction. We develop a system based on this representation and evaluate it across diverse scenes. Our qualitative and quantitative results demonstrate the system's effectiveness and generalization across object instances, relations, and scenes, outperforming methods solely relying on vision-language models (VLMs).

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 73 of its 98 references that are in the map. First posted on arXiv 23 Jan 2025.

Builds on

73 of 98 references.

References · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Segment Anythingcited by 8,158
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  10. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  11. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  12. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
38 more
  1. 2023Vision Transformers Need Registerscited by 844
  2. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  3. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  4. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  5. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  6. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  7. 2020Learning to Explore using Active Neural SLAMcited by 308
  8. 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
  9. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
  10. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  11. 2018Large-Scale Study of Curiosity-Driven Learningcited by 277
  12. 2018Semi-parametric Topological Memory for Navigationcited by 203
  13. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  14. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
  15. 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
  16. 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
  17. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
  18. 2020Rearrangement: A Challenge for Embodied AIcited by 153
  19. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
  20. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
  21. 2018Visual Semantic Navigation using Scene Priorscited by 127
  22. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
  23. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
  24. 2019Learning Exploration Policies for Navigationcited by 113
  25. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
  26. 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
  27. 2021Visual Room Rearrangementcited by 101
  28. 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 101
  29. 2022Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Modelscited by 95
  30. 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
  31. 2022Offline Visual Representation Learning for Embodied Navigationcited by 74
  32. 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
  33. 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 69
  34. 2020Learning Affordance Landscapes for Interaction Exploration in 3D Environmentscited by 65
  35. 2020Learning Object Relation Graph and Tentative Policy for Visual Navigationcited by 62
  36. 2024RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operationcited by 62
  37. 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
  38. 2019Online Replanning in Belief Space for Partially Observable Task and Motion Problemscited by 60

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Relational Semantic Reasoning on 3D Scene Graphs for Open World Interactive Object Search
  2. 2025Imagine, Verify, Execute: Memory-guided Agentic Exploration with Vision-Language Models
  3. 2024Scene Exploration by Vision-Language Models
  4. 2025RoboRetriever: Single-Camera Robot Object Retrieval via Active and Interactive Perception with Dynamic Scene Graph
  5. 2026LIEREx: Language-Image Embeddings for Robotic Exploration
  6. 2025Uncertainty-Informed Active Perception for Open Vocabulary Object Goal Navigation
  7. 2026Relationship-Aware Hierarchical 3D Scene Graph for Task Reasoning
  8. 2026Open-Set 3D Scene Graphs for Field Robotics: An Outdoor Case Study ↗