CuriousBot: Interactive Mobile Exploration via Actionable 3D Relational Object Graph
Not on the map. Why?
Abstract (arXiv)
Mobile exploration is a longstanding challenge in robotics, yet current methods primarily focus on active perception instead of active interaction, limiting the robot's ability to interact with and fully explore its environment. Existing robotic exploration approaches via active interaction are often restricted to tabletop scenes, neglecting the unique challenges posed by mobile exploration, such as large exploration spaces, complex action spaces, and diverse object relations. In this work, we introduce a 3D relational object graph that encodes diverse object relations and enables exploration through active interaction. We develop a system based on this representation and evaluate it across diverse scenes. Our qualitative and quantitative results demonstrate the system's effectiveness and generalization across object instances, relations, and scenes, outperforming methods solely relying on vision-language models (VLMs).
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 73 of its 98 references that are in the map. First posted on arXiv 23 Jan 2025.
Builds on
73 of 98 references.
References · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
38 more
- 2023Vision Transformers Need Registerscited by 844
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2020Learning to Explore using Active Neural SLAMcited by 308
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2018Large-Scale Study of Curiosity-Driven Learningcited by 277
- 2018Semi-parametric Topological Memory for Navigationcited by 203
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
- 2020Rearrangement: A Challenge for Embodied AIcited by 153
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
- 2018Visual Semantic Navigation using Scene Priorscited by 127
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
- 2019Learning Exploration Policies for Navigationcited by 113
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
- 2018Mapping Instructions to Actions in 3D Environments with Visual Goal Predictioncited by 101
- 2021Visual Room Rearrangementcited by 101
- 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 101
- 2022Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Modelscited by 95
- 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
- 2022Offline Visual Representation Learning for Embodied Navigationcited by 74
- 2021Auxiliary Tasks and Exploration Enable ObjectNavcited by 73
- 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 69
- 2020Learning Affordance Landscapes for Interaction Exploration in 3D Environmentscited by 65
- 2020Learning Object Relation Graph and Tentative Policy for Visual Navigationcited by 62
- 2024RTAB-Map as an Open-Source Lidar and Visual SLAM Library for Large-Scale and Long-Term Online Operationcited by 62
- 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
- 2019Online Replanning in Belief Space for Partially Observable Task and Motion Problemscited by 60
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025MomaGraph: State-Aware Unified Scene Graphs with Vision-Language Model for Embodied Task Planningcited by 8
- 2026FunFact: Building Probabilistic Functional 3D Scene Graphs via Factor-Graph Reasoningcited by 5
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2026CoReLIN: Constraint-based Reasoning for Zero-shot Lifelong Interactive Navigationcited by 0
- 20263D Scene Graphs: Open Challenges and Future Directions15 Jun 2026
- 2026FunFact: Building Probabilistic Functional 3D Scene Graphs via Factor-Graph Reasoning4 Apr 2026
- 2026CoReLIN: Constraint-based Reasoning for Zero-shot Lifelong Interactive Navigation23 Feb 2026
- 2025MomaGraph: State-Aware Unified Scene Graphs with Vision-Language Model for Embodied Task Planning18 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026Relational Semantic Reasoning on 3D Scene Graphs for Open World Interactive Object Search
- 2025Imagine, Verify, Execute: Memory-guided Agentic Exploration with Vision-Language Models
- 2024Scene Exploration by Vision-Language Models
- 2025RoboRetriever: Single-Camera Robot Object Retrieval via Active and Interactive Perception with Dynamic Scene Graph
- 2026LIEREx: Language-Image Embeddings for Robotic Exploration
- 2025Uncertainty-Informed Active Perception for Open Vocabulary Object Goal Navigation
- 2026Relationship-Aware Hierarchical 3D Scene Graph for Task Reasoning
- 2026Open-Set 3D Scene Graphs for Field Robotics: An Outdoor Case Study ↗