ArtiSG: Functional 3D Scene Graph Construction via Human-demonstrated Articulated Objects Manipulation
Not on the map. Why?
Abstract (arXiv)
3D scene graphs have empowered robots with semantic understanding for navigation and planning. However, current functional scene graphs primarily focus on static element detection, lacking the actionable kinematic information required for physical manipulation, particularly regarding articulated objects. Existing approaches for inferring articulation mechanisms from static observations are prone to visual ambiguity, while methods that estimate parameters from state changes typically rely on constrained settings such as fixed cameras and unobstructed views. Furthermore, inconspicuous functional elements like hidden handles are frequently missed by pure visual perception. To bridge this gap, we present ArtiSG, a framework that constructs functional 3D scene graphs by encoding human demonstrations into structured robotic memory. Our approach leverages a robust data collection pipeline utilizing a portable hardware setup to accurately track 6-DoF manipulation trajectories and estimate articulation axes, even under camera ego-motion. By integrating these kinematic priors into a hierarchical, open-vocabulary graph, our system not only models how articulated objects move but also utilizes physical interaction data to discover implicit elements. Extensive real-world experiments demonstrate that ArtiSG significantly outperforms baselines in functional element recall and articulation estimation precision. Moreover, we show that the constructed graph serves as a reliable robotic memory, effectively guiding robots to perform language-directed manipulation tasks in real-world environments containing diverse articulated objects.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latentscited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interactioncited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 20263D Scene Graphs: Open Challenges and Future Directions15 Jun 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026