FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents
Not on the map. Why?
Abstract (arXiv)
To operate effectively in human environments, robots must identify articulated objects, segment their movable and interactive parts, and estimate their kinematic models. Existing articulated scene representations typically recover kinematics from observed interactions, while methods operating on static scans often decouple articulation from functional interactive elements. We present FunArt, a framework that constructs articulation-aware functional 3D scene graphs from posed RGB-D observations captured in a single static configuration. FunArt reconstructs object instances, converts their fused geometry directly into the O-Voxel representation of TRELLIS.2, and exploits its frozen, sparse-compression VAE as a structural prior. A lightweight query-based decoder combines compact object-level latents with dense, surface-aligned features to jointly segment movable parts and functional interactive elements while estimating motion type, axis, origin, and range. On the Articulate3D dataset, FunArt achieves state-of-the-art performance across movable-part segmentation, articulation estimation, and functional-element segmentation, both with and without ground-truth object input. In the end-to-end setting, it outperforms the strongest baselines by 1.5 AP_{50} points for movable parts, 2.8 AP_{50} points under joint origin-and-axis constraints, and 6.7 AP_{50} points for functional elements. These results demonstrate that generative 3D latents encode actionable structural cues that can initialize robotic perception and planning before physical interaction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
41 of 48 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
29 more
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 54
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 52
- 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
- 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025Articulated Object Estimation in the Wildcited by 19
- 2024Functionality understanding and segmentation in 3D scenescited by 17
- 2025GEOPARD: Geometric Pretraining for Articulation Prediction in 3D Shapescited by 13
- 2026Articulated 3D Scene Graphs for Open-World Mobile Manipulationcited by 11
- 2024Lost & Found: Tracking Changes from Egocentric Observations in 3D Dynamic Scene Graphscited by 10
- 2025KeySG: Hierarchical Keyframe-Based 3D Scene Graphscited by 10
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 8
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenescited by 7
- 2026Pandora: Articulated 3D Scene Graphs from Egocentric Visioncited by 6
- 2025Social 3D Scene Graphs: Modeling Human Actions and Relations for Interactive Service Robotscited by 5
- 2025ArtiSG: Functional 3D Scene Graph Construction via Human-demonstrated Articulated Objects Manipulationcited by 5
- 2026FunFact: Building Probabilistic Functional 3D Scene Graphs via Factor-Graph Reasoningcited by 5
- 2026OVI-MAP:Open-Vocabulary Instance-Semantic Mappingcited by 4
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2025Action-guided generation of 3D functionality segmentation datacited by 2
- 2026T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentationcited by 2
Built on by
Not cited yet.