REACT3D: Recovering Articulations for Interactive Physical 3D Scenes
Not on the map. Why?
Abstract (arXiv)
Interactive 3D scenes are increasingly vital for embodied intelligence, yet existing datasets remain limited due to the labor-intensive process of annotating part segmentation, kinematic types, and motion trajectories. We present REACT3D, a scalable zero-shot framework that converts static 3D scenes into simulation-ready interactive replicas with consistent geometry, enabling direct use in diverse downstream tasks. Our contributions include: (i) openable-object detection and segmentation to extract candidate movable parts from static scenes, (ii) articulation estimation that infers joint types and motion parameters, (iii) hidden-geometry completion followed by interactive object assembly, and (iv) interactive scene integration in widely supported formats to ensure compatibility with standard simulation platforms. We achieve state-of-the-art performance on detection/segmentation and articulation metrics across diverse indoor scenes, demonstrating the effectiveness of our framework and providing a practical foundation for scalable interactive scene generation, thereby lowering the barrier to large-scale research on articulated scene understanding. Our project page is https://react3d.github.io/
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
24 of 39 references.
References · 24
- 2023Visual Instruction Tuningcited by 7,792
- 2017Mask R-CNNcited by 7,259
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
12 more
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2022OPD: Single-view 3D Openable Part Detectioncited by 52
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2024An improvement on the Louvain algorithm using random walkscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 7
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latentscited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interactioncited by 0
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenescited by 0
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026