mlsanityData to 7 Oct 2026

REACT3D: Recovering Articulations for Interactive Physical 3D Scenes

arXiv 2510.11340 ↗First posted 13 Oct 2025cs.CV cs.ROcited by 6

Not on the map. Why?

Abstract (arXiv)

Interactive 3D scenes are increasingly vital for embodied intelligence, yet existing datasets remain limited due to the labor-intensive process of annotating part segmentation, kinematic types, and motion trajectories. We present REACT3D, a scalable zero-shot framework that converts static 3D scenes into simulation-ready interactive replicas with consistent geometry, enabling direct use in diverse downstream tasks. Our contributions include: (i) openable-object detection and segmentation to extract candidate movable parts from static scenes, (ii) articulation estimation that infers joint types and motion parameters, (iii) hidden-geometry completion followed by interactive object assembly, and (iv) interactive scene integration in widely supported formats to ensure compatibility with standard simulation platforms. We achieve state-of-the-art performance on detection/segmentation and articulation metrics across diverse indoor scenes, demonstrating the effectiveness of our framework and providing a practical foundation for scalable interactive scene generation, thereby lowering the barrier to large-scale research on articulated scene understanding. Our project page is https://react3d.github.io/

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

24 of 39 references.

References · 24

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2017Mask R-CNNcited by 7,259
  3. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  4. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  5. 2018Open3D: A Modern Library for 3D Data Processingcited by 717
  6. 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
  7. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
  8. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
  9. 2019Category-Level Articulated Object Pose Estimationcited by 158
  10. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
  11. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
  12. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
12 more
  1. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  2. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
  3. 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
  4. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  5. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
  6. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
  7. 2022OPD: Single-view 3D Openable Part Detectioncited by 52
  8. 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
  9. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  10. 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
  11. 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
  12. 2024An improvement on the Louvain algorithm using random walkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.