mlsanityData to 7 Oct 2026

ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos

arXiv 2606.24628 ↗First posted 23 Jun 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deploying robots in unstructured real-world environments needs accurate, interactive models of the objects. Constructing these models at scale remains a critical bottleneck for robotic system integration. We present ArtiTwinSplat, a framework that automatically constructs articulated, photo-realistic digital twins of objects directly from RGB-D videos, requiring no CAD models, simulation assets, or manual annotations. Our method is built on 3D Gaussian Splatting that preserve geometric fidelity and photometric realism, coupled with an unsupervised articulation discovery pipeline that recovers part structure and joint kinematics from observed motion alone. With tracking and optimization stages our method provides stable, queryable digital twins that support real-time rendering, viewpoint control, and interactive manipulation. Unlike prior methods confined to simulation, ArtiTwinSplat operates directly on real-world observations and produces twins that are immediately usable by downstream robot planning and learning systems. This method offers a practical, scalable pathway toward digital twin construction, lowering the integration barrier for articulated object manipulation in embodied AI and human-robot collaboration contexts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

21 of 23 references.

References · 21

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  3. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  4. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  5. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  6. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
  7. 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 135
  8. 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
  9. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
  10. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  11. 2023ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenescited by 68
  12. 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
9 more
  1. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  2. 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
  3. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
  4. 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 51
  5. 2024Multi-modal Situated Reasoning in 3D Scenescited by 50
  6. 2023Reconstructing Animatable Categories from Videoscited by 46
  7. 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 24
  8. 20243DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangementcited by 15
  9. 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13

Built on by

Not cited yet.