Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects
Not on the map. Why?
Abstract (arXiv)
We address the problem of building digital twins of unknown articulated objects from two RGBD scans of the object at different articulation states. We decompose the problem into two stages, each addressing distinct aspects. Our method first reconstructs object-level shape at each state, then recovers the underlying articulation model including part segmentation and joint articulations that associate the two states. By explicitly modeling point-level correspondences and exploiting cues from images, 3D reconstructions, and kinematics, our method yields more accurate and stable results compared to prior work. It also handles more than one movable part and does not rely on any object shape or structure priors. Project page: https://github.com/NVlabs/DigitalTwinArt
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Builds on 0 of its 42 references that are in the map. First posted on arXiv 1 Apr 2024.
Builds on
0 of 42 references.
No references here yet.
Built on by
Citing papers per year: 2024: 6; 2025: 32; 2026: 29.
67 papers.
Sort:
By area:
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
38 more
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Articulated Object Estimation in the Wildcited by 18
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulationcited by 16
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2025Dexterous World Modelscited by 15
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
- 2025ScrewSplat: An End-to-End Method for Articulated Object Recognitioncited by 9
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2025Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understandingcited by 8
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 7
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenescited by 6
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splattingcited by 5
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraintscited by 3
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenariocited by 3
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 3
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Onlycited by 2
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshescited by 2
- 2024NARF24: Estimating Articulated Object Structure for Implicit Renderingcited by 1
- 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structurecited by 1
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splattingcited by 1
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splattingcited by 1
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Videocited by 1
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Viewscited by 1
50 most cited of 67 All 67 (JSON)
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos23 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
38 more
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes19 Apr 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting9 Apr 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario23 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints12 Mar 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2025Dexterous World Models19 Dec 2025
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Only8 Dec 2025
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splatting21 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
- 2025GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulation23 Oct 2025
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation20 Oct 2025
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenes13 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Images4 Sep 2025
- 2025Articulated Object Estimation in the Wild1 Sep 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025ScrewSplat: An End-to-End Method for Articulated Object Recognition4 Aug 2025
- 2025From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understanding23 Jul 2025
- 2025PhysX-3D: Physical-Grounded 3D Asset Generation16 Jul 2025
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Image8 Jul 2025
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting20 Jun 2025
- 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structure13 Jun 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
50 newest of 67 All 67 (JSON)
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2025Dexterous World Modelscited by 15
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2025Dexterous World Models19 Dec 2025
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imagination19 Dec 2024
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshescited by 2
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes19 Apr 2026
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Articulated Object Estimation in the Wildcited by 18
12 most cited of 61 All 61 (JSON)
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos23 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
12 newest of 61 All 61 (JSON)