Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints
Not on the map. Why?
Abstract (arXiv)
Building high-fidelity digital twins of articulated objects from visual data remains a central challenge. Existing approaches depend on multi-view captures of the object in discrete, static states, which severely constrains their real-world scalability. In this paper, we introduce Articulat3D, a novel framework that constructs such digital twins from casually captured monocular videos by jointly enforcing explicit 3D geometric and motion constraints. We first propose Motion Prior-Driven Initialization, which leverages 3D point tracks to exploit the low-dimensional structure of articulated motion. By modeling scene dynamics with a compact set of motion bases, we facilitate soft decomposition of the scene into multiple rigidly moving groups. Building on this initialization, we introduce Geometric and Motion Constraints Refinement, which enforces physically plausible articulation through learnable kinematic primitives parameterized by a joint axis, a pivot point, and per-frame motion scalars, yielding reconstructions that are both geometrically accurate and temporally coherent. Extensive experiments demonstrate that Articulat3D achieves state-of-the-art performance on synthetic benchmarks and real-world casually captured monocular videos, significantly advancing the feasibility of digital twin creation under uncontrolled real-world conditions. Our project page is available at https://maxwell-zhao.github.io/Articulat3D/.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 41 of its 44 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
41 of 44 references.
References · 41
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2025Qwen-Image Technical Reportcited by 973
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
29 more
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 135
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 51
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2023Reconstructing Animatable Categories from Videoscited by 46
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 30
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 24
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstructioncited by 13
- 2025GEOPARD: Geometric Pretraining for Articulation Prediction in 3D Shapescited by 12
- 2025High-Fidelity Simulated Data Generation for Real-World Zero-Shot Robotic Manipulation Learning with Gaussian Splattingcited by 12
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splattingcited by 5
- 2025Towards Affordance-Aware Robotic Dexterous Grasping with Human-like Priorscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.