REACTO: Reconstructing Articulated Objects from a Single Video
Not on the map. Why?
Abstract (arXiv)
In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like humans and animals from videos, but face challenges with piece-wise rigid general articulated objects due to limitations in their deformation models. To tackle this, we propose Quasi-Rigid Blend Skinning, a novel deformation model that enhances the rigidity of each part while maintaining flexible deformation of the joints. Our primary insight combines three distinct approaches: 1) an enhanced bone rigging system for improved component modeling, 2) the use of quasi-sparse skinning weights to boost part rigidity and reconstruction fidelity, and 3) the application of geodesic point assignment for precise motion and seamless deformation. Our method outperforms previous works in producing higher-fidelity 3D reconstructions of general articulated objects, as demonstrated on both real and synthetic datasets. Project page: https://chaoyuesong.github.io/REACTO.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 63 of its 79 references that are in the map. First posted on arXiv 17 Apr 2024.
Builds on
63 of 79 references.
References · 63
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2016Density estimation using Real NVPcited by 2,029
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
38 more
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2023Track Anything: Segment Anything Meets Videoscited by 230
- 2021Neural Articulated Radiance Fieldcited by 196
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2020Shape and Viewpoint without Keypointscited by 92
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
- 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 23; 2026: 18.
45 papers.
Sort:
By area:
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videoscited by 14
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
33 more
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2024Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generationcited by 12
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2024AutoURDF: Unsupervised Robot Modeling from Point Cloud Frames Using Cluster Registrationcited by 5
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussianscited by 5
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splattingcited by 5
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 4
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraintscited by 3
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactionscited by 3
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Onlycited by 2
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splattingcited by 1
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequencescited by 1
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Videocited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generationcited by 0
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objectscited by 0
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objectscited by 0
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstructioncited by 0
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videoscited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects28 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
33 more
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints12 Mar 2026
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors4 Mar 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequences13 Feb 2026
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Only8 Dec 2025
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splatting21 Nov 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation20 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025Puppeteer: Rig and Animate Your 3D Models14 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Image8 Jul 2025
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussians28 Jun 2025
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting20 Jun 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting4 Jun 2025
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videos17 May 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videos21 Mar 2025
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generation17 Mar 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025MagicArticulate: Make Your 3D Models Articulation-Ready17 Feb 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2024AutoURDF: Unsupervised Robot Modeling from Point Cloud Frames Using Cluster Registration7 Dec 2024
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description2 Dec 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2024Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation27 May 2024
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors4 Mar 2026
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videoscited by 14
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
12 most cited of 39 All 39 (JSON)
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects28 Apr 2026
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints12 Mar 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
12 newest of 39 All 39 (JSON)