PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objects
Not on the map. Why?
Abstract (arXiv)
We address the task of simultaneous part-level reconstruction and motion parameter estimation for articulated objects. Given two sets of multi-view images of an object in two static articulation states, we decouple the movable part from the static part and reconstruct shape and appearance while predicting the motion parameters. To tackle this problem, we present PARIS: a self-supervised, end-to-end architecture that learns part-level implicit shape and appearance models and optimizes motion parameters jointly without any 3D supervision, motion, or semantic annotation. Our experiments show that our method generalizes better across object categories, and outperforms baselines and prior work that are given 3D point clouds as input. Our approach improves reconstruction relative to state-of-the-art baselines with a Chamfer-L1 distance reduction of 3.94 (45.2%) for objects and 26.79 (84.5%) for parts, and achieves 5% error rate for motion estimation across 10 object categories. Video summary at: https://youtu.be/tDSrROPCgUc
Key facts. Cited by 118 papers in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 14 Aug 2023.
Builds on
38 of 56 references.
References · 38
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020Point Transformercited by 1,470
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
26 more
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2021Motion Representations for Articulated Animationcited by 255
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2020Learning Deformable Tetrahedral Meshes for 3D Reconstructioncited by 85
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
- 2022NerfAcc: A General NeRF Acceleration Toolboxcited by 74
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 56
- 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2022Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesiscited by 43
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
- 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
- 2023Semi-Weakly Supervised Object Kinematic Motion Predictioncited by 14
- 2021Learning to Infer Kinematic Hierarchies for Novel Object Instancescited by 10
- 2022Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and Challengescited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 20; 2025: 43; 2026: 54.
118 papers.
Sort:
By area:
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 54
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
38 more
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 30
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 26
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 21
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 19
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025Articulated Object Estimation in the Wildcited by 19
- 2025Dexterous World Modelscited by 18
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2024LEIA: Latent View-invariant Embeddings for Implicit 3D Articulationcited by 16
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulationcited by 11
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026Articulated 3D Scene Graphs for Open-World Mobile Manipulationcited by 11
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2025ScrewSplat: An End-to-End Method for Articulated Object Recognitioncited by 9
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 9
- 2025Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understandingcited by 8
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraintscited by 8
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 8
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generationcited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenescited by 7
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
50 most cited of 118 All 118 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image4 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
38 more
- 2026ArtiMo: Agent-Driven Articulated Mesh Animation21 Aug 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos23 Jun 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026Revisiting Articulated Parts Perception in Robot Manipulation6 Jun 2026
- 2026SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation1 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations29 Apr 2026
- 2026Breaking the Rigid Prior: Towards Articulated 3D Anomaly Detection29 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects28 Apr 2026
- 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generation22 Apr 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation13 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting9 Apr 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario23 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints12 Mar 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
50 newest of 118 All 118 (JSON)
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 21
- 2025Dexterous World Modelscited by 18
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2025Dexterous World Models19 Dec 2025
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model2 Nov 2025
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imagination19 Dec 2024
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraintscited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025ArticFlow: Generative Simulation of Articulated Mechanismscited by 1
- 2025ArticFlow: Generative Simulation of Articulated Mechanisms22 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraints1 Aug 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 54
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
12 most cited of 104 All 104 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image4 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
12 newest of 104 All 104 (JSON)