mlsanityData to 7 Oct 2026

Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesis

arXiv 2406.16623 ↗First posted 24 Jun 2024cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

We propose a novel unsupervised method to learn the pose and part-segmentation of articulated objects with rigid parts. Given two observations of an object in different articulation states, our method learns the geometry and appearance of object parts by using an implicit model from the first observation, distils the part segmentation and articulation from the second observation while rendering the latter observation. Additionally, to tackle the complexities in the joint optimization of part segmentation and articulation, we propose a voxel grid-based initialization strategy and a decoupled optimization procedure. Compared to the prior unsupervised work, our model obtains significantly better performance, and generalizes to objects with multiple parts while it can be efficiently from few views for the latter observation.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 34 of its 47 references that are in the map. First posted on arXiv 24 Jun 2024.

Builds on

34 of 47 references.

References · 34

  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  7. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  8. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  9. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  10. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  11. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  12. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
22 more
  1. 2021Motion Representations for Articulated Animationcited by 253
  2. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  3. 2021Neural Articulated Radiance Fieldcited by 196
  4. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  5. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
  6. 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
  7. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
  8. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  9. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
  10. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  11. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
  12. 2020STaR: Self-supervised Tracking and Reconstruction of Rigid Objects in Motion with Neural Renderingcited by 76
  13. 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
  14. 2018Deep Part Induction from Articulated Object Pairscited by 66
  15. 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
  16. 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 55
  17. 2022OPD: Single-view 3D Openable Part Detectioncited by 52
  18. 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
  19. 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
  20. 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
  21. 2022Understanding 3D Object Articulation in Internet Videoscited by 36
  22. 2022NARF22: Neural Articulated Radiance Fields for Configuration-Aware Renderingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 10.

24 papers.

Sort:

By area:

  1. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  2. 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
  3. 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
  4. 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
  5. 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
  6. 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
  7. 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
  8. 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
  9. 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
  10. 2025ART: Articulated Reconstruction Transformercited by 9
  11. 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
  12. 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
12 more
  1. 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 3
  2. 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
  3. 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structurecited by 1
  4. 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
  5. 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
  6. 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 1
  7. 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splattingcited by 1
  8. 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
  9. 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0
  10. 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
  11. 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
  12. 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videoscited by 0