CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videos
Not on the map. Why?
Abstract (arXiv)
Animating an object in 3D often requires an articulated structure, e.g. a kinematic chain or skeleton of the manipulated object with proper skinning weights, to obtain smooth movements and surface deformations. However, existing models that allow direct pose manipulations are either limited to specific object categories or built with specialized equipment. To reduce the work needed for creating animatable 3D models, we propose a novel reconstruction method that learns an animatable kinematic chain for any articulated object. Our method operates on monocular videos without prior knowledge of the object's shape or underlying structure. Our approach is on par with state-of-the-art 3D surface reconstruction methods on various articulated object categories while enabling direct pose manipulations by re-posing the learned kinematic chain.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 74 of its 88 references that are in the map. First posted on arXiv 14 Apr 2023.
Builds on
74 of 88 references.
References · 74
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
38 more
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2019PointRend: Image Segmentation as Renderingcited by 440
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2021Deep ViT Features as Dense Visual Descriptorscited by 330
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2018Everybody Dance Nowcited by 315
- 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2017Pose Guided Person Image Generationcited by 251
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 226
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 211
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
- 2021Neural Articulated Radiance Fieldcited by 196
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2019NASA: Neural Articulated Shape Approximationcited by 149
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 1.
10 papers.
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videoscited by 14
- 2024S3O: A Dual-Phase Approach for Reconstructing Dynamic Shape and Skeleton of Articulated Objects from Single Monocular Videocited by 12
- 20244DPV: 4D Pet from Videos by Coarse-to-Fine Non-Rigid Radiance Fieldscited by 5
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussianscited by 5
- 2025Motion Blender Gaussian Splatting for Dynamic Scene Reconstructioncited by 3
- 2025HEIR: Learning Graph-Based Motion Hierarchiescited by 1
- 2024Hierarchically Structured Neural Bones for Reconstructing Animatable Objects from Casual Videoscited by 0
- 2026GaussiAnimate: Rig Animatable Categories with Level of Dynamicscited by 0
- 2026GaussiAnimate: Rig Animatable Categories with Level of Dynamics9 Apr 2026
- 2025HEIR: Learning Graph-Based Motion Hierarchies30 Oct 2025
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussians28 Jun 2025
- 2025RigGS: Rigging of 3D Gaussians for Modeling Articulated Objects in Videos21 Mar 2025
- 2025Motion Blender Gaussian Splatting for Dynamic Scene Reconstruction12 Mar 2025
- 20244DPV: 4D Pet from Videos by Coarse-to-Fine Non-Rigid Radiance Fields15 Nov 2024
- 2024Hierarchically Structured Neural Bones for Reconstructing Animatable Objects from Casual Videos1 Aug 2024
- 2024S3O: A Dual-Phase Approach for Reconstructing Dynamic Shape and Skeleton of Articulated Objects from Single Monocular Video21 May 2024
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024