mlsanityData to 14 Oct 2026

CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videos

arXiv 2304.06937 ↗First posted 14 Apr 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Animating an object in 3D often requires an articulated structure, e.g. a kinematic chain or skeleton of the manipulated object with proper skinning weights, to obtain smooth movements and surface deformations. However, existing models that allow direct pose manipulations are either limited to specific object categories or built with specialized equipment. To reduce the work needed for creating animatable 3D models, we propose a novel reconstruction method that learns an animatable kinematic chain for any articulated object. Our method operates on monocular videos without prior knowledge of the object's shape or underlying structure. Our approach is on par with state-of-the-art 3D surface reconstruction methods on various articulated object categories while enabling direct pose manipulations by re-posing the learned kinematic chain.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 74 of its 88 references that are in the map. First posted on arXiv 14 Apr 2023.

Builds on

74 of 88 references.

References · 74

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  8. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  10. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  11. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  12. 2021Volume Rendering of Neural Implicit Surfacescited by 996
38 more
  1. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  2. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  3. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  4. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  5. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  6. 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 627
  7. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  8. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  9. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  10. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  11. 2019PointRend: Image Segmentation as Renderingcited by 440
  12. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  13. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
  14. 2021Deep ViT Features as Dense Visual Descriptorscited by 330
  15. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  16. 2018Everybody Dance Nowcited by 315
  17. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  18. 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
  19. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  20. 2017Pose Guided Person Image Generationcited by 251
  21. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  22. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 226
  23. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  24. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  25. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 211
  26. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  27. 2021Self-Calibrating Neural Radiance Fieldscited by 204
  28. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  29. 2021Neural Articulated Radiance Fieldcited by 196
  30. 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
  31. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  32. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  33. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  34. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  35. 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
  36. 2019NASA: Neural Articulated Shape Approximationcited by 149
  37. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  38. 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 1.

10 papers.