mlsanityData to 14 Oct 2026

Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categories

arXiv 2211.03889 ↗First posted 7 Nov 2022cs.CVcited by 29

Not on the map. Why?

Abstract (arXiv)

Obtaining photorealistic reconstructions of objects from sparse views is inherently ambiguous and can only be achieved by learning suitable reconstruction priors. Earlier works on sparse rigid object reconstruction successfully learned such priors from large datasets such as CO3D. In this paper, we extend this approach to dynamic objects. We use cats and dogs as a representative example and introduce Common Pets in 3D (CoP3D), a collection of crowd-sourced videos showing around 4,200 distinct pets. CoP3D is one of the first large-scale datasets for benchmarking non-rigid 3D reconstruction "in the wild". We also propose Tracker-NeRF, a method for learning 4D reconstruction from our dataset. At test time, given a small number of video frames of an unseen object, Tracker-NeRF predicts the trajectories of its 3D points and generates new views, interpolating viewpoint and time. Results on CoP3D reveal significantly better non-rigid new-view synthesis performance than existing baselines.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 44 of its 55 references that are in the map. First posted on arXiv 7 Nov 2022.

Builds on

44 of 55 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  6. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  8. 2020Neural Sparse Voxel Fieldscited by 959
  9. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  10. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  11. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
32 more
  1. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  2. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  3. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  4. 2019PointRend: Image Segmentation as Renderingcited by 440
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  7. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  8. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  9. 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
  10. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  11. 2020Consistent Video Depth Estimationcited by 220
  12. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
  13. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
  14. 2017Learning a Multi-View Stereo Machinecited by 194
  15. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  16. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  17. 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
  18. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  19. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
  20. 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
  21. 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
  22. 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
  23. 2020Continuous Surface Embeddingscited by 80
  24. 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
  25. 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
  26. 2016A Large Dataset of Object Scanscited by 64
  27. 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
  28. 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
  29. 2020Implicit Mesh Reconstruction from Unannotated Image Collectionscited by 49
  30. 2020Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the Wildcited by 35
  31. 2022Imposing Consistency for Optical Flow Estimationcited by 24
  32. 2021Learning monocular 3D reconstruction of articulated categories from motioncited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 7; 2025: 13; 2026: 5.

29 papers.

Sort:

By area:

  1. 2023Robust Dynamic Radiance Fieldscited by 194
  2. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
  3. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
  4. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
  5. 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 61
  6. 2024Learning the 3D Fauna of the Webcited by 59
  7. 2022SparsePose: Sparse-View Camera Pose Regression and Refinementcited by 53
  8. 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 49
  9. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  10. 2025Dynamic Camera Poses and Where to Find Themcited by 27
  11. 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
  12. 2024Fast Encoder-Based 3D from Casual Videos via Point Track Processingcited by 14
17 more
  1. 2024SEED4D: A Synthetic Ego--Exo Dynamic 4D Data Generator, Driving Dataset and Benchmarkcited by 8
  2. 2024Temporal Residual Jacobians For Rig-free Motion Transfercited by 7
  3. 20254D-Animal: Freely Reconstructing Animatable 3D Animals from Videoscited by 6
  4. 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
  5. 2024Dynamic NeRF: A Reviewcited by 5
  6. 2025LIM: Large Interpolator Model for Dynamic Reconstructioncited by 5
  7. 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Fieldcited by 5
  8. 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modelingcited by 5
  9. 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recoverycited by 4
  10. 2025Advances and Trends in the 3D Reconstruction of the Shape and Motion of Animalscited by 2
  11. 2025PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimationcited by 1
  12. 2026SMAL-pets: SMAL Based Avatars of Pets from Single Imagecited by 1
  13. 2026InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generationcited by 1
  14. 2026Kirin: Animal Motion Generation from In-the-Wild Videocited by 1
  15. 2025SIRE: SE(3) Intrinsic Rigidity Embeddingscited by 0
  16. 2025Broadening View Synthesis of Dynamic Scenes from Constrained Monocular Videoscited by 0
  17. 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animalscited by 0