mlsanityData to 7 Oct 2026

Deep Non-Rigid Structure from Motion

arXiv 1908.00052 ↗First posted 30 Jul 2019cs.CVcited by 38

Not on the map. Why?

Abstract (arXiv)

Current non-rigid structure from motion (NRSfM) algorithms are mainly limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many applications within vision. In this paper we propose a novel deep neural network to recover camera poses and 3D points solely from an ensemble of 2D image coordinates. The proposed neural network is mathematically interpretable as a multi-layer block sparse dictionary learning problem, and can handle problems of unprecedented scale and shape complexity. Extensive experiments demonstrate the impressive performance of our approach where we exhibit superior precision and robustness against all available state-of-the-art works in the order of magnitude. We further propose a quality measure (based on the network weights) which circumvents the need for 3D ground-truth to ascertain the confidence we have in the reconstruction.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jul 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 12; 2022: 10; 2023: 10; 2024: 5; 2025: 1.

38 papers.

Sort:

By area:

  1. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  2. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
  3. 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
  4. 2022Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Cameracited by 57
  5. 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
  6. 2022CASA: Category-agnostic Skeletal Animal Reconstructioncited by 35
  7. 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstructioncited by 26
  8. 2022Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimationcited by 25
  9. 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
  10. 2022Unbiased 4D: Monocular 4D Reconstruction with a Neural Deformation Modelcited by 25
  11. 2021To The Point: Correspondence-driven monocular 3D category reconstructioncited by 21
  12. 2024BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priorscited by 14
26 more
  1. 2024Fast Encoder-Based 3D from Casual Videos via Point Track Processingcited by 14
  2. 2021OMAD: Object Model with Articulated Deformations for Pose Estimation and Retrievalcited by 12
  3. 2023MovingParts: Motion-based 3D Part Discovery in Dynamic Radiance Fieldcited by 12
  4. 2023DreaMo: Articulated 3D Reconstruction From A Single Casual Videocited by 12
  5. 2023CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videoscited by 10
  6. 2021PAUL: Procrustean Autoencoder for Unsupervised Liftingcited by 9
  7. 2023Root Pose Decomposition Towards Generic Non-rigid 3D Reconstruction with Monocular Videoscited by 8
  8. 20233D-LFM: Lifting Foundation Modelcited by 8
  9. 2022Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimationcited by 6
  10. 2021DensePose 3D: Lifting Canonical Surface Maps of Articulated Objects to the Third Dimensioncited by 5
  11. 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenescited by 5
  12. 2023Camera-Independent Single Image Depth Estimation from Defocus Blurcited by 5
  13. 20244DPV: 4D Pet from Videos by Coarse-to-Fine Non-Rigid Radiance Fieldscited by 5
  14. 2023DynamicSurf: Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Gridcited by 4
  15. 2021GTT-Net: Learned Generalized Trajectory Triangulationcited by 2
  16. 2021High Fidelity 3D Reconstructions with Limited Physical Viewscited by 2
  17. 2023Learning Internal Representations of 3D Transformations from 2D Projected Inputscited by 2
  18. 2024What is Wrong with End-to-End Learning for Phase Retrieval?cited by 2
  19. 2021End-to-End Learning of Multi-category 3D Pose and Shape Estimationcited by 1
  20. 2022MBW: Multi-view Bootstrapping in the Wildcited by 1
  21. 2022Controllable GAN Synthesis Using Non-Rigid Structure-from-Motioncited by 1
  22. 2021Simulated Data Generation Through Algorithmic Force Coefficient Estimation for AI-Based Robotic Projectile Launch Modelingcited by 0
  23. 2022Piecewise Planar Hulls for Semi-Supervised Learning of 3D Shape and Pose from 2D Imagescited by 0
  24. 2023HeadRecon: High-Fidelity 3D Head Reconstruction from Monocular Videocited by 0
  25. 2024Object Agnostic 3D Lifting in Space and Timecited by 0
  26. 2025Unsupervised 2D-3D lifting of non-rigid objects using local constraintscited by 0