PR-RRN: Pairwise-Regularized Residual-Recursive Networks for Non-rigid Structure-from-Motion
Not on the map. Why?
Abstract (arXiv)
We propose PR-RRN, a novel neural-network based method for Non-rigid Structure-from-Motion (NRSfM). PR-RRN consists of Residual-Recursive Networks (RRN) and two extra regularization losses. RRN is designed to effectively recover 3D shape and camera from 2D keypoints with novel residual-recursive structure. As NRSfM is a highly under-constrained problem, we propose two new pairwise regularization to further regularize the reconstruction. The Rigidity-based Pairwise Contrastive Loss regularizes the shape representation by encouraging higher similarity between the representations of high-rigidity pairs of frames than low-rigidity pairs. We propose minimum singular-value ratio to measure the pairwise rigidity. The Pairwise Consistency Loss enforces the reconstruction to be consistent when the estimated shapes and cameras are exchanged between pairs. Our approach achieves state-of-the-art performance on CMU MOCAP and PASCAL3D+ dataset.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 15 of its 52 references that are in the map. First posted on arXiv 17 Aug 2021.
Builds on
15 of 52 references.
References · 15
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2019Contrastive Multiview Codingcited by 1,297
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2019Unsupervised 3D Pose Estimation with Geometric Self-Supervisioncited by 95
- 2020An Analysis of SVD for Deep Rotation Estimationcited by 85
- 2020Info3D: Representation Learning on 3D Objects using Mutual Information Maximization and Contrastive Learningcited by 68
- 2019C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motioncited by 60
- 2017Pixel Recursive Super Resolutioncited by 44
- 2018Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspectivecited by 19
- 2018Structure from Recurrent Motion: From Rigidity to Recurrencycited by 16
- 2021Self-Supervised Visibility Learning for Novel View Synthesiscited by 14
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 2; 2024: 1; 2025: 0; 2026: 1.
9 papers.
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videoscited by 10
- 2022Deep Non-rigid Structure-from-Motion: A Sequence-to-Sequence Translation Perspectivecited by 8
- 2022MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Viewscited by 7
- 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modelingcited by 7
- 2021End-to-End Learning of Multi-category 3D Pose and Shape Estimationcited by 1
- 2022Piecewise Planar Hulls for Semi-Supervised Learning of 3D Shape and Pose from 2D Imagescited by 0
- 2026SSR: A Training-Free Approach for Streaming 3D Reconstructioncited by 0
- 2026SSR: A Training-Free Approach for Streaming 3D Reconstruction16 Mar 2026
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modeling18 Aug 2023
- 2023CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videos14 Apr 2023
- 2022Piecewise Planar Hulls for Semi-Supervised Learning of 3D Shape and Pose from 2D Images14 Nov 2022
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstruction27 Oct 2022
- 2022MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views19 Jul 2022
- 2022Deep Non-rigid Structure-from-Motion: A Sequence-to-Sequence Translation Perspective10 Apr 2022
- 2021End-to-End Learning of Multi-category 3D Pose and Shape Estimation19 Dec 2021