Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
Not on the map. Why?
Abstract (arXiv)
Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in attempt to predict 3D shapes, where information is rich only on the surfaces. In this paper, we propose a novel 3D generative modeling framework to efficiently generate object shapes in the form of dense point clouds. We use 2D convolutional operations to predict the 3D structure from multiple viewpoints and jointly apply geometric reasoning with 2D projection optimization. We introduce the pseudo-renderer, a differentiable module to approximate the true rendering operation, to synthesize novel depth maps for optimization. Experimental results for single-image 3D object reconstruction tasks show that we outperforms state-of-the-art methods in terms of shape similarity and prediction density.
Key facts. Cited by 133 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 31; 2023: 27; 2024: 17; 2025: 11; 2026: 7.
133 papers.
Sort:
By area:
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2021Advances in Neural Renderingcited by 365
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
38 more
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2021The Power of Points for Modeling Humans in Clothingcited by 90
- 2022What's in your hands? 3D Reconstruction of Generic Objects in Handscited by 90
- 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
- 2021SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elementscited by 72
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2024Advances in 3D Generation: A Surveycited by 62
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2023Cross-Ray Neural Radiance Fields for Novel-view Synthesis from Unconstrained Image Collectionscited by 54
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2022Learning Implicit Templates for Point-Based Clothed Human Modelingcited by 50
- 2022NeuPhysics: Editable Neural Geometry and Physics from Monocular Videoscited by 50
- 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
- 2021Point-set Distances for Learning Representations of 3D Point Cloudscited by 48
- 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
- 2022Approximate Differentiable Rendering with Algebraic Surfacescited by 44
- 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
- 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
- 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 32
- 2023A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsamplingcited by 28
- 2021Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matchingcited by 26
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulationcited by 26
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 24
- 2023CloSET: Modeling Clothed Humans on Continuous Surface with Explicit Template Decompositioncited by 21
- 2021CoCoNets: Continuous Contrastive 3D Scene Representationscited by 19
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstructioncited by 18
- 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Cloudscited by 16
- 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistencycited by 16
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 16
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
- 2021FINet: Dual Branches Feature Interaction for Partial-to-Partial Point Cloud Registrationcited by 14
- 2023Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylizationcited by 14
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priorscited by 14
- 2022AGConv: Adaptive Graph Convolution on 3D Point Cloudscited by 13
- 2021Vision-based Neural Scene Representations for Spacecraftcited by 12
50 most cited of 133 All 133 (JSON)
- 2026Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization11 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026Sketch2MinSurf: Vision-Language Guided Generation of Editable Minimal Surfaces from Hand-Drawn Sketches20 May 2026
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch10 Apr 2026
- 2026GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting2 Apr 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2026Dexterous Manipulation Policies from RGB Human Videos via 3D Hand-Object Trajectory Reconstruction9 Feb 2026
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splatting20 Aug 2025
- 2025Rate-distortion Optimized Point Cloud Preprocessing for Geometry-based Point Cloud Compression3 Aug 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
- 2025Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions7 May 2025
- 2025Learning Multi-frame and Monocular Prior for Estimating Geometry in Dynamic Scenes3 May 2025
38 more
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors17 Apr 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2025D2USt3R: Enhancing 3D Reconstruction for Dynamic Scenes8 Apr 2025
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundness28 Mar 2025
- 2025GaussianFocus: Constrained Attention Focus for 3D Gaussian Splatting22 Mar 2025
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Images17 Mar 2025
- 2024Rendering-Oriented 3D Point Cloud Attribute Compression using Sparse Tensor-based Transformer12 Nov 2024
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion4 Oct 2024
- 2024Underground Mapping and Localization Based on Ground-Penetrating Radar24 Sep 2024
- 2024Curvy: A Parametric Cross-section based Surface Reconstruction1 Sep 2024
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classes26 Aug 2024
- 2024VF-NeRF: Learning Neural Vector Fields for Indoor Scene Reconstruction16 Aug 2024
- 2024A Comparative Study of Neural Surface Reconstruction for Scientific Visualization30 Jul 2024
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction5 Jul 2024
- 2024Lightweight Predictive 3D Gaussian Splats27 Jun 2024
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction10 Jun 2024
- 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models16 May 2024
- 2024SceneFactory: A Workflow-centric and Unified Framework for Incremental Scene Modeling13 May 2024
- 2024APC2Mesh: Bridging the gap from occluded building faccades to full 3D models3 Apr 2024
- 2024CHOSEN: Contrastive Hypothesis Selection for Multi-View Depth Refinement2 Apr 2024
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splatting22 Mar 2024
- 2024A Concept for Reconstructing Stucco Statues from historic Sketches using synthetic Data only8 Feb 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023DUSt3R: Geometric 3D Vision Made Easy21 Dec 2023
- 2023Ins-HOI: Instance Aware Human-Object Interactions Recovery15 Dec 2023
- 2023HumanReg: Self-supervised Non-rigid Registration of Human Point Cloud9 Dec 2023
- 2023A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling3 Dec 2023
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering30 Nov 2023
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstruction23 Nov 2023
- 2023Test-Time Augmentation for 3D Point Cloud Classification and Segmentation22 Nov 2023
- 2023Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloud13 Nov 2023
- 2023CADSim: Robust and Scalable in-the-wild 3D Reconstruction for Controllable Sensor Simulation2 Nov 2023
- 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistency30 Oct 2023
- 2023P2CADNet: An End-to-End Reconstruction Network for Parametric 3D CAD Model from Point Clouds4 Oct 2023
- 2023DefGoalNet: Contextual Goal Learning from Demonstrations For Deformable Object Manipulation25 Sep 2023
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Field16 Aug 2023
- 2023Cross-Ray Neural Radiance Fields for Novel-view Synthesis from Unconstrained Image Collections16 Jul 2023
- 2023Learning to Predict Scene-Level Implicit 3D from Posed RGBD Data14 Jun 2023
50 newest of 133 All 133 (JSON)
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2023A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsamplingcited by 28
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstructioncited by 18
- 20233D Colored Shape Reconstruction from a Single RGB Image through Diffusioncited by 0
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touchcited by 0
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch10 Apr 2026
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction5 Jul 2024
- 2023A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling3 Dec 2023
- 20233D Colored Shape Reconstruction from a Single RGB Image through Diffusion11 Feb 2023
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2021Advances in Neural Renderingcited by 365
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
12 most cited of 126 All 126 (JSON)
- 2026Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization11 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026Sketch2MinSurf: Vision-Language Guided Generation of Editable Minimal Surfaces from Hand-Drawn Sketches20 May 2026
- 2026GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting2 Apr 2026
- 2026Dexterous Manipulation Policies from RGB Human Videos via 3D Hand-Object Trajectory Reconstruction9 Feb 2026
- 2025Reconstruction Using the Invisible: Intuition from NIR and Metadata for Enhanced 3D Gaussian Splatting20 Aug 2025
- 2025Rate-distortion Optimized Point Cloud Preprocessing for Geometry-based Point Cloud Compression3 Aug 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
- 2025Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions7 May 2025
- 2025Learning Multi-frame and Monocular Prior for Estimating Geometry in Dynamic Scenes3 May 2025
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors17 Apr 2025
- 2025D2USt3R: Enhancing 3D Reconstruction for Dynamic Scenes8 Apr 2025
12 newest of 126 All 126 (JSON)