Deep Point Cloud Reconstruction
Not on the map. Why?
Abstract (arXiv)
Point cloud obtained from 3D scanning is often sparse, noisy, and irregular. To cope with these issues, recent studies have been separately conducted to densify, denoise, and complete inaccurate point cloud. In this paper, we advocate that jointly solving these tasks leads to significant improvement for point cloud reconstruction. To this end, we propose a deep point cloud reconstruction network consisting of two stages: 1) a 3D sparse stacked-hourglass network as for the initial densification and denoising, 2) a refinement via transformers converting the discrete voxels into 3D points. In particular, we further improve the performance of transformer by a newly proposed module called amplified positional encoding. This module has been designed to differently amplify the magnitude of positional encoding vectors based on the points' distances for adaptive refinements. Extensive experiments demonstrate that our network achieves state-of-the-art performance among the recent studies in the ScanNet, ICL-NUIM, and ShapeNetPart datasets. Moreover, we underline the ability of our network to generalize toward real-world and unmet scenes.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 48 of its 75 references that are in the map. First posted on arXiv 23 Nov 2021.
Builds on
48 of 75 references.
References · 48
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2020Point Transformercited by 1,470
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2020Neural Sparse Voxel Fieldscited by 959
- 2016Stacked Hourglass Networks for Human Pose Estimationcited by 915
36 more
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
- 2018Pyramid Stereo Matching Networkcited by 489
- 2018PCN: Point Completion Networkcited by 384
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2020Deep Global Registrationcited by 229
- 2017Submanifold Sparse Convolutional Networkscited by 223
- 2018PU-Net: Point Cloud Upsampling Networkcited by 209
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2020PF-Net: Point Fractal Network for 3D Point Cloud Completioncited by 146
- 2018Generating 3D Adversarial Point Cloudscited by 144
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
- 2018Patch-based Progressive 3D Point Set Upsamplingcited by 101
- 2019PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Cloudscited by 99
- 2020PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Pathscited by 97
- 2019Interpolated Convolutional Networks for 3D Point Cloud Understandingcited by 86
- 2018EC-Net: an Edge-aware Point set Consolidation Networkcited by 84
- 2021Score-Based Point Cloud Denoisingcited by 83
- 2021Point Cloud Upsampling via Disentangled Refinementcited by 74
- 2021PointMixer: MLP-Mixer for Point Cloud Understandingcited by 71
- 2020Detail Preserved Point Cloud Completion via Separated Feature Aggregationcited by 70
- 2020Generative Sparse Detection Networks for 3D Single-shot Object Detectioncited by 69
- 2019Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaningcited by 58
- 2021VolumeFusion: Deep Depth Fusion for 3D Scene Reconstructioncited by 44
- 2020Learning Graph-Convolutional Representations for Point Cloud Denoisingcited by 40
- 2020PointTriNet: Learned Triangulation of 3D Point Setscited by 32
- 2020Learning Delaunay Surface Elements for Mesh Reconstructioncited by 23
- 2021Volumetric Propagation Network: Stereo-LiDAR Fusion for Long-Range Depth Estimationcited by 15
- 2021Stereo Object Matching Networkcited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 3; 2025: 6; 2026: 1.
15 papers.
Sort:
By area:
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2022Towards Scale Balanced 6-DoF Grasp Detection in Cluttered Scenescited by 21
- 2025SuperPC: A Single Diffusion Model for Point Cloud Completion, Upsampling, Denoising, and Colorizationcited by 21
- 2023SCP: Spherical-Coordinate-based Learned Point Cloud Compressioncited by 12
- 2025HORT: Monocular Hand-held Objects Reconstruction with Transformerscited by 11
- 2023Fine-grained Text and Image Guided Point Cloud Completion with CLIP Modelcited by 5
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environmentscited by 4
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstructioncited by 3
- 2024Multi-Type Point Cloud Autoencoder: A Complete Equivariant Embedding for Molecule Conformation and Posecited by 3
- 2025Re-Densification Meets Cross-Scale Propagation: Real-Time Neural Compression of LiDAR Point Cloudscited by 2
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Drivingcited by 2
- 2025SVRecon: Sparse Voxel Rasterization for Surface Reconstructioncited by 2
- 2026Towards Practical Lossless Neural Compression for LiDAR Point Clouds26 Mar 2026
- 2025Quantile Rendering: Efficiently Embedding High-dimensional Feature on 3D Gaussian Splatting24 Dec 2025
- 2025SVRecon: Sparse Voxel Rasterization for Surface Reconstruction21 Nov 2025
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving16 Sep 2025
- 2025Re-Densification Meets Cross-Scale Propagation: Real-Time Neural Compression of LiDAR Point Clouds28 Aug 2025
- 2025HORT: Monocular Hand-held Objects Reconstruction with Transformers27 Mar 2025
- 2025SuperPC: A Single Diffusion Model for Point Cloud Completion, Upsampling, Denoising, and Colorization18 Mar 2025
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environments4 Jun 2024
- 2024Multi-Type Point Cloud Autoencoder: A Complete Equivariant Embedding for Molecule Conformation and Pose22 May 2024
- 2024A survey of synthetic data augmentation methods in computer vision15 Mar 2024
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstruction23 Nov 2023
- 2023SCP: Spherical-Coordinate-based Learned Point Cloud Compression24 Aug 2023
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2022Towards Scale Balanced 6-DoF Grasp Detection in Cluttered Scenescited by 21
- 2023SCP: Spherical-Coordinate-based Learned Point Cloud Compressioncited by 12
- 2025HORT: Monocular Hand-held Objects Reconstruction with Transformerscited by 11
- 2023Fine-grained Text and Image Guided Point Cloud Completion with CLIP Modelcited by 5
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environmentscited by 4
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstructioncited by 3
- 2024Multi-Type Point Cloud Autoencoder: A Complete Equivariant Embedding for Molecule Conformation and Posecited by 3
- 2025Re-Densification Meets Cross-Scale Propagation: Real-Time Neural Compression of LiDAR Point Cloudscited by 2
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Drivingcited by 2
- 2025SVRecon: Sparse Voxel Rasterization for Surface Reconstructioncited by 2
- 2026Towards Practical Lossless Neural Compression for LiDAR Point Cloudscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Towards Practical Lossless Neural Compression for LiDAR Point Clouds26 Mar 2026
- 2025Quantile Rendering: Efficiently Embedding High-dimensional Feature on 3D Gaussian Splatting24 Dec 2025
- 2025SVRecon: Sparse Voxel Rasterization for Surface Reconstruction21 Nov 2025
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving16 Sep 2025
- 2025Re-Densification Meets Cross-Scale Propagation: Real-Time Neural Compression of LiDAR Point Clouds28 Aug 2025
- 2025HORT: Monocular Hand-held Objects Reconstruction with Transformers27 Mar 2025
- 2024RayProNet: A Neural Point Field Framework for Radio Propagation Modeling in 3D Environments4 Jun 2024
- 2024Multi-Type Point Cloud Autoencoder: A Complete Equivariant Embedding for Molecule Conformation and Pose22 May 2024
- 2024A survey of synthetic data augmentation methods in computer vision15 Mar 2024
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstruction23 Nov 2023
- 2023SCP: Spherical-Coordinate-based Learned Point Cloud Compression24 Aug 2023
- 2023Fine-grained Text and Image Guided Point Cloud Completion with CLIP Model17 Aug 2023
12 newest of 14 All 14 (JSON)