Toward Robust Neural Reconstruction from Sparse Point Sets
Not on the map. Why?
Abstract (arXiv)
We consider the challenging problem of learning Signed Distance Functions (SDF) from sparse and noisy 3D point clouds. In contrast to recent methods that depend on smoothness priors, our method, rooted in a distributionally robust optimization (DRO) framework, incorporates a regularization term that leverages samples from the uncertainty regions of the model to improve the learned SDFs. Thanks to tractable dual formulations, we show that this framework enables a stable and efficient optimization of SDFs in the absence of ground truth supervision. Using a variety of synthetic and real data evaluations from different modalities, we show that our DRO based learning framework can improve SDF learning with respect to baselines and the state-of-the-art methods.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 63 of its 94 references that are in the map. First posted on arXiv 20 Dec 2024.
Builds on
63 of 94 references.
References · 63
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2020Convolutional Occupancy Networkscited by 761
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
38 more
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2017Neural 3D Mesh Renderercited by 437
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 337
- 2019Neural Point-Based Graphicscited by 327
- 2015Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulationscited by 291
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 185
- 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 147
- 2015Distributionally Robust Logistic Regressioncited by 126
- 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2018Auxiliary Tasks in Multi-task Learningcited by 108
- 2023Neural Kernel Surface Reconstructioncited by 104
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2013Data-Driven Robust Optimizationcited by 85
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2015Distributional Smoothing with Virtual Adversarial Trainingcited by 61
- 2022Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priorscited by 60
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2022Surface Reconstruction from Point Clouds by Learning Predictive Context Priorscited by 54
- 2020Neural Splines: Fitting 3D Surfaces with Infinitely-Wide Neural Networkscited by 52
- 2020Meshing Point Clouds with Predicted Intrinsic-Extrinsic Ratio Guidancecited by 39
- 2021Phase Transitions, Distance Functions, and Implicit Neural Representationscited by 38
- 2021Sinkhorn Distributionally Robust Optimizationcited by 38
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
- 2022A Unified Wasserstein Distributional Robustness Framework for Adversarial Trainingcited by 36
- 2020Implicit Feature Networks for Texture Completion from Partial 3D Datacited by 31
- 2022Iterative Poisson Surface Reconstruction (iPSR) for Unoriented Pointscited by 31
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2020Dynamic Plane Convolutional Occupancy Networkscited by 24
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2025: 5.
5 papers.
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 8
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2025Anti-Aliased 2D Gaussian Splattingcited by 7
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splattingcited by 3
- 2025Iterative Sampling Methods for Sinkhorn Distributionally Robust Optimizationcited by 1
- 2025Iterative Sampling Methods for Sinkhorn Distributionally Robust Optimization14 Dec 2025
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting16 Jun 2025
- 2025Anti-Aliased 2D Gaussian Splatting12 Jun 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025