# EC-Net: an Edge-aware Point set Consolidation Network

arXiv: https://arxiv.org/abs/1807.06010 · HTML: https://mlsanity.com/paper/1807.06010/

## Key facts

- Cited by 84 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Jul 2018.

## Built on by (most cited first, 30 of 84)

- [Neural Kernel Surface Reconstruction](https://mlsanity.com/paper/2305.19590/) (2023)
- [Point Cloud Upsampling via Disentangled Refinement](https://mlsanity.com/paper/2106.04779/) (2021)
- [Neural Fields as Learnable Kernels for 3D Reconstruction](https://mlsanity.com/paper/2111.13674/) (2021)
- [Neural Points: Point Cloud Representation with Neural Fields for Arbitrary Upsampling](https://mlsanity.com/paper/2112.04148/) (2021)
- [Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions](https://mlsanity.com/paper/2304.11846/) (2023)
- [PC2WF: 3D Wireframe Reconstruction from Raw Point Clouds](https://mlsanity.com/paper/2103.02766/) (2021)
- [Orienting Point Clouds with Dipole Propagation](https://mlsanity.com/paper/2105.01604/) (2021)
- [AdaFit: Rethinking Learning-based Normal Estimation on Point Clouds](https://mlsanity.com/paper/2108.05836/) (2021)
- [TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Clouds](https://mlsanity.com/paper/2407.12702/) (2024)
- [IterativePFN: True Iterative Point Cloud Filtering](https://mlsanity.com/paper/2304.01529/) (2023)
- [Deep Point Set Resampling via Gradient Fields](https://mlsanity.com/paper/2111.02045/) (2021)
- [NEF: Neural Edge Fields for 3D Parametric Curve Reconstruction from Multi-view Images](https://mlsanity.com/paper/2303.07653/) (2023)
- [NerVE: Neural Volumetric Edges for Parametric Curve Extraction from Point Cloud](https://mlsanity.com/paper/2303.16465/) (2023)
- [GraphFit: Learning Multi-scale Graph-Convolutional Representation for Point Cloud Normal Estimation](https://mlsanity.com/paper/2207.11484/) (2022)
- [PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling](https://mlsanity.com/paper/2203.00914/) (2022)
- [PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows](https://mlsanity.com/paper/2107.05893/) (2021)
- [SSPU-Net: Self-Supervised Point Cloud Upsampling via Differentiable Rendering](https://mlsanity.com/paper/2108.00454/) (2021)
- [PU-EVA: An Edge Vector based Approximation Solution for Flexible-scale Point Cloud Upsampling](https://mlsanity.com/paper/2204.10750/) (2022)
- [Deep Point Cloud Reconstruction](https://mlsanity.com/paper/2111.11704/) (2021)
- [Point Cloud Upsampling via Cascaded Refinement Network](https://mlsanity.com/paper/2210.03942/) (2022)
- [AGConv: Adaptive Graph Convolution on 3D Point Clouds](https://mlsanity.com/paper/2206.04665/) (2022)
- [SepicNet: Sharp Edges Recovery by Parametric Inference of Curves in 3D Shapes](https://mlsanity.com/paper/2304.06531/) (2023)
- [Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering](https://mlsanity.com/paper/2208.06811/) (2022)
- [PC2-PU: Patch Correlation and Point Correlation for Effective Point Cloud Upsampling](https://mlsanity.com/paper/2109.09337/) (2021)
- [PCDNF: Revisiting Learning-based Point Cloud Denoising via Joint Normal Filtering](https://mlsanity.com/paper/2209.00798/) (2022)
- [Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning](https://mlsanity.com/paper/2308.16484/) (2023)
- [EdgeGaussians -- 3D Edge Mapping via Gaussian Splatting](https://mlsanity.com/paper/2409.12886/) (2024)
- [FrePolad: Frequency-Rectified Point Latent Diffusion for Point Cloud Generation](https://mlsanity.com/paper/2311.12090/) (2023)
- [LighTN: Light-weight Transformer Network for Performance-overhead Tradeoff in Point Cloud Downsampling](https://mlsanity.com/paper/2202.06263/) (2022)
- [Lidar Upsampling with Sliced Wasserstein Distance](https://mlsanity.com/paper/2301.13558/) (2023)

## Abstract (arXiv)

Point clouds obtained from 3D scans are typically sparse, irregular, and noisy, and required to be consolidated. In this paper, we present the first deep learning based edge-aware technique to facilitate the consolidation of point clouds. We design our network to process points grouped in local patches, and train it to learn and help consolidate points, deliberately for edges. To achieve this, we formulate a regression component to simultaneously recover 3D point coordinates and point-to-edge distances from upsampled features, and an edge-aware joint loss function to directly minimize distances from output points to 3D meshes and to edges. Compared with previous neural network based works, our consolidation is edge-aware. During the synthesis, our network can attend to the detected sharp edges and enable more accurate 3D reconstructions. Also, we trained our network on virtual scanned point clouds, demonstrated the performance of our method on both synthetic and real point clouds, presented various surface reconstruction results, and showed how our method outperforms the state-of-the-arts.