# PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Clouds

arXiv: https://arxiv.org/abs/2210.08305 · HTML: https://mlsanity.com/paper/2210.08305/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 57 references that are in the map.
- First posted on arXiv 15 Oct 2022.

## Builds on (most cited first, 22 of 22)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs](https://mlsanity.com/paper/1606.00915/) (2016)
- [Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1802.02611/) (2018)
- [Fast R-CNN](https://mlsanity.com/paper/1504.08083/) (2015)
- [ShapeNet: An Information-Rich 3D Model Repository](https://mlsanity.com/paper/1512.03012/) (2015)
- [V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation](https://mlsanity.com/paper/1606.04797/) (2016)
- [Dynamic Graph CNN for Learning on Point Clouds](https://mlsanity.com/paper/1801.07829/) (2018)
- [Rich feature hierarchies for accurate object detection and semantic segmentation](https://mlsanity.com/paper/1311.2524/) (2013)
- [3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation](https://mlsanity.com/paper/1606.06650/) (2016)
- [Soft-NMS -- Improving Object Detection With One Line of Code](https://mlsanity.com/paper/1704.04503/) (2017)
- [The Importance of Skip Connections in Biomedical Image Segmentation](https://mlsanity.com/paper/1608.04117/) (2016)
- [Adaptive NMS: Refining Pedestrian Detection in a Crowd](https://mlsanity.com/paper/1904.03629/) (2019)
- [3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes](https://mlsanity.com/paper/1607.00582/) (2016)
- [Point2Skeleton: Learning Skeletal Representations from Point Clouds](https://mlsanity.com/paper/2012.00230/) (2020)
- [3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis](https://mlsanity.com/paper/2112.04863/) (2021)
- [Tractogram filtering of anatomically non-plausible fibers with geometric deep learning](https://mlsanity.com/paper/2003.11013/) (2020)
- [Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentation](https://mlsanity.com/paper/2203.08964/) (2022)
- [Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction](https://mlsanity.com/paper/2012.07262/) (2020)
- [Single Neuron Segmentation using Graph-based Global Reasoning with Auxiliary Skeleton Loss from 3D Optical Microscope Images](https://mlsanity.com/paper/2101.08910/) (2021)
- [Learning Shape Representation on Sparse Point Clouds for Volumetric Image Segmentation](https://mlsanity.com/paper/1906.02281/) (2019)
- [Voxel-wise Cross-Volume Representation Learning for 3D Neuron Reconstruction](https://mlsanity.com/paper/2108.06522/) (2021)
- [Vascular surface segmentation for intracranial aneurysm isolation and quantification](https://mlsanity.com/paper/2005.14449/) (2020)

## Built on by (most cited first, 6 of 6)

- [Revisiting Point Cloud Completion: Are We Ready For The Real-World?](https://mlsanity.com/paper/2411.17580/) (2024)
- [Boosting 3D Neuron Segmentation with 2D Vision Transformer Pre-trained on Natural Images](https://mlsanity.com/paper/2405.02686/) (2024)
- [A Survey of Medical Point Cloud Shape Learning: Registration, Reconstruction and Variation](https://mlsanity.com/paper/2508.03057/) (2025)
- [NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization](https://mlsanity.com/paper/2603.23104/) (2026)
- [DINeuro: Distilling Knowledge from 2D Natural Images via Deformable Tubular Transferring Strategy for 3D Neuron Reconstruction](https://mlsanity.com/paper/2410.22078/) (2024)
- [NeuroRefiner: Morphology-Aware Multi-Agent Refinement for 3D Fluorescence Microscopy Neuron Segmentation](https://mlsanity.com/paper/2608.09636/) (2026)

## Abstract (arXiv)

Digital neuron reconstruction from 3D microscopy images is an essential technique for investigating brain connectomics and neuron morphology. Existing reconstruction frameworks use convolution-based segmentation networks to partition the neuron from noisy backgrounds before applying the tracing algorithm. The tracing results are sensitive to the raw image quality and segmentation accuracy. In this paper, we propose a novel framework for 3D neuron reconstruction. Our key idea is to use the geometric representation power of the point cloud to better explore the intrinsic structural information of neurons. Our proposed framework adopts one graph convolutional network to predict the neural skeleton points and another one to produce the connectivity of these points. We finally generate the target SWC file through the interpretation of the predicted point coordinates, radius, and connections. Evaluated on the Janelia-Fly dataset from the BigNeuron project, we show that our framework achieves competitive neuron reconstruction performance. Our geometry and topology learning of point clouds could further benefit 3D medical image analysis, such as cardiac surface reconstruction. Our code is available at https://github.com/RunkaiZhao/PointNeuron.
