A skeletonization algorithm for gradient-based optimization
Not on the map. Why?
Abstract (arXiv)
The skeleton of a digital image is a compact representation of its topology, geometry, and scale. It has utility in many computer vision applications, such as image description, segmentation, and registration. However, skeletonization has only seen limited use in contemporary deep learning solutions. Most existing skeletonization algorithms are not differentiable, making it impossible to integrate them with gradient-based optimization. Compatible algorithms based on morphological operations and neural networks have been proposed, but their results often deviate from the geometry and topology of the true medial axis. This work introduces the first three-dimensional skeletonization algorithm that is both compatible with gradient-based optimization and preserves an object's topology. Our method is exclusively based on matrix additions and multiplications, convolutional operations, basic non-linear functions, and sampling from a uniform probability distribution, allowing it to be easily implemented in any major deep learning library. In benchmarking experiments, we prove the advantages of our skeletonization algorithm compared to non-differentiable, morphological, and neural-network-based baselines. Finally, we demonstrate the utility of our algorithm by integrating it with two medical image processing applications that use gradient-based optimization: deep-learning-based blood vessel segmentation, and multimodal registration of the mandible in computed tomography and magnetic resonance images.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 14 of its 48 references that are in the map. First posted on arXiv 5 Sep 2023.
Builds on
14 of 48 references.
References · 14
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 286
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2020Dynamic Feature Integration for Simultaneous Detection of Salient Object, Edge and Skeletoncited by 34
- 2016DeepSkeleton: Learning Multi-task Scale-associated Deep Side Outputs for Object Skeleton Extraction in Natural Imagescited by 13
- 2018AirLab: Autograd Image Registration Laboratorycited by 12
- 2019SkelNetOn 2019: Dataset and Challenge on Deep Learning for Geometric Shape Understandingcited by 10
2 more
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 6; 2026: 4.
17 papers.
Sort:
- 2023The TopCoW Challenge -- Topology-Aware Circle of Willis Segmentation for CT and MR Angiographycited by 48
- 2024Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structurescited by 43
- 2024Centerline Boundary Dice Loss for Vascular Segmentationcited by 27
- 2024Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentationcited by 17
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generationcited by 2
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphscited by 2
- 2026NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initializationcited by 2
- 2025Skelite: Compact Neural Networks for Efficient Iterative Skeletonizationcited by 1
- 2025Parametric shape models for vessels learned from segmentations via differentiable voxelizationcited by 1
- 2025Does the Skeleton-Recall Loss Really Work?cited by 1
- 2024Evaluation of Blood Vessel Segmentation Methods on Hard-to-Detect Vascular Structurescited by 0
- 2024Enhancing the automatic segmentation and analysis of 3D liver vasculature modelscited by 0
5 more
- 2025MorphoSkel3D: Morphological Skeletonization of 3D Point Clouds for Informed Sampling in Object Classification and Retrievalcited by 0
- 2025ContextLoss: Context Information for Topology-Preserving Segmentationcited by 0
- 2026Continuous-tone Simple Points: An ℓ0-Norm of Cyclic Gradient for Topology-Preserving Data-Driven Image Segmentationcited by 0
- 2026RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extractioncited by 0
- 2026Sparse cubical complexes for efficient topology-preservation in image datacited by 0
- 2026Sparse cubical complexes for efficient topology-preservation in image data29 Sep 2026
- 2026RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extraction26 May 2026
- 2026Continuous-tone Simple Points: An ℓ0-Norm of Cyclic Gradient for Topology-Preserving Data-Driven Image Segmentation30 Apr 2026
- 2026NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization24 Mar 2026
- 2025Does the Skeleton-Recall Loss Really Work?15 Aug 2025
- 2025Parametric shape models for vessels learned from segmentations via differentiable voxelization3 Jul 2025
- 2025ContextLoss: Context Information for Topology-Preserving Segmentation10 Jun 2025
- 2025Skelite: Compact Neural Networks for Efficient Iterative Skeletonization10 Mar 2025
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphs17 Feb 2025
- 2025MorphoSkel3D: Morphological Skeletonization of 3D Point Clouds for Informed Sampling in Object Classification and Retrieval22 Jan 2025
- 2024Enhancing the automatic segmentation and analysis of 3D liver vasculature models24 Nov 2024
- 2024Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation5 Nov 2024
5 more
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generation10 Jul 2024
- 2024Centerline Boundary Dice Loss for Vascular Segmentation1 Jul 2024
- 2024Evaluation of Blood Vessel Segmentation Methods on Hard-to-Detect Vascular Structures19 Jun 2024
- 2024Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structures3 Apr 2024
- 2023The TopCoW Challenge -- Topology-Aware Circle of Willis Segmentation for CT and MR Angiography29 Dec 2023
- 2023The TopCoW Challenge -- Topology-Aware Circle of Willis Segmentation for CT and MR Angiographycited by 48
- 2024Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structurescited by 43
- 2024Centerline Boundary Dice Loss for Vascular Segmentationcited by 27
- 2024Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentationcited by 17
- 2024RoBus: A Multimodal Dataset for Controllable Road Networks and Building Layouts Generationcited by 2
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphscited by 2
- 2026NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initializationcited by 2
- 2025Skelite: Compact Neural Networks for Efficient Iterative Skeletonizationcited by 1
- 2025Parametric shape models for vessels learned from segmentations via differentiable voxelizationcited by 1
- 2025Does the Skeleton-Recall Loss Really Work?cited by 1
- 2024Evaluation of Blood Vessel Segmentation Methods on Hard-to-Detect Vascular Structurescited by 0
- 2024Enhancing the automatic segmentation and analysis of 3D liver vasculature modelscited by 0
12 most cited of 17 All 17 (JSON)
- 2026Sparse cubical complexes for efficient topology-preservation in image data29 Sep 2026
- 2026RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extraction26 May 2026
- 2026Continuous-tone Simple Points: An ℓ0-Norm of Cyclic Gradient for Topology-Preserving Data-Driven Image Segmentation30 Apr 2026
- 2026NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization24 Mar 2026
- 2025Does the Skeleton-Recall Loss Really Work?15 Aug 2025
- 2025Parametric shape models for vessels learned from segmentations via differentiable voxelization3 Jul 2025
- 2025ContextLoss: Context Information for Topology-Preserving Segmentation10 Jun 2025
- 2025Skelite: Compact Neural Networks for Efficient Iterative Skeletonization10 Mar 2025
- 2025GraphMorph: Tubular Structure Extraction by Morphing Predicted Graphs17 Feb 2025
- 2025MorphoSkel3D: Morphological Skeletonization of 3D Point Clouds for Informed Sampling in Object Classification and Retrieval22 Jan 2025
- 2024Enhancing the automatic segmentation and analysis of 3D liver vasculature models24 Nov 2024
- 2024Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation5 Nov 2024
12 newest of 17 All 17 (JSON)