Improving Deep Learning-based Automatic Cranial Defect Reconstruction by Heavy Data Augmentation: From Image Registration to Latent Diffusion Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Modeling and manufacturing of personalized cranial implants are important research areas that may decrease the waiting time for patients suffering from cranial damage. The modeling of personalized implants may be partially automated by the use of deep learning-based methods. However, this task suffers from difficulties with generalizability into data from previously unseen distributions that make it difficult to use the research outcomes in real clinical settings. Due to difficulties with acquiring ground-truth annotations, different techniques to improve the heterogeneity of datasets used for training the deep networks have to be considered and introduced. In this work, we present a large-scale study of several augmentation techniques, varying from classical geometric transformations, image registration, variational autoencoders, and generative adversarial networks, to the most recent advances in latent diffusion models. We show that the use of heavy data augmentation significantly increases both the quantitative and qualitative outcomes, resulting in an average Dice Score above 0.94 for the SkullBreak and above 0.96 for the SkullFix datasets. Moreover, we show that the synthetically augmented network successfully reconstructs real clinical defects. The work is a considerable contribution to the field of artificial intelligence in the automatic modeling of personalized cranial implants.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 25 of its 56 references that are in the map. First posted on arXiv 10 Jun 2024.
Builds on
25 of 56 references.
References · 25
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Neural Discrete Representation Learningcited by 4,650
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2019An Introduction to Variational Autoencoderscited by 997
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 368
- 2023Effective Data Augmentation With Diffusion Modelscited by 282
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2018Synthetic Data Augmentation using GAN for Improved Liver Lesion Classificationcited by 136
- 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
- 2018IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesiscited by 85
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2021Conditional Deformable Image Registration with Convolutional Neural Networkcited by 59
13 more
- 2019Voxel2Mesh: 3D Mesh Model Generation from Volumetric Datacited by 52
- 2021GAN-Based Data Augmentation and Anonymization for Skin-Lesion Analysis: A Critical Reviewcited by 25
- 2020Soft-IntroVAE: Analyzing and Improving the Introspective Variational Autoencodercited by 23
- 2023Point Cloud Diffusion Models for Automatic Implant Generationcited by 19
- 2020A Baseline Approach for AutoImplant: the MICCAI 2020 Cranial Implant Design Challengecited by 10
- 2022Deep Learning-based Framework for Automatic Cranial Defect Reconstruction and Implant Modelingcited by 8
- 2023High-Resolution Cranial Defect Reconstruction by Iterative, Low-Resolution, Point Cloud Completion Transformerscited by 6
- 2020Cranial Implant Design via Virtual Craniectomy with Shape Priorscited by 5
- 2021Learning to Rearrange Voxels in Binary Segmentation Masks for Smooth Manifold Triangulationcited by 5
- 2020Data Augmentation with norm-VAE for Unsupervised Domain Adaptationcited by 4
- 2023Deep Generative Networks for Heterogeneous Augmentation of Cranial Defectscited by 4
- 2020Cranial Implant Prediction using Low-Resolution 3D Shape Completion and High-Resolution 2D Refinementcited by 3
- 2024Automatic Cranial Defect Reconstruction with Self-Supervised Deep Deformable Masked Autoencoderscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2022Back to the Roots: Reconstructing Large and Complex Cranial Defects using an Image-based Statistical Shape Model
- 2023Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
- 2024Skull-to-Face: Anatomy-Guided 3D Facial Reconstruction and Editing
- 2026MedPCFM-TED: One-Step Point Cloud Flow Matching for Implant Generation via Teacher-Guided Endpoint Distillation
- 2026Cranio-Diff: Diffusion-based Cross-domain Craniofacial Reconstruction with 2D X-ray Skull Guidance and Structural Identity Constraints
- 2022Brain Imaging Generation with Latent Diffusion Models
- 2024Synthetic Augmentation for Anatomical Landmark Localization using DDPMs
- 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completion