One-shot Joint Extraction, Registration and Segmentation of Neuroimaging Data
Not on the map. Why?
Abstract (arXiv)
Brain extraction, registration and segmentation are indispensable preprocessing steps in neuroimaging studies. The aim is to extract the brain from raw imaging scans (i.e., extraction step), align it with a target brain image (i.e., registration step) and label the anatomical brain regions (i.e., segmentation step). Conventional studies typically focus on developing separate methods for the extraction, registration and segmentation tasks in a supervised setting. The performance of these methods is largely contingent on the quantity of training samples and the extent of visual inspections carried out by experts for error correction. Nevertheless, collecting voxel-level labels and performing manual quality control on high-dimensional neuroimages (e.g., 3D MRI) are expensive and time-consuming in many medical studies. In this paper, we study the problem of one-shot joint extraction, registration and segmentation in neuroimaging data, which exploits only one labeled template image (a.k.a. atlas) and a few unlabeled raw images for training. We propose a unified end-to-end framework, called JERS, to jointly optimize the extraction, registration and segmentation tasks, allowing feedback among them. Specifically, we use a group of extraction, registration and segmentation modules to learn the extraction mask, transformation and segmentation mask, where modules are interconnected and mutually reinforced by self-supervision. Empirical results on real-world datasets demonstrate that our proposed method performs exceptionally in the extraction, registration and segmentation tasks. Our code and data can be found at https://github.com/Anonymous4545/JERS
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 56 references that are in the map. First posted on arXiv 27 Jul 2023.
Builds on
19 of 56 references.
References · 19
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2015Spatial Transformer Networkscited by 1,429
- 2016Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentationcited by 263
- 2018An Unsupervised Learning Model for Deformable Medical Image Registrationcited by 150
- 2019Data augmentation using learned transformations for one-shot medical image segmentationcited by 138
- 2019Recursive Cascaded Networks for Unsupervised Medical Image Registrationcited by 105
- 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
- 2019DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentationcited by 66
- 2020LT-Net: Label Transfer by Learning Reversible Voxel-wise Correspondence for One-shot Medical Image Segmentationcited by 28
- 2020Recurrent Multi-view Alignment Network for Unsupervised Surface Registrationcited by 19
7 more
- 2020Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Imagescited by 17
- 2021Modeling the Probabilistic Distribution of Unlabeled Data forOne-shot Medical Image Segmentationcited by 17
- 2018A Multi-stage Framework with Context Information Fusion Structure for Skin Lesion Segmentationcited by 12
- 2021Gaussian Mixture Graphical Lasso with Application to Edge Detection in Brain Networkscited by 4
- 2022Deep Representations for Time-varying Brain Datasetscited by 3
- 2022ABN: Anti-Blur Neural Networks for Multi-Stage Deformable Image Registrationcited by 3
- 2022ERNet: Unsupervised Collective Extraction and Registration in Neuroimaging Datacited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.
3 papers.