# VIBESegmentator: Full Body MRI Segmentation for the NAKO and UK Biobank

arXiv: https://arxiv.org/abs/2406.00125 · HTML: https://mlsanity.com/paper/2406.00125/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 43 references that are in the map.
- First posted on arXiv 31 May 2024.

## Builds on (most cited first, 12 of 12)

- [TotalSegmentator: robust segmentation of 104 anatomical structures in CT images](https://mlsanity.com/paper/2208.05868/) (2022)
- [Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation](https://mlsanity.com/paper/1908.10454/) (2019)
- [Segment Anything in Medical Images](https://mlsanity.com/paper/2304.12306/) (2023)
- [VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images](https://mlsanity.com/paper/2001.09193/) (2020)
- [TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRI](https://mlsanity.com/paper/2405.19492/) (2024)
- [AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weeks](https://mlsanity.com/paper/2305.09666/) (2023)
- [Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation](https://mlsanity.com/paper/2308.09345/) (2023)
- [Panoptica -- instance-wise evaluation of 3D semantic and instance segmentation maps](https://mlsanity.com/paper/2312.02608/) (2023)
- [SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation](https://mlsanity.com/paper/2402.16368/) (2024)
- [MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI](https://mlsanity.com/paper/2405.05944/) (2024)
- [MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT](https://mlsanity.com/paper/2405.06463/) (2024)
- [Using UK Biobank data to establish population-specific atlases from whole body MRI](https://mlsanity.com/paper/2308.14365/) (2023)

## Built on by (most cited first, 11 of 11)

- [MedNeXt-v2: Scaling 3D ConvNeXts for Large-Scale Supervised Representation Learning in Medical Image Segmentation](https://mlsanity.com/paper/2512.17774/) (2025)
- [UKBOB: One Billion MRI Labeled Masks for Generalizable 3D Medical Image Segmentation](https://mlsanity.com/paper/2504.06908/) (2025)
- [BackSplit: The Importance of Sub-dividing the Background in Biomedical Lesion Segmentation](https://mlsanity.com/paper/2511.19394/) (2025)
- [Whole-body Representation Learning For Competing Preclinical Disease Risk Assessment](https://mlsanity.com/paper/2508.02307/) (2025)
- [Benchmarking of Deep Learning Methods for Generic MRI Multi-Organ Abdominal Segmentation](https://mlsanity.com/paper/2507.17971/) (2025)
- [A method for tissue-mask supported whole-body image registration in the UK Biobank](https://mlsanity.com/paper/2512.02702/) (2025)
- [In search of truth: Evaluating concordance of AI-based anatomy segmentation models](https://mlsanity.com/paper/2512.15921/) (2025)
- [Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representations](https://mlsanity.com/paper/2603.13590/) (2026)
- [Do We Really Need Diffusion? A Fast U-Net for Paired Medical Image Translation](https://mlsanity.com/paper/2606.17675/) (2026)
- [Population-Scale Segmentation of Penile Tissue in DIXON MRI using Deep Learning for Quantitative Phenotyping in Male Reproductive Health](https://mlsanity.com/paper/2607.02127/) (2026)
- [Towards Accurate and Fast Clinical Body Composition: A Resource-Efficient Hierarchical Segmentation Framework for Multi-Source CT](https://mlsanity.com/paper/2607.07177/) (2026)

## Abstract (arXiv)

Objectives: To present a publicly available deep learning-based torso segmentation model that provides comprehensive voxel-wise coverage, including delineations that extend to the boundaries of anatomical compartments. Materials and Methods: We extracted preliminary segmentations from TotalSegmentator, spine, and body composition models for Magnetic Resonance Tomography (MR) images, then improved them iteratively and retrained an nnUNet model. Using a random retrospective subset of German National Cohort (NAKO), UK Biobank, internal MR and Computed Tomography (CT) data (Training: 2897 series from 626 subjects, 290 female; mean age 53+-16; 3-fold-cross validation (20% hold-out). Internal testing 36 series from 12 subjects, 6 male; mean age 60+-11), we segmented 71 structures in torso MR and 72 in CT images: 20 organs, 10 muscles, 19 vessels, 16 bones, ribs in CT, intervertebral discs, spinal cord, spinal canal and body composition (subcutaneous fat, unclassified muscles and visceral fat). For external validation, we used existing automatic organ segmentations, independent ground truth segmentations on gradient echo images, and the Amos data. We used non-parametric bootstrapping for confidence intervals and Wilcoxon rank-sum test for computing statistical significance. Results: We achieved an average Dice score of 0.90+-0.06 on our internal gradient echo test set, which included 71 semantic segmentation labels. Our model ties with the best model on Amos with a Dice of 0,81+-0.14, while having a larger field of view and a considerably higher number structures included. Conclusion: Our work presents a publicly available full-torso segmentation model for MRI and CT images that classifies almost all subject voxels to date.
