UniPro: Unified Multi-Mode Medical Image Segmentation from 2D Images to 3D Volumes via Propagation
Not on the map. Why?
Abstract (arXiv)
Medical image segmentation remains fragmented along two axes: segmentation paradigms and data dimensionality. Existing methods are typically developed separately for semantic, in-context, and interactive segmentation, and are further specialized to either native 2D images or 3D volumetric data. In clinical practice, however, segmentation workflows take many forms: a case may be initialized by semantic prediction, reference-guided segmentation, or user interaction. Regardless of how it begins, fine-grained refinement is naturally performed on 2D views; for volumetric scans, such 2D edits must propagate coherently to the rest of the volume. We present UniPro, a unified model that bridges segmentation paradigms and data dimensionality, using propagation to extend 2D segmentation to 3D volumes. Our key insight is that volumetric propagation and in-context segmentation share the same reference-conditioned prediction mechanism, differing only in whether the reference image-mask pairs come from other cases or from previously segmented neighboring slices. Building on this view, UniPro supports semantic, in-context, interactive, and propagation-based segmentation within a single slice-based framework, using class priors, reference exemplars, user clicks, and neighboring-slice predictions as mode-specific conditioning inputs. To improve propagation reliability, UniPro further incorporates bidirectional and 3D supervision to regularize slice-wise propagation beyond per-slice losses. Extensive experiments across diverse modalities and anatomies show that UniPro achieves strong performance across all segmentation settings, enabling annotation-efficient 3D segmentation from sparse 2D initialization and reducing slice-by-slice correction effort.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 3 Oct 2026.
Builds on
38 of 54 references.
References · 38
- 2023Segment Anythingcited by 8,234
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
- 2017Deep Learning for Medical Image Analysiscited by 401
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
- 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 224
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
26 more
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 172
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 163
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 111
- 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 96
- 2023UniverSeg: Universal Medical Image Segmentationcited by 91
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 87
- 2021NeoUNet: Towards accurate colon polyp segmentation and neoplasm detectioncited by 51
- 2023UniSeg: A Prompt-driven Universal Segmentation Model as well as A Strong Representation Learnercited by 47
- 2025nnInteractive: Redefining 3D Promptable Segmentationcited by 41
- 2023Training Like a Medical Resident: Context-Prior Learning Toward Universal Medical Image Segmentationcited by 33
- 2020Bridging 2D and 3D Segmentation Networks for Computation Efficient Volumetric Medical Image Segmentation: An Empirical Study of 2.5D Solutionscited by 31
- 2021iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Imagescited by 28
- 2025A co-evolving agentic AI system for medical imaging analysiscited by 17
- 2021Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised Learningcited by 16
- 2025Show and Segment: Universal Medical Image Segmentation via In-Context Learningcited by 16
- 2024MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidancecited by 13
- 2024Clustering Propagation for Universal Medical Image Segmentationcited by 12
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learningcited by 8
- 2024RevSAM2: Prompt SAM2 for Medical Image Segmentation via Reverse-Propagation without Fine-tuningcited by 7
- 2024Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Networkcited by 6
- 2025Accelerating Volumetric Medical Image Annotation via Short-Long Memory SAM 2cited by 5
- 2024VerSe: Integrating Multiple Queries as Prompts for Versatile Cardiac MRI Segmentationcited by 3
- 2025K-Prism: A Knowledge-Guided and Prompt Integrated Universal Medical Image Segmentation Modelcited by 3
- 2025Atlas is Your Perfect Context: One-Shot Customization for Generalizable Foundational Medical Image Segmentationcited by 3
- 2024PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Imagescited by 1
Built on by
Not cited yet.