ESICA: A Scalable Framework for Text-Guided 3D Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Text guided 3D medical image segmentation offers a flexible alternative to class based and spatial prompt based models by allowing users to specify regions of interest directly in natural language. This paradigm avoids reliance on predefined label sets, reduces ambiguous outputs, and aligns more naturally with clinical workflows. However, existing text guided frameworks are often computationally expensive, exhibit weak text volume feature alignment, and fail to capture fine anatomical details. We propose ESICA, a lightweight and scalable framework that addresses these challenges through three innovations: (1) a similarity matrix based mask prediction formulation that enhances semantic alignment, (2) an efficient decomposed decoder with adapter modules for accurate volumetric decoding, and (3) a two pass refinement strategy that sharpens boundaries and resolves uncertain regions. To improve training stability and generalization, ESICA adopts a two stage scheme consisting of positive only pretraining followed by balanced fine tuning. On the CVPR BiomedSegFM benchmark spanning five imaging modalities (CT, MRI, PET, ultrasound, and microscopy), ESICA achieves state of the art segmentation accuracy, while the compact ESICA4 Lite variant attains similar segmentation performance with substantially fewer parameters, yielding a superior efficiency accuracy trade off. Our framework advances text guided segmentation toward efficient, scalable, and clinically deployable systems. Code will be made publicly available at https://github.com/mirthAI/ESICA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
19 of 30 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023Segment Anythingcited by 8,158
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Image Segmentation Using Text and Image Promptscited by 509
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
7 more
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 101
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 86
- 2023Lightweight Transformers for Clinical Natural Language Processingcited by 15
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2024CAT: Coordinating Anatomical-Textual Prompts for Multi-Organ and Tumor Segmentationcited by 14
- 2025DCFormer: Efficient 3D Vision-Language Modeling with Decomposed Convolutionscited by 10
- 2024Efficient MedSAMs: Segment Anything in Medical Images on Laptopcited by 4
Built on by
Not cited yet.