Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Language-guided Medical Image Segmentation (LMIS) has shown great potential to improve the delineation of anatomical structures and lesions by integrating clinical textual information. Existing methods generally rely on either implicit interaction between textual and visual features or auxiliary coarse-grained supervision for cross-modal alignment. However, these methods lack explicit and fine-grained constraints to ensure semantic consistency, causing a mismatch between language and the segmentation outputs. To address this issue, we propose Text-as-Illumination Retinex Network (TIRNet), a novel Retinex-inspired framework that treats text embeddings as semantic illumination for feature modulation, thereby improving semantic consistency in LMIS. TIRNet introduces two key blocks integrated at each decoder stage: (1) the Retinex-inspired Text Modulation Block (RTMB), which employs positive and negative illumination maps to enhance text-relevant foreground features and suppress background interference; and (2) the Consistent Detail Compensation Block (CDCB), which selectively recovers high-frequency details via a consistency-gated mechanism conditioned on illumination reliability. Furthermore, we propose a Multi-Scale Illumination Supervision Loss (MSIS-Loss), comprising a Region-Grounded Contrastive Loss (RGC-Loss) that enforces cross-modal similarity to be concentrated in text-relevant foreground regions and suppressed in background regions, and a Background Suppression Loss (BS-Loss) that provides pixel-level supervision for negative illumination maps, jointly ensuring a precise cross-modal alignment at each decoder stage. Extensive experiments on the MosMedData+ and QaTa-COV19 datasets demonstrate that TIRNet achieves state-of-the-art performance in LMIS. The code is available at: https://github.com/anaanaa/TIRNet.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
18 of 30 references.
References · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018Group Normalizationcited by 1,524
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
- 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
- 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
- 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
6 more
- 2023Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray imagescited by 34
- 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 28
- 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 23
- 2024SelfReg-UNet: Self-Regularized UNet for Medical Image Segmentationcited by 18
- 2023TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Imagescited by 13
- 2022Semantic decomposition Network with Contrastive and Structural Constraints for Dental Plaque Segmentationcited by 2
Built on by
Not cited yet.