mlsanityData to 14 Oct 2026

Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation

arXiv 2606.27794 ↗First posted 26 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Language-guided Medical Image Segmentation (LMIS) has shown great potential to improve the delineation of anatomical structures and lesions by integrating clinical textual information. Existing methods generally rely on either implicit interaction between textual and visual features or auxiliary coarse-grained supervision for cross-modal alignment. However, these methods lack explicit and fine-grained constraints to ensure semantic consistency, causing a mismatch between language and the segmentation outputs. To address this issue, we propose Text-as-Illumination Retinex Network (TIRNet), a novel Retinex-inspired framework that treats text embeddings as semantic illumination for feature modulation, thereby improving semantic consistency in LMIS. TIRNet introduces two key blocks integrated at each decoder stage: (1) the Retinex-inspired Text Modulation Block (RTMB), which employs positive and negative illumination maps to enhance text-relevant foreground features and suppress background interference; and (2) the Consistent Detail Compensation Block (CDCB), which selectively recovers high-frequency details via a consistency-gated mechanism conditioned on illumination reliability. Furthermore, we propose a Multi-Scale Illumination Supervision Loss (MSIS-Loss), comprising a Region-Grounded Contrastive Loss (RGC-Loss) that enforces cross-modal similarity to be concentrated in text-relevant foreground regions and suppressed in background regions, and a Background Suppression Loss (BS-Loss) that provides pixel-level supervision for negative illumination maps, jointly ensuring a precise cross-modal alignment at each decoder stage. Extensive experiments on the MosMedData+ and QaTa-COV19 datasets demonstrate that TIRNet achieves state-of-the-art performance in LMIS. The code is available at: https://github.com/anaanaa/TIRNet.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

18 of 30 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  5. 2018Group Normalizationcited by 1,524
  6. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  7. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
  8. 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
  9. 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 231
  10. 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
  11. 2022TGANet: Text-guided attention for improved polyp segmentationcited by 59
  12. 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
6 more
  1. 2023Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray imagescited by 34
  2. 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 28
  3. 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 23
  4. 2024SelfReg-UNet: Self-Regularized UNet for Medical Image Segmentationcited by 18
  5. 2023TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Imagescited by 13
  6. 2022Semantic decomposition Network with Contrastive and Structural Constraints for Dental Plaque Segmentationcited by 2

Built on by

Not cited yet.