mlsanityData to 14 Oct 2026

Dual-Domain Cross-Modal Decoding for Clinical Text-Guided Medical Image Segmentation

arXiv 2608.11335 ↗First posted 11 Aug 2026cs.CV cs.AI eess.IVcited by 1

Not on the map. Why?

Abstract (arXiv)

Clinical text can narrow down what to segment, but recent text-guided designs emphasize spatial alignment while overlooking frequency content that governs texture and boundaries. We propose Dual-Domain Cross-Modal Decoding (DD-CMD) for clinical text-guided pulmonary infection segmentation, integrating two complementary forms of language guidance during decoding. In the spatial domain, Text-Guided Spatial Cross-Attention (TGSA) aligns multi-scale visual tokens with text semantics and updates features through gated residual fusion. In the frequency domain, Spectral-Text Adaptive Modulation (STAM) applies a 2D DCT to compute learnable band-energy statistics and predicts text-conditioned FiLM parameters to recalibrate decoder channels for frequency-aware decoding. DD-CMD embeds TGSA and STAM into a coarse-to-fine decoder (7x7 to 56x56) and restores full-resolution masks using a lightweight two-stage refinement module. Experiments on QaTa-COV19 and MosMedData+ show that DD-CMD achieves 91.46% Dice / 84.26% mIoU and 81.95% Dice / 69.42% mIoU, respectively, with average gains of +1.96 Dice and +2.67 mIoU over the strongest prior baselines. Code: https://github.com/maklachur/DD-CMD.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

15 of 25 references.

References · 15

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2022A ConvNet for the 2020scited by 3,579
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  4. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  5. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  6. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  7. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
  8. 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 111
  9. 2020MosMedData: Chest CT Scans With COVID-19 Related Findings Datasetcited by 104
  10. 2022OSegNet: Operational Segmentation Network for COVID-19 Detection using Chest X-ray Imagescited by 48
  11. 2023Loss Functions in the Era of Semantic Segmentation: A Survey and Outlookcited by 34
  12. 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 28
3 more
  1. 2013A dwt, dct and svd based watermarking technique to protect the image piracycited by 12
  2. 2025Frequency-domain Multi-modal Fusion for Language-guided Medical Image Segmentationcited by 4
  3. 2026MambaLiteUNet: Cross-Gated Adaptive Feature Fusion for Robust Skin Lesion Segmentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Multimodal Routing and Region Refinement for Language-Guided Medical Image Segmentationcited by 0