mlsanityData to 7 Oct 2026

MedDiT4SR: Tri-Stream Joint Adaptation of Pre-Trained Diffusion Transformers for Medical Image Super-Resolution

arXiv 2607.20598 ↗First posted 22 Jul 2026eess.IVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Medical image super-resolution (MedSR) requires recovering fine anatomical structures from degraded observations while avoiding unsupported details introduced by generative priors. Large-scale pre-trained multimodal diffusion transformers provide strong visual priors, but their adaptation to MedSR remains non-trivial. In conventional ControlNet-style adaptation, the low-resolution (LR) image is processed as an external condition and injected into the denoising stream through one-way connections. Consequently, LR anatomical evidence cannot be jointly updated with the evolving denoising and semantic representations. We propose MedDiT4SR, a tri-stream adaptation framework that integrates the LR, noisy latent, and text representations into the same multimodal diffusion-transformer blocks. To complement global token interaction, we introduce a Super-Resolution Adapter (SR Adapter) that aggregates scale-dependent local tokens and suppresses interpolation-induced redundancy. We further propose a Semantic Alignment Refiner (SA Refiner) that calibrates local LR responses using prompt-conditioned semantic information. Experiments under both in-domain and within-modality cross-dataset settings demonstrate the effectiveness of adapting large-scale pre-trained DiT models to medical image super-resolution across diverse imaging domains.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 13 of its 32 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

13 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Dual Prompting Image Restoration with Diffusion Transformers24 Apr

Other references · 12

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  5. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  6. 2020Pre-Trained Image Processing Transformercited by 891
  7. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  8. 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 226
  9. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
  10. 2025Exploring Multimodal Diffusion Transformers for Enhanced Prompt-based Image Editingcited by 16
  11. 2019Medical image super-resolution method based on dense blended attention networkcited by 1
  12. 2025Taming Stable Diffusion for Computed Tomography Blind Super-Resolutioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution
  2. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution
  3. 2024Improving Consistency in Diffusion Models for Image Super-Resolution
  4. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution
  5. 2023InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model
  6. 2026Scale-Cascaded Diffusion Models for Super-Resolution in Medical Imaging
  7. 2026When Latents Forget Pixels: Restoring Fidelity in Diffusion Transformer Super-Resolution
  8. 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement