mlsanityData to 14 Oct 2026

Structure-Accurate Medical Image Translation via Dynamic Frequency Balance and Knowledge Guidance

arXiv 2504.09441 ↗First posted 13 Apr 2025cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal medical images play a crucial role in the precise and comprehensive clinical diagnosis. Diffusion model is a powerful strategy to synthesize the required medical images. However, existing approaches still suffer from the problem of anatomical structure distortion due to the overfitting of high-frequency information and the weakening of low-frequency information. Thus, we propose a novel method based on dynamic frequency balance and knowledge guidance. Specifically, we first extract the low-frequency and high-frequency components by decomposing the critical features of the model using wavelet transform. Then, a dynamic frequency balance module is designed to adaptively adjust frequency for enhancing global low-frequency features and effective high-frequency details as well as suppressing high-frequency noise. To further overcome the challenges posed by the large differences between different medical modalities, we construct a knowledge-guided mechanism that fuses the prior clinical knowledge from a visual language model with visual features, to facilitate the generation of accurate anatomical structures. Experimental evaluations on multiple datasets show the proposed method achieves significant improvements in qualitative and quantitative assessments, verifying its effectiveness and superiority.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 13 Apr 2025.

Builds on

32 of 48 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  8. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  9. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  10. 2017Deep Learning for Medical Image Analysiscited by 401
  11. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  12. 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
20 more
  1. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 192
  2. 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
  3. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
  4. 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 117
  5. 2023Adaptive Latent Diffusion Model for 3D Medical Image to Image Translation: Multi-modal Magnetic Resonance Imaging Studycited by 64
  6. 2024Efficient Diffusion Model for Image Restoration by Residual Shiftingcited by 64
  7. 2023SynthRAD2023 Grand Challenge dataset: generating synthetic CT for radiotherapycited by 53
  8. 2019Unsupervised Medical Image Translation Using Cycle-MedGANcited by 44
  9. 2019Brain Tumor Segmentation on MRI with Missing Modalitiescited by 42
  10. 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMscited by 35
  11. 2024WaveFace: Authentic Face Restoration with Efficient Frequency Recoverycited by 20
  12. 2019Reversible GANs for Memory-efficient Image-to-Image Translationcited by 19
  13. 2023Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translationcited by 19
  14. 2024Face2Diffusion for Fast and Editable Face Personalizationcited by 17
  15. 2024Slice-Consistent 3D Volumetric Brain CT-to-MRI Translation with 2D Brownian Bridge Diffusion Modelcited by 16
  16. 2019Unsupervised Adversarial Correction of Rigid MR Motion Artifactscited by 11
  17. 2021Simultaneous super-resolution and motion artifact removal in diffusion-weighted MRI using unsupervised deep learningcited by 6
  18. 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approachcited by 3
  19. 2024I2I-Galip: Unsupervised Medical Image Translation Using Generative Adversarial CLIPcited by 2
  20. 2024Multi-scale Generative Modeling for Fast Samplingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Zero-shot Medical Image Translation via Frequency-Guided Diffusion Models
  2. 2023FDDM: Unsupervised Medical Image Translation with a Frequency-Decoupled Diffusion Model
  3. 2026Multiscale Structure-Guided Latent Diffusion for Multimodal MRI Translation
  4. 2024MedM2G: Unifying Medical Multi-Modal Generation via Cross-Guided Diffusion with Visual Invariant
  5. 2024Similarity-aware Syncretic Latent Diffusion Model for Medical Image Translation with Representation Learning
  6. 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translation
  7. 2026MedDiT4SR: Tri-Stream Joint Adaptation of Pre-Trained Diffusion Transformers for Medical Image Super-Resolution
  8. 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis