TriFusion-SR: Joint Tri-Modal Medical Image Fusion and SR
Not on the map. Why?
Abstract (arXiv)
Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing approaches typically perform image fusion and super-resolution (SR) in separate stages, leading to artifacts and degraded perceptual quality. These limitations are further amplified in tri-modal settings that combine anatomical modalities (e.g., MRI, CT) with functional scans (e.g., PET, SPECT) due to pronounced frequency domain imbalances. We propose TriFusionSR, a wavelet-guided conditional diffusion framework for joint tri-modal fusion and SR. The framework explicitly decomposes multimodal features into frequency bands using the 2D Discrete Wavelet Transform, enabling frequency-aware crossmodal interaction. We further introduce a Rectified Wavelet Features (RWF) strategy for latent coefficient calibration, followed by an Adaptive Spatial-Frequency Fusion (ASFF) module with gated channel-spatial attention to enable structure-driven multimodal refinement. Extensive experiments demonstrate state-of-the-art performance, achieving 4.8-12.4% PSNR improvement and substantial reductions in RMSE and LPIPS across multiple upsampling scales.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
12 of 30 references.
References · 12
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2022TGFuse: An Infrared and Visible Image Fusion Approach Based on Transformer and Generative Adversarial Networkcited by 29
- 2023DisC-Diff: Disentangled Conditional Diffusion Model for Multi-Contrast MRI Super-Resolutioncited by 28
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2024Simultaneous Tri-Modal Medical Image Fusion and Super-Resolution using Conditional Diffusion Modelcited by 13
- 2025FlexiD-Fuse: Flexible number of inputs multi-modal medical image fusion based on diffusion modelcited by 4
- 2025WaveHiT-SR: Hierarchical Wavelet Network for Efficient Image Super-Resolutioncited by 1
Built on by
Not cited yet.