mlsanityData to 14 Oct 2026

Universal Pansharpening Model

arXiv 2603.03831 ↗First posted 4 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Pansharpening generates the high-resolution multi-spectral (MS) image by integrating spatial details from a texture-rich panchromatic (PAN) image and spectral attributes from a low-resolution MS image. Existing methods are predominantly satellite-specific and scene-dependent, which severely limits their generalization across heterogeneous sensors and varied scenes, thereby reducing their real-world practicality. To address these challenges, we present UniPS, a universal pansharpening model for satellite-agnostic and scene-robust fusion. Specifically, we introduce a modality-interleaved transformer that learns band-wise modal specializations to form reversible spectral affine bases, mapping arbitrary-band MS into a unified latent space via tensor multiplication. Building upon this, we construct a latent diffusion bridge model to progressively evolve latent representations, and incorporate bridge posterior sampling to couple latent diffusion with pixel-space observations, enabling stable and controllable fusion. Furthermore, we devise infinite-dimensional pixel-to-latent interaction mechanisms to comprehensively capture the cross-domain dependencies between PAN observations and MS representations, thereby facilitating complementary information fusion. In addition, to support large-scale training and evaluation, we construct a comprehensive pansharpening benchmark, termed PSBench, consisting of worldwide MS and PAN image pairs from multiple satellites across diverse scenes. Extensive experiments verify that UniPS consistently outperforms state-of-the-art methods, exhibiting superior generalization and robustness across a wide range of tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 34 of its 103 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

34 of 103 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SSDiff: Spatial-spectral Integrated Diffusion Model for Remote Sensing Pansharpening17 Apr
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep

Other references · 32

  1. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  2. 2024Mixtral of Expertscited by 1,823
  3. 2016An overview of gradient descent optimization algorithmscited by 1,033
  4. 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 404
  5. 2021BASE Layers: Simplifying Training of Large, Sparse Modelscited by 320
  6. 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
  7. 2024Mixture of LoRA Expertscited by 181
  8. 2024Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Expertscited by 108
  9. 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
  10. 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
  11. 2024Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Modelscited by 59
  12. 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 56
20 more
  1. 2024Rewrite the Starscited by 55
  2. 2021Deep Gradient Projection Networks for Pan-sharpeningcited by 44
  3. 2024Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Modelscited by 42
  4. 2021EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gatecited by 30
  5. 2024HMoE: Heterogeneous Mixture of Experts for Language Modelingcited by 29
  6. 2024Content-Adaptive Non-Local Convolution for Remote Sensing Pansharpeningcited by 20
  7. 2022U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image Fusioncited by 19
  8. 2022PanFormer: a Transformer Based Model for Pan-sharpeningcited by 18
  9. 2023PanFlowNet: A Flow-Based Deep Network for Pan-sharpeningcited by 16
  10. 2025Wavelet-Assisted Multi-Frequency Attention Network for Pansharpeningcited by 13
  11. 2024Hyperspectral Pansharpening: Critical Review, Tools and Future Perspectivescited by 8
  12. 2025Bidirectional Diffusion Bridge Modelscited by 8
  13. 2024Linearly-evolved Transformer for Pan-sharpeningcited by 5
  14. 2024Hipandas: Hyperspectral Image Joint Denoising and Super-Resolution by Image Fusion with the Panchromatic Imagecited by 4
  15. 2024Infinite-Dimensional Feature Interactioncited by 2
  16. 2025Enpowering Your Pansharpening Models with Generalizability: Unified Distribution is All You Needcited by 2
  17. 2026Cross-Scale Pansharpening via ScaleFormer and the PanScale Benchmarkcited by 2
  18. 2024Real HSI-MSI-PAN image dataset for the hyperspectral/multi-spectral/panchromatic image fusion and super-resolution fieldscited by 1
  19. 2025Rethinking Pan-sharpening: A New Training Process for Full-Resolution Generalizationcited by 1
  20. 2025Leveraging Large-Scale Pretrained Spatial-Spectral Priors for General Zero-Shot Pansharpeningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024CrossDiff: Exploring Self-Supervised Representation of Pansharpening via Cross-Predictive Diffusion Model
  2. 2025Fose: Fusion of One-Step Diffusion and End-to-End Network for Pansharpening
  3. 2026Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening
  4. 2023Unsupervised Hyperspectral Pansharpening via Low-rank Diffusion Model
  5. 2025S2WMamba: A Wavelet-Assisted Mamba-Based Dual-Branch Network For Pansharpening
  6. 2026CC-Pan: Channel-wise Compression based Diffusion for Efficient Pan-Sharpening
  7. 2025MMMamba: A Versatile Cross-Modal In Context Fusion Framework for Pan-Sharpening and Zero-Shot Image Enhancement
  8. 2025Spatial-Spectral Binarized Neural Network for Panchromatic and Multi-spectral Images Fusion