Learning the Target Priors Before Image Translation: A Decoupled Training Paradigm for Cross-Modal Image Translation in Remote Sensing
Not on the map. Why?
Abstract (arXiv)
Cross-modal image translation in remote sensing must preserve source-observed content while matching the target-domain distribution. Existing methods jointly learn the target prior and cross-modal dependence from scarce paired data, overlooking a key asymmetry: only the latter intrinsically requires cross-modal correspondence. We formalize this distinction through conditional-score and denoising-risk analyses and propose Learning the Target Priors Before Image Translation (LTP-BIT), a prior-first paradigm that decouples the two learning tasks. LTP-BIT first learns a target-domain generative prior from large-scale unpaired imagery, then retains the pretrained backbone weights and learns source-conditioned control through P-DART, a parameter-efficient dual-stream architecture. Controlled experiments show that prior matching and scaling primarily improve target-domain realism, whereas instance fidelity relies more strongly on conditional adaptation. LTP-BIT achieves state-of-the-art performance across SAR-to-RGB and NIR-to-RGB benchmarks using only 9.81% task-specific parameters. On QXS-SAROPT, it retains near-full-data instance fidelity with only 25% of the paired samples.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
25 of 44 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
- 2017Toward Multimodal Image-to-Image Translationcited by 296
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 218
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
13 more
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 66
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 55
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 48
- 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 46
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusioncited by 27
- 2025The Prism Hypothesis: Harmonizing Semantic and Pixel Representations via Unified Autoencodingcited by 22
- 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensingcited by 4
- 2025UniCon: Unidirectional Information Flow for Effective Control of Large-Scale Diffusion Modelscited by 3
- 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translationcited by 3
Built on by
Not cited yet.