mlsanityData to 14 Oct 2026

Quantitative Comparison of Fine-Tuning Techniques for Pretrained Latent Diffusion Models in the Generation of Unseen SAR Images

arXiv 2506.13307 ↗First posted 16 Jun 2025cs.CV cs.AIcited by 3

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

We present a framework for adapting a large pretrained latent diffusion model to high-resolution Synthetic Aperture Radar (SAR) image generation. The approach enables controllable synthesis and the creation of rare or out-of-distribution scenes beyond the training set. Rather than training a task-specific small model from scratch, we adapt an open-source text-to-image foundation model to the SAR modality, using its semantic prior to align prompts with SAR imaging physics (side-looking geometry, slant-range projection, and coherent speckle with heavy-tailed statistics). Using a 100k-image SAR dataset, we compare full fine-tuning and parameter-efficient Low-Rank Adaptation (LoRA) across the UNet diffusion backbone, the Variational Autoencoder (VAE), and the text encoders. Evaluation combines (i) statistical distances to real SAR amplitude distributions, (ii) textural similarity via Gray-Level Co-occurrence Matrix (GLCM) descriptors, and (iii) semantic alignment using a SAR-specialized CLIP model. Our results show that a hybrid strategy-full UNet tuning with LoRA on the text encoders and a learned token embedding-best preserves SAR geometry and texture while maintaining prompt fidelity. The framework supports text-based control and multimodal conditioning (e.g., segmentation maps, TerraSAR-X, or optical guidance), opening new paths for large-scale SAR scene data augmentation and unseen scenario simulation in Earth observation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 17 of its 39 references that are in the map. First posted on arXiv 16 Jun 2025.

Builds on

17 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024HSIGene: A Foundation Model For Hyperspectral Image Generation19 Sep

Other references · 16

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  10. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  11. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 151
  12. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 48
4 more
  1. 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
  2. 2025SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretationcited by 5
  3. 2025Synthetic Art Generation and DeepFake Detection A Study on Jamini Roy Inspired Datasetcited by 1
  4. 2025From Spaceborne to Airborne: SAR Image Synthesis Using Foundation Models for Multi-Scale Adaptationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration
  2. 2024SAR to Optical Image Translation with Color Supervised Diffusion Model
  3. 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation
  4. 2024SAR Image Synthesis with Diffusion Models
  5. 2024Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation
  6. 2026ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation
  7. 2026Better with Less: Tackling Heterogeneous Multi-Modal Image Joint Pretraining via Conditioned and Degraded Masked Autoencoder
  8. 2023Non-Visible Light Data Synthesis and Application: A Case Study for Synthetic Aperture Radar Imagery