mlsanityData to 7 Oct 2026

RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generation

arXiv 2307.02392 ↗First posted 5 Jul 2023cs.CVcited by 2

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Along with the nearing completion of the Square Kilometre Array (SKA), comes an increasing demand for accurate and reliable automated solutions to extract valuable information from the vast amount of data it will allow acquiring. Automated source finding is a particularly important task in this context, as it enables the detection and classification of astronomical objects. Deep-learning-based object detection and semantic segmentation models have proven to be suitable for this purpose. However, training such deep networks requires a high volume of labeled data, which is not trivial to obtain in the context of radio astronomy. Since data needs to be manually labeled by experts, this process is not scalable to large dataset sizes, limiting the possibilities of leveraging deep networks to address several tasks. In this work, we propose RADiff, a generative approach based on conditional diffusion models trained over an annotated radio dataset to generate synthetic images, containing radio sources of different morphologies, to augment existing datasets and reduce the problems caused by class imbalances. We also show that it is possible to generate fully-synthetic image-annotation pairs to automatically augment any annotated dataset. We evaluate the effectiveness of this approach by training a semantic segmentation model on a real dataset augmented in two ways: 1) using synthetic images obtained from real masks, and 2) generating images from synthetic semantic masks. We show an improvement in performance when applying augmentation, gaining up to 18% in performance when using real masks and 4% when augmenting with synthetic masks. Finally, we employ this model to generate large-scale radio maps with the objective of simulating Data Challenges.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 32 of its 77 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

32 of 77 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023A Conditional Denoising Diffusion Probabilistic Model for Radio Interferometric Image Reconstruction16 May

Other references · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2017Neural Discrete Representation Learningcited by 4,650
  11. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
19 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  3. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  4. 2015Variational Inference with Normalizing Flowscited by 2,161
  5. 2014Conditional Generative Adversarial Netscited by 2,152
  6. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  7. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  8. 2016Generative Adversarial Text to Image Synthesiscited by 735
  9. 2020ResNeSt: Split-Attention Networkscited by 445
  10. 2019Panoptic-DeepLabcited by 362
  11. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  12. 2017Data Augmentation Generative Adversarial Networkscited by 278
  13. 2017Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoderscited by 222
  14. 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
  15. 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
  16. 2023TTIDA: Controllable Generative Data Augmentation via Text-to-Text and Text-to-Image Modelscited by 14
  17. 2020Conditional Generation of Medical Images via Disentangled Adversarial Inferencecited by 13
  18. 2019CAESAR source finder: recent developments and testingcited by 4
  19. 2023Radio astronomical images object detection and segmentation: A benchmark on deep learning methodscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can AI Dream of Unseen Galaxies? Conditional Diffusion Model for Galaxy Morphology Augmentation
  2. 2025Category-based Galaxy Image Generation via Diffusion Models
  3. 2024Radio-astronomical Image Reconstruction with Conditional Denoising Diffusion Model
  4. 2025Radio Astronomy in the Era of Vision-Language Models: Prompt Sensitivity and Adaptation
  5. 2023Diffusion Models for Probabilistic Deconvolution of Galaxy Images
  6. 2024RadioDiff: An Effective Generative Diffusion Model for Sampling-Free Dynamic Radio Map Construction
  7. 2025Intrinsic Dimension Estimation for Radio Galaxy Zoo using Diffusion Models
  8. 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics