mlsanityData to 7 Oct 2026

Realistic galaxy image simulation via score-based generative models

arXiv 2111.01713 ↗First posted 2 Nov 2021astro-ph.IM astro-ph.GA cs.LGcited by 24

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

We show that a Denoising Diffusion Probabalistic Model (DDPM), a class of score-based generative model, can be used to produce realistic mock images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic Instrument (DESI) grz imaging of galaxies from the Photometry and Rotation curve OBservations from Extragalactic Surveys (PROBES) sample and galaxies selected from the Sloan Digital Sky Survey. Subjectively, the generated galaxies are highly realistic when compared with samples from the real dataset. We quantify the similarity by borrowing from the deep generative learning literature, using the `Fr'echet Inception Distance' to test for subjective and morphological similarity. We also introduce the `Synthetic Galaxy Distance' metric to compare the emergent physical properties (such as total magnitude, colour and half light radius) of a ground truth parent and synthesised child dataset. We argue that the DDPM approach produces sharper and more realistic images than other generative methods such as Adversarial Networks (with the downside of more costly inference), and could be used to produce large samples of synthetic observations tailored to a specific imaging survey. We demonstrate two potential uses of the DDPM: (1) accurate in-painting of occluded data, such as satellite trails, and (2) domain transfer, where new input images can be processed to mimic the properties of the DDPM training set. Here we `DESI-fy' cartoon images as a proof of concept for domain transfer. Finally, we suggest potential applications for score-based approaches that could motivate further research on this topic within the astronomical community.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 0 of its 9 references that are in the map. First posted on arXiv 2 Nov 2021.

Builds on

0 of 9 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 8; 2024: 5; 2025: 5; 2026: 2.

24 papers.

Sort:

By area:

  1. 2023SoK: Privacy-Preserving Data Synthesiscited by 37
  2. 2022Posterior samples of source galaxies in strong gravitational lenses with score-based priorscited by 20
  3. 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
  4. 2022Can denoising diffusion probabilistic models generate realistic astrophysical fields?cited by 10
  5. 2023Multiscale Flow for Robust and Optimal Cosmological Analysiscited by 10
  6. 2024AstroPT: Scaling Large Observation Models for Astronomycited by 9
  7. 2024Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problemscited by 5
  8. 2025The Platonic Universe: Do Foundation Models See the Same Sky?cited by 5
  9. 2023Denoising Diffusion Probabilistic Models to Predict the Density of Molecular Cloudscited by 4
  10. 2024Understanding Galaxy Morphology Evolution Through Cosmic Time via Redshift Conditioned Diffusion Modelscited by 4
  11. 2023Bayesian Imaging for Radio Interferometry with Score-Based Priorscited by 3
  12. 2023Predicting the Radiation Field of Molecular Clouds using Denoising Diffusion Probabilistic Modelscited by 2
12 more
  1. 2023Echoes in the Noise: Posterior Samples of Faint Galaxy Surface Brightness Profiles with Score-Based Likelihoods and Priorscited by 2
  2. 2024Diff-PIC: Revolutionizing Particle-In-Cell Nuclear Fusion Simulation with Diffusion Modelscited by 2
  3. 2024Nested Diffusion Models Using Hierarchical Latent Priorscited by 2
  4. 2022Learning to Kindle the Starlightcited by 1
  5. 2025Category-based Galaxy Image Generation via Diffusion Modelscited by 1
  6. 2023Deep Learning Segmentation of Spiral Arms and Barscited by 0
  7. 2023ρ-Diffusion: A diffusion-based density estimation framework for computational physicscited by 0
  8. 2025Mapping Galaxy Images Across Ultraviolet, Visible and Infrared Bands Using Generative Deep Learningcited by 0
  9. 2025Can AI Dream of Unseen Galaxies? Conditional Diffusion Model for Galaxy Morphology Augmentationcited by 0
  10. 2025Neural Posterior Estimation for Cataloging Astronomical Images from the Legacy Survey of Space and Timecited by 0
  11. 2026Accelerating Redshift-Conditioned Galaxy Image Synthesis with One-step Generative Modelingcited by 0
  12. 2026High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrologycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Using Galaxy Evolution as Source of Physics-Based Ground Truth for Generative Models
  2. 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics
  3. 2023A point cloud approach to generative modeling for galaxy surveys at the field level
  4. 2024Galaxy spectroscopy without spectra: Galaxy properties from photometric images with conditional diffusion models
  5. 2025Investigation on deep learning-based galaxy image translation models
  6. 2024Reconstructing Galaxy Cluster Mass Maps using Score-based Generative Modeling
  7. 2025Score Matching on Large Geometric Graphs for Cosmology Generation
  8. 2023Diffusion Models for Probabilistic Deconvolution of Galaxy Images