NuclearDiffusion: Text-to-Image Foundation Models for Learning Nuclear Energy Concepts
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Generative artificial intelligence (AI) has transformed text-to-image synthesis, yet its ability to represent specialized engineering domains remains largely unexplored. As an exmaple in nuclear engineering, general-purpose foundation models frequently generate physically incorrect or conceptually inconsistent images because they lack domain-specific knowledge. This work presents one of the first systematic studies of domain adaptation for nuclear text-to-image generation through fine-tuning of open-source diffusion models. We curate a dataset of 1,000 captioned nuclear energy images spanning reactors, fuel cycles, radiation, and related concepts, and use it to fine-tune three state-of-the-art open-source models: Stable Diffusion XL (SDXL), SD-v3.5-Medium, and the flow-matching Flux.1 model. Their performance is evaluated using both quantitative image-similarity metrics and qualitative expert assessment against the corresponding zero-shot models. Fine-tuning substantially improves the fidelity of SDXL, provides only limited gains for SD-v3.5-Medium, and yields no measurable improvement for Flux.1, demonstrating that adaptation effectiveness depends strongly on the underlying generative architecture rather than model scale alone. We further compare the fine-tuned models against three leading commercial systems--GPT-Image-2, Gemini-3.1-Flash-Image, and Midjourney. Although GPT-Image-2 and Gemini generate convincing images for broad nuclear concepts, they frequently fail on specialized engineering prompts, where the fine-tuned open-source models produce more accurate and technically consistent outputs. These results establish domain-specific fine-tuning as a practical pathway for developing trustworthy generative AI tools for domain-specific applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 14 of its 66 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
14 of 66 references.
References · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018Demystifying MMD GANscited by 1,268
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 105
- 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignmentcited by 27
- 2024MedM2G: Unifying Medical Multi-Modal Generation via Cross-Guided Diffusion with Visual Invariantcited by 21
- 2024Virtual Sensing-Enabled Digital Twin Framework for Real-Time Monitoring of Nuclear Systems Leveraging Deep Neural Operatorscited by 12
- 2025Variational Digital Twinscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Overcoming Data Scarcity in Nuclear Energy: A Study on Critical Heat Flux with Physics-consistent Conditional Diffusion Model
- 2025ReactorFold: Generative discovery of nuclear reactor cores via emergent physical reasoning
- 2024Generating Realistic X-ray Scattering Images Using Stable Diffusion and Human-in-the-loop Annotations
- 2026DiffusionBench: On Holistic Evaluation of Diffusion Transformers
- 2024Semantic Approach to Quantifying the Consistency of Diffusion Model Image Generation
- 2025Neuro-Symbolic Generative Diffusion Models for Physically Grounded, Robust, and Safe Generation
- 2025Mechanistic Interpretability of LoRA-Adapted Language Models for Nuclear Reactor Safety Applications
- 2024M2PDE: Compositional Generative Multiphysics and Multi-component PDE Simulation