Fidelity-preserving enhancement of ptychography with foundational text-to-image models
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Ptychographic phase retrieval enables high-resolution imaging of complex samples but often suffers from artifacts such as grid pathology and multislice crosstalk, which degrade reconstructed images. We propose a plug-and-play (PnP) framework that integrates physics model-based phase retrieval with text-guided image editing using foundational diffusion models. By employing the alternating direction method of multipliers (ADMM), our approach ensures consensus between data fidelity and artifact removal subproblems, maintaining physics consistency while enhancing image quality. Artifact removal is achieved using a text-guided diffusion image editing method (LEDITS++) with a pre-trained foundational diffusion model, allowing users to specify artifacts for removal in natural language. Demonstrations on simulated and experimental datasets show significant improvements in artifact suppression and structural fidelity, validated by metrics such as peak signal-to-noise ratio (PSNR) and diffraction pattern consistency. This work highlights the combination of text-guided generative models and model-based phase retrieval algorithms as a transferable and fidelity-preserving method for high-quality diffraction imaging.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 18 of its 50 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
18 of 50 references.
References · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2017Deep Image Priorcited by 1,097
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
- 2018"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priorscited by 114
6 more
- 2017Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibriumcited by 58
- 2024Plug-and-Play image restoration with Stochastic deNOising REgularizationcited by 17
- 2023Physics Constrained Unsupervised Deep Learning for Rapid, High Resolution Scanning Coherent Diffraction Reconstructioncited by 13
- 2023PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstructioncited by 9
- 2019Three dimensions, two microscopes, one code: automatic differentiation for x-ray nanotomography beyond the depth of focus limitcited by 5
- 2021Using a modified double deep image prior for crosstalk mitigation in multislice ptychographycited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Ptychographic Image Reconstruction from Limited Data via Score-Based Diffusion Models with Physics-Guidance
- 2025Position-Blind Ptychography: Viability of image reconstruction via data-driven variational inference
- 2025Improving Multislice Electron Ptychography with a Generative Prior
- 2025I2I-PR: Deep Iterative Refinement for Phase Retrieval using Image-to-Image Diffusion Models
- 2025DIFFRACT: Diffusion-based Restoration via Adaptive Control and Thresholding for Diffraction Imaging
- 2025Adapting General-Purpose Foundation Models for X-ray Ptychography in Low-Data Regimes
- 2025Physics-Guided Diffusion Priors for Multi-Slice Reconstruction in Scientific Imaging
- 2026Multiphase-Diff: Diffusion-Based Generative Modeling for High-Contrast Multiphase Physical Systems with Sharp Interfaces