# Towards generalizable deep ptychography neural networks

arXiv: https://arxiv.org/abs/2509.25104 · HTML: https://mlsanity.com/paper/2509.25104/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 55 references that are in the map.
- First posted on arXiv 29 Sep 2025.

## Builds on (most cited first, 17 of 17)

- [Learning to See by Looking at Noise](https://mlsanity.com/paper/2106.05963/) (2021)
- [Lensless computational imaging through deep learning](https://mlsanity.com/paper/1702.08516/) (2017)
- [On the use of deep learning for phase recovery](https://mlsanity.com/paper/2308.00942/) (2023)
- [Deep learning at the edge enables real-time streaming ptychographic imaging](https://mlsanity.com/paper/2209.09408/) (2022)
- [Physics Constrained Unsupervised Deep Learning for Rapid, High Resolution Scanning Coherent Diffraction Reconstruction](https://mlsanity.com/paper/2306.11014/) (2023)
- [PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction](https://mlsanity.com/paper/2310.07504/) (2023)
- [On the interplay between physical and content priors in deep learning for computational imaging](https://mlsanity.com/paper/2004.06355/) (2020)
- [SiSPRNet: End-to-End Learning for Single-Shot Phase Retrieval](https://mlsanity.com/paper/2205.11434/) (2022)
- [Compressive Ptychography using Deep Image and Generative Priors](https://mlsanity.com/paper/2205.02397/) (2022)
- [PtychoFormer: A Transformer-based Model for Ptychographic Phase Retrieval](https://mlsanity.com/paper/2410.17377/) (2024)
- [A Physics-Inspired Deep Learning Framework with Polar Coordinate Attention for Ptychographic Imaging](https://mlsanity.com/paper/2412.06806/) (2024)
- [Deep Iterative Phase Retrieval for Ptychography](https://mlsanity.com/paper/2202.10573/) (2022)
- [Deep-learning real-time phase retrieval of imperfect diffraction patterns from X-ray free-electron lasers](https://mlsanity.com/paper/2409.15784/) (2024)
- [Ptychographic Image Reconstruction from Limited Data via Score-Based Diffusion Models with Physics-Guidance](https://mlsanity.com/paper/2502.18767/) (2025)
- [Spectral pre-modulation of training examples enhances the spatial resolution of the Phase Extraction Neural Network (PhENN)](https://mlsanity.com/paper/1808.10753/) (2018)
- [Investigating the robustness of a learning-based method for quantitative phase retrieval from propagation-based x-ray phase contrast measurements under laboratory conditions](https://mlsanity.com/paper/2211.01372/) (2022)
- [Learning neural representations for X-ray ptychography reconstruction with unknown probes](https://mlsanity.com/paper/2509.04402/) (2025)

## Built on by (most cited first, 1 of 1)

- [Contrast-invariant deep ptychography neural networks](https://mlsanity.com/paper/2608.02869/) (2026)

## Abstract (arXiv)

X-ray ptychography is a data-intensive imaging technique expected to become ubiquitous at next-generation light sources delivering many-fold increases in coherent flux. The need for real-time feedback under accelerated acquisition rates motivates surrogate reconstruction models like deep neural networks, which offer orders-of-magnitude speedup over conventional methods. However, existing deep learning approaches lack robustness across diverse experimental conditions. We propose an unsupervised training workflow emphasizing probe learning by combining experimentally-measured probes with synthetic, procedurally generated objects. This probe-centric approach enables a single physics-informed neural network to reconstruct unseen experiments across multiple beamlines; among the first demonstrations of multi-probe generalization. We find probe learning is equally important as in-distribution learning; models trained using this synthetic workflow achieve reconstruction fidelity comparable to those trained exclusively on experimental data, even when changing the type of synthetic training object. The proposed approach enables training of experiment-steering models that provide real-time feedback under dynamic experimental conditions.
