AI-assisted Automated Workflow for Real-time X-ray Ptychography Data Analysis via Federated Resources
Not on the map. Why?
Abstract (arXiv)
We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlapping scan positions. This acquisition method can enable nanoscale imaging with x-rays and electrons, but this often requires very large experimental datasets and commensurately high turnaround times, which can limit experimental capabilities such as real-time experimental steering and low-latency monitoring. In this work, we introduce a software system that can automate ptychography data analysis tasks. We accelerate the data analysis pipeline by using a modified version of PtychoNN -- an ML-based approach to solve phase retrieval problem that shows two orders of magnitude speedup compared to traditional iterative methods. Further, our system coordinates and overlaps different data analysis tasks to minimize synchronization overhead between different stages of the workflow. We evaluate our workflow system with real-world experimental workloads from the 26ID beamline at Advanced Photon Source and ThetaGPU cluster at Argonne Leadership Computing Resources.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 68 references that are in the map. First posted on arXiv 9 Apr 2023.
Builds on
19 of 68 references.
References · 19
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2020funcX: A Federated Function Serving Fabric for Sciencecited by 32
- 2019TomoGAN: Low-Dose Synchrotron X-Ray Tomography with Generative Adversarial Networkscited by 25
- 2021AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imagingcited by 18
- 2018Real-time coherent diffraction inversion using deep generative networkscited by 17
- 2021AI Accelerator Survey and Trendscited by 17
- 2022Deep learning at the edge enables real-time streaming ptychographic imagingcited by 17
- 2020BraggNN: Fast X-ray Bragg Peak Analysis Using Deep Learningcited by 14
- 2020Joint ptycho-tomography with deep generative priorscited by 8
- 2016SHARP: a distributed, GPU-based ptychographic solvercited by 6
- 2019Deep Learning Accelerated Light Source Experimentscited by 6
- 2021Algorithm-driven Advances for Scientific CT Instruments: From Model-based to Deep Learning-based Approachescited by 5
7 more
- 2021Scalable and accurate multi-GPU based image reconstruction of large-scale ptychography datacited by 5
- 2020Petascale XCT: 3D Image Reconstruction with Hierarchical Communications on Multi-GPU Nodescited by 4
- 2022Globus Automation Services: Research process automation across the space-time continuumcited by 4
- 2019iFDK: A Scalable Framework for Instant High-resolution Image Reconstructioncited by 3
- 2020Deep Learning-based Low-dose Tomography Reconstruction with Hybrid-dose Measurementscited by 3
- 2021High-Performance Ptychographic Reconstruction with Federated Facilitiescited by 2
- 2022Image Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstructioncited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.