mlsanityData to 7 Oct 2026

A Physics-Inspired Deep Learning Framework with Polar Coordinate Attention for Ptychographic Imaging

arXiv 2412.06806 ↗First posted 25 Nov 2024physics.optics cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Ptychographic imaging confronts inherent challenges in applying deep learning for phase retrieval from diffraction patterns. Conventional neural architectures, both convolutional neural networks and Transformer-based methods, are optimized for natural images with Euclidean spatial neighborhood-based inductive biases that exhibit geometric mismatch with the concentric coherent patterns characteristic of diffraction data in reciprocal space. In this paper, we present PPN, a physics-inspired deep learning network with Polar Coordinate Attention (PoCA) for ptychographic imaging, that aligns neural inductive biases with diffraction physics through a dual-branch architecture separating local feature extraction from non-local coherence modeling. It consists of a PoCA mechanism that replaces Euclidean spatial priors with physically consistent radial-angular correlations. PPN outperforms existing end-to-end models, with spectral and spatial analysis confirming its greater preservation of high-frequency details. Notably, PPN maintains robust performance compared to iterative methods even at low overlap ratios, making it well suited for high-throughput imaging in real-world acquisition scenarios for samples with consistent structural characteristics.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

17 of 47 references.

References · 17

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  4. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  5. 2020A Survey on Visual Transformercited by 653
  6. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
  7. 2022Medical Image Segmentation Review: The success of U-Netcited by 190
  8. 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformercited by 124
  9. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
  10. 2023ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modelingcited by 46
  11. 2022Bidirectional Generation of Structure and Properties Through a Single Molecular Foundation Modelcited by 25
  12. 2022Deep learning at the edge enables real-time streaming ptychographic imagingcited by 17
5 more
  1. 2019Learning to Synthesize: Robust Phase Retrieval at Low Photon countscited by 16
  2. 2023PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstructioncited by 9
  3. 2024PtychoFormer: A Transformer-based Model for Ptychographic Phase Retrievalcited by 5
  4. 2023Noise-robust latent vector reconstruction in ptychography using deep generative modelscited by 4
  5. 2021Using a modified double deep image prior for crosstalk mitigation in multislice ptychographycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.