mlsanityData to 7 Oct 2026

PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices

arXiv 2411.03527 ↗First posted 5 Nov 2024cs.LG physics.opticscited by 5

Not on the map. Why?

Abstract (arXiv)

Electromagnetic field simulation is central to designing, optimizing, and validating photonic devices and circuits. However, costly computation associated with numerical simulation poses a significant bottleneck, hindering scalability and turnaround time in the photonic circuit design process. Neural operators offer a promising alternative, but existing SOTA approaches, NeurOLight, struggle with predicting high-fidelity fields for real-world complicated photonic devices, with the best reported 0.38 normalized mean absolute error in NeurOLight. The inter-plays of highly complex light-matter interaction, e.g., scattering and resonance, sensitivity to local structure details, non-uniform learning complexity for full-domain simulation, and rich frequency information, contribute to the failure of existing neural PDE solvers. In this work, we boost the prediction fidelity to an unprecedented level for simulating complex photonic devices with a novel operator design driven by the above challenges. We propose a novel cross-axis factorized PACE operator with a strong long-distance modeling capacity to connect the full-domain complex field pattern with local device structures. Inspired by human learning, we further divide and conquer the simulation task for extremely hard cases into two progressively easy tasks, with a first-stage model learning an initial solution refined by a second model. On various complicated photonic device benchmarks, we demonstrate one sole PACE model is capable of achieving 73% lower error with 50% fewer parameters compared with various recent ML for PDE solvers. The two-stage setup further advances high-fidelity simulation for even more intricate cases. In terms of runtime, PACE demonstrates 154-577x and 11.8-12x simulation speedup over numerical solver using scipy or highly-optimized pardiso solver, respectively. We open sourced the code and dataset.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 5 Nov 2024.

Builds on

21 of 42 references.

References · 21

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  2. 2020On Layer Normalization in the Transformer Architecturecited by 906
  3. 2021Choose a Transformer: Fourier or Galerkincited by 333
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  5. 2021Factorized Fourier Neural Operatorscited by 237
  6. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  7. 2022U-NO: U-shaped Neural Operatorscited by 219
  8. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  9. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
  10. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  11. 2020Photonics for artificial intelligence and neuromorphic computingcited by 111
  12. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
9 more
  1. 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
  2. 2023FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Corescited by 32
  3. 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulationcited by 17
  4. 2023Lightening-Transformer: A Dynamically-operated Optically-interconnected Photonic Transformer Acceleratorcited by 15
  5. 2021A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learningcited by 13
  6. 2023M3ICRO: Machine Learning-Enabled Compact Photonic Tensor Core based on PRogrammable Multi-Operand Multimode Interferencecited by 5
  7. 2022Fuse and Mix: MACAM-Enabled Analog Activation for Energy-Efficient Neural Accelerationcited by 4
  8. 2023Integrated multi-operand optical neurons for scalable and hardware-efficient deep learningcited by 4
  9. 2024Dilated convolution neural operator for multiscale partial differential equationscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.