PACE: Pacing Operator Learning to Accurate Optical Field Simulation for Complicated Photonic Devices
Not on the map. Why?
Abstract (arXiv)
Electromagnetic field simulation is central to designing, optimizing, and validating photonic devices and circuits. However, costly computation associated with numerical simulation poses a significant bottleneck, hindering scalability and turnaround time in the photonic circuit design process. Neural operators offer a promising alternative, but existing SOTA approaches, NeurOLight, struggle with predicting high-fidelity fields for real-world complicated photonic devices, with the best reported 0.38 normalized mean absolute error in NeurOLight. The inter-plays of highly complex light-matter interaction, e.g., scattering and resonance, sensitivity to local structure details, non-uniform learning complexity for full-domain simulation, and rich frequency information, contribute to the failure of existing neural PDE solvers. In this work, we boost the prediction fidelity to an unprecedented level for simulating complex photonic devices with a novel operator design driven by the above challenges. We propose a novel cross-axis factorized PACE operator with a strong long-distance modeling capacity to connect the full-domain complex field pattern with local device structures. Inspired by human learning, we further divide and conquer the simulation task for extremely hard cases into two progressively easy tasks, with a first-stage model learning an initial solution refined by a second model. On various complicated photonic device benchmarks, we demonstrate one sole PACE model is capable of achieving 73% lower error with 50% fewer parameters compared with various recent ML for PDE solvers. The two-stage setup further advances high-fidelity simulation for even more intricate cases. In terms of runtime, PACE demonstrates 154-577x and 11.8-12x simulation speedup over numerical solver using scipy or highly-optimized pardiso solver, respectively. We open sourced the code and dataset.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 5 Nov 2024.
Builds on
21 of 42 references.
References · 21
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Factorized Fourier Neural Operatorscited by 237
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2020Photonics for artificial intelligence and neuromorphic computingcited by 111
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
9 more
- 2023Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEscited by 66
- 2023FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Corescited by 32
- 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulationcited by 17
- 2023Lightening-Transformer: A Dynamically-operated Optically-interconnected Photonic Transformer Acceleratorcited by 15
- 2021A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learningcited by 13
- 2023M3ICRO: Machine Learning-Enabled Compact Photonic Tensor Core based on PRogrammable Multi-Operand Multimode Interferencecited by 5
- 2022Fuse and Mix: MACAM-Enabled Analog Activation for Energy-Efficient Neural Accelerationcited by 4
- 2023Integrated multi-operand optical neurons for scalable and hardware-efficient deep learningcited by 4
- 2024Dilated convolution neural operator for multiscale partial differential equationscited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
- 2025MAPS: Multi-Fidelity AI-Augmented Photonic Simulation and Inverse Design Infrastructurecited by 2
- 2025Democratizing Electronic-Photonic AI Systems: An Open-Source AI-Infused Cross-Layer Co-Design and Design Automation Toolflowcited by 0
- 2026Harnessing Photonics for Machine Intelligencecited by 0
- 2026Fast Reconstruction of Exact Maxwell Dynamics from Sparse Datacited by 0
- 2026Fast Reconstruction of Exact Maxwell Dynamics from Sparse Data19 May 2026
- 2026Harnessing Photonics for Machine Intelligence12 Apr 2026
- 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operators20 Jan 2026
- 2025Democratizing Electronic-Photonic AI Systems: An Open-Source AI-Infused Cross-Layer Co-Design and Design Automation Toolflow31 Dec 2025
- 2025MAPS: Multi-Fidelity AI-Augmented Photonic Simulation and Inverse Design Infrastructure2 Mar 2025