mlsanityData to 7 Oct 2026

PGOT: A Physics-Geometry Operator Transformer for Complex PDEs

arXiv 2512.23192 ↗First posted 29 Dec 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

While Transformers have demonstrated remarkable potential in modeling Partial Differential Equations (PDEs), modeling large-scale unstructured meshes with complex geometries remains a significant challenge. Existing efficient architectures often employ feature dimensionality reduction strategies, which inadvertently induces Geometric Aliasing, resulting in the loss of critical physical boundary information. To address this, we propose the Physics-Geometry Operator Transformer (PGOT), designed to reconstruct physical feature learning through explicit geometry awareness. Specifically, we propose Spectrum-Preserving Geometric Attention (SpecGeo-Attention). Utilizing a ``physics slicing-geometry injection" mechanism, this module incorporates multi-scale geometric encodings to explicitly preserve multi-scale geometric features while maintaining linear computational complexity O(N). Furthermore, PGOT dynamically routes computations to low-order linear paths for smooth regions and high-order non-linear paths for shock waves and discontinuities based on spatial coordinates, enabling spatially adaptive and high-precision physical field modeling. PGOT achieves consistent state-of-the-art performance across four standard benchmarks and excels in large-scale industrial tasks including airfoil and car designs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

35 of 53 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Inductive Representation Learning on Large Graphscited by 6,284
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  6. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  7. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  8. 2019Graph U-Netscited by 489
  9. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  10. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  11. 2021Choose a Transformer: Fourier or Galerkincited by 333
  12. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
23 more
  1. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  2. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  3. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  5. 2021Global Filter Networks for Image Classificationcited by 257
  6. 2021Factorized Fourier Neural Operatorscited by 237
  7. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  8. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  9. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
  10. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  11. 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 77
  12. 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
  13. 2023Improved Operator Learning by Orthogonal Attentioncited by 58
  14. 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 56
  15. 2022Mitigating spectral bias for the multiscale operator learningcited by 43
  16. 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
  17. 2023Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEscited by 16
  18. 2025Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptationcited by 14
  19. 2025Physics-Informed Representation Alignment for Sparse Radio-Map Reconstructioncited by 11
  20. 2023Understanding the Expressivity and Trainability of Fourier Neural Operator: A Mean-Field Perspectivecited by 10
  21. 2025SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEscited by 6
  22. 2023Geometric instability of graph neural networks on large graphscited by 2
  23. 2025Maximal Update Parametrization and Zero-Shot Hyperparameter Transfer for Fourier Neural Operatorscited by 1

Built on by

Not cited yet.