mlsanityData to 7 Oct 2026

Let There Be Light: Reflection, Refraction and Scattering for Neural Operators

arXiv 2606.03262 ↗First posted 2 Jun 2026cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural operators learn mappings between infinite-dimensional function spaces and provide a data-driven surrogate modeling paradigm for parametric partial differential equations (PDEs). Existing architectures typically obtain expressivity by parameterizing integral kernels in prescribed transform domains or by applying attention-like interactions over discretized spatial points. While these approaches have achieved substantial progress, they often face a persistent trade-off among physical interpretability, nonlocal spatial communication, mesh scalability, and computational cost. We propose a Light-inspired neural operator(LiNO), an operator-learning architecture whose latent evolution is decomposed into three mechanisms motivated by elementary light transport: reflection, refraction, and scattering. Reflection and refraction act as adaptive pointwise transformations in latent feature space, enabling local feature reorientation and anisotropic modulation, whereas scattering performs input-dependent nonlocal propagation over the physical domain. We first formulate scattering as a normalized pairwise kernel with relative positional bias, and then develop an efficient scattering variant that replaces explicit pairwise interactions with positive-feature global propagation and a local diffusion branch, reducing the dominant spatial complexity from quadratic to linear. This yields a structured neural operator that separates local feature modulation from global spatial communication while retaining a modular and interpretable latent evolution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

19 of 24 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  6. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  7. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  8. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  9. 2021Choose a Transformer: Fourier or Galerkincited by 333
  10. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  11. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  12. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
7 more
  1. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  2. 2022U-NO: U-shaped Neural Operatorscited by 219
  3. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
  4. 2023LNO: Laplace Neural Operator for Solving Differential Equationscited by 47
  5. 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
  6. 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
  7. 2023KoopmanLab: machine learning for solving complex physics equationscited by 9

Built on by

Not cited yet.