Let There Be Light: Reflection, Refraction and Scattering for Neural Operators
Not on the map. Why?
Abstract (arXiv)
Neural operators learn mappings between infinite-dimensional function spaces and provide a data-driven surrogate modeling paradigm for parametric partial differential equations (PDEs). Existing architectures typically obtain expressivity by parameterizing integral kernels in prescribed transform domains or by applying attention-like interactions over discretized spatial points. While these approaches have achieved substantial progress, they often face a persistent trade-off among physical interpretability, nonlocal spatial communication, mesh scalability, and computational cost. We propose a Light-inspired neural operator(LiNO), an operator-learning architecture whose latent evolution is decomposed into three mechanisms motivated by elementary light transport: reflection, refraction, and scattering. Reflection and refraction act as adaptive pointwise transformations in latent feature space, enabling local feature reorientation and anisotropic modulation, whereas scattering performs input-dependent nonlocal propagation over the physical domain. We first formulate scattering as a normalized pairwise kernel with relative positional bias, and then develop an efficient scattering variant that replaces explicit pairwise interactions with positive-feature global propagation and a local diffusion branch, reducing the dominant spatial complexity from quadratic to linear. This yields a structured neural operator that separates local feature modulation from global spatial communication while retaining a modular and interpretable latent evolution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
19 of 24 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
7 more
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
- 2023LNO: Laplace Neural Operator for Solving Differential Equationscited by 47
- 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
- 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
- 2023KoopmanLab: machine learning for solving complex physics equationscited by 9
Built on by
Not cited yet.