Mesh-Informed Neural Operator : A Transformer Generative Approach
Not on the map. Why?
Abstract (arXiv)
Generative models in function spaces, situated at the intersection of generative modeling and operator learning, are attracting increasing attention due to their immense potential in diverse scientific and engineering applications. While functional generative models are theoretically domain- and discretization-agnostic, current implementations heavily rely on the Fourier Neural Operator (FNO), limiting their applicability to regular grids and rectangular domains. To overcome these critical limitations, we introduce the Mesh-Informed Neural Operator (MINO). By leveraging graph neural operators and cross-attention mechanisms, MINO offers a principled, domain- and discretization-agnostic backbone for generative modeling in function spaces. This advancement significantly expands the scope of such models to more diverse applications in generative, inverse, and regression tasks. Furthermore, MINO provides a unified perspective on integrating neural operators with general advanced deep learning architectures. Finally, we introduce a suite of standardized evaluation metrics that enable objective comparison of functional generative models, addressing another critical gap in the field.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 20 Jun 2025.
Builds on
43 of 50 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
31 more
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2022U-NO: U-shaped Neural Operatorscited by 230
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
- 2021Generative Models as Distributions of Functionscited by 89
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 84
- 2023Score-based Diffusion Models in Function Spacecited by 82
- 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 80
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 62
- 2022Understanding convolution on graphs via energiescited by 59
- 2022Generative Adversarial Neural Operatorscited by 52
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2022Diffusion Generative Models in Infinite Dimensionscited by 49
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 38
- 2022Learning to Solve PDE-constrained Inverse Problems with Graph Networkscited by 37
- 2025Guided Diffusion Sampling on Function Spaces with Applications to PDEscited by 36
- 2022Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detectioncited by 33
- 2023Variational Autoencoding Neural Operatorscited by 22
- 2025Stochastic Process Learning via Operator Flow Matchingcited by 14
- 2023Broadband Ground Motion Synthesis via Generative Adversarial Neural Operators: Development and Validationcited by 12
- 2024The GeometricKernels Package: Heat and Mat'ern Kernels for Geometric Learning on Manifolds, Meshes, and Graphscited by 11
- 2024Universal Functional Regression with Neural Operator Flowscited by 9
- 2023Sliced Wasserstein distance between probability measures on Hilbert spacescited by 5
- 2023DFU: scale-robust diffusion model for zero-shot super-resolution image generationcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 9.
11 papers.
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorchcited by 3
- 2025Geometric Laplace Neural Operatorcited by 2
- 2026Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systemscited by 1
- 2026Enforcing Reciprocity in Operator Learning for Seismic Wave Propagationcited by 1
- 2026Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inferencecited by 1
- 2026GRIFDIR: Graph Resolution-Invariant FEM Diffusion Models in Function Spaces over Irregular Domainscited by 1
- 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversioncited by 0
- 2026Large-Scale 3D Ground-Motion Synthesis with Physics-Inspired Latent Operator Flow Matchingcited by 0
- 2026SPAMoE: Spectrum-Aware Hybrid Operator Framework for Full-Waveform Inversioncited by 0
- 2026Learning Neural Operator Surrogates for the Black Hole Accretion Codecited by 0
- 2026Flow Annealing Posterior Sampling for Function-Space Regression and Inverse Problemscited by 0
- 2026Flow Annealing Posterior Sampling for Function-Space Regression and Inverse Problems21 Jun 2026
- 2026GRIFDIR: Graph Resolution-Invariant FEM Diffusion Models in Function Spaces over Irregular Domains5 May 2026
- 2026Learning Neural Operator Surrogates for the Black Hole Accretion Code28 Apr 2026
- 2026Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inference22 Apr 2026
- 2026SPAMoE: Spectrum-Aware Hybrid Operator Framework for Full-Waveform Inversion8 Apr 2026
- 2026Large-Scale 3D Ground-Motion Synthesis with Physics-Inspired Latent Operator Flow Matching18 Mar 2026
- 2026Enforcing Reciprocity in Operator Learning for Seismic Wave Propagation12 Feb 2026
- 2026Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systems10 Feb 2026
- 2026torch-sla: Differentiable Sparse Linear Algebra with Adjoint Solvers and Sparse Tensor Parallelism for PyTorch20 Jan 2026
- 2025Geometric Laplace Neural Operator18 Dec 2025
- 2025SA-EMO: Structure-Aligned Encoder Mixture of Operators for Generalizable Full-waveform Inversion7 Nov 2025