Correcting Neural Operator Spectral Bias via Diffusion Posterior Sampling with Sparse Observations
Not on the map. Why?
Abstract (arXiv)
Neural operator surrogates (NO) approximate PDE solutions orders of magnitude faster than numerical solvers, but suffer from spectral bias: high-frequency content is systematically attenuated, limiting reliability where fine-scale structure matters. Sparse sensor measurements of the field are often available too, offering pointwise accuracy without spectral distortion but covering only a small fraction of the domain. We address this by treating NO predictions as auxiliary observations in a diffusion posterior sampling framework. Our method, FreqNO-DPS (https://github.com/niccoloperrone/FreqNO-DPS), combines an unconditional score-based diffusion prior, trained on high-fidelity simulations, with diffusion posterior sampling (DPS) conditioned on sparse observations and guided by a frozen neural operator. Naive integration reintroduces the surrogate's spectral bias; we resolve this with a closed-form, spectrally shaped guidance score that weights the surrogate by its frequency-dependent accuracy and needs no denoiser backpropagation. A distribution-free analysis bounds the approximation error across the frequency-diffusion-time plane and shows the guidance's frequency dependence is preserved regardless of distributional assumptions. On 3D elastic wavefield prediction at 5% and 2% sensor coverage, the method reaches near-zero spectral bias across all bands, where both the surrogate and sensor-only DPS show systematic high-frequency attenuation. Isotropic guidance, the natural baseline, improves pointwise accuracy but carries the bias into the posterior nearly intact, confirming that frequency-dependent calibration is essential, not merely beneficial. The framework needs only paired surrogate/reference data and exploits no problem-specific structure beyond the residual's approximate spectral diagonality, verifiable for new surrogates via the coherence diagnostic we provide.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
22 of 36 references.
References · 22
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2021Factorized Fourier Neural Operatorscited by 249
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2024Physics-Informed Diffusion Modelscited by 90
- 2017Data-Driven Sparse Sensor Placement for Reconstructioncited by 57
- 2024Numerical analysis of physics-informed neural networks and related models in physics-informed machine learningcited by 39
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
10 more
- 2025Guided Diffusion Sampling on Function Spaces with Applications to PDEscited by 36
- 2025Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systemscited by 31
- 2024Generative AI for fast and accurate statistical computation of fluidscited by 30
- 2024Toward a Better Understanding of Fourier Neural Operators from a Spectral Perspectivecited by 25
- 2025Guiding diffusion models to reconstruct flow fields from sparse datacited by 11
- 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spacescited by 10
- 2024Multiple-Input Fourier Neural Operator (MIFNO) for source-dependent 3D elastodynamicscited by 8
- 2024CoNFiLD-inlet: Synthetic Turbulence Inflow Using Generative Latent Diffusion Models with Neural Fieldscited by 8
- 2026Spectral bias in physics-informed and operator learning: Analysis and mitigation guidelinescited by 8
- 2025Integrating Fourier Neural Operators with Diffusion Models to improve Spectral Representation of Synthetic Earthquake Ground Motion Responsecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance
- 2026Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability
- 2026Latent Diffusion Posterior Sampling with Surrogate Likelihood Guidance for PDE Inverse Problems
- 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems
- 2026Generative Neural Operators through Diffusion Last Layer
- 2026Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models
- 2026Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observations
- 2026Backward-Consistent Diffusion Sampling for Sparsely Observed PDE Inverse Problems