Learning Neural Operators from Partial Observations via Latent Autoregressive Modeling
Not on the map. Why?
Abstract (arXiv)
Real-world scientific applications frequently encounter incomplete observational data due to sensor limitations, geographic constraints, or measurement costs. Although neural operators significantly advanced PDE solving in terms of computational efficiency and accuracy, their underlying assumption of fully-observed spatial inputs severely restricts applicability in real-world applications. We introduce the first systematic framework for learning neural operators from partial observation. We identify and formalize two fundamental obstacles: (i) the supervision gap in unobserved regions that prevents effective learning of physical correlations, and (ii) the dynamic spatial mismatch between incomplete inputs and complete solution fields. Specifically, our proposed Latent Autoregressive Neural Operator(LANO) introduces two novel components designed explicitly to address the core difficulties of partial observations: (i) a mask-to-predict training strategy that creates artificial supervision by strategically masking observed regions, and (ii) a Physics-Aware Latent Propagator that reconstructs solutions through boundary-first autoregressive generation in latent space. Additionally, we develop POBench-PDE, a dedicated and comprehensive benchmark designed specifically for evaluating neural operators under partial observation conditions across three PDE-governed tasks. LANO achieves state-of-the-art performance with 18--69% relative L2 error reduction across all benchmarks under patch-wise missingness with less than 50% missing rate, including real-world climate prediction. Our approach effectively addresses practical scenarios involving up to 75% missing rate, to some extent bridging the existing gap between idealized research settings and the complexities of real-world scientific computing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
35 of 51 references.
References · 35
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2016Pixel Recurrent Neural Networkscited by 814
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
23 more
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022MIONet: Learning multiple-input operators via tensor productcited by 180
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 80
- 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
- 2021Task Transformer Network for Joint MRI Reconstruction and Super-Resolutioncited by 58
- 2023Improved Operator Learning by Orthogonal Attentioncited by 58
- 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
- 2025VFlow: Discovering Optimal Agentic Workflows for Verilog Generationcited by 19
- 2023Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEscited by 16
- 2024Accelerating PDE Data Generation via Differential Operator Action in Solution Spacecited by 15
- 2018Deep learning electromagnetic inversion with convolutional neural networkscited by 12
- 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recyclingcited by 12
- 2025Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-Trainingcited by 10
- 2025Exploiting Edited Large Language Models as General Scientific Optimizerscited by 7
- 2025Self-Attention to Operator Learning-based 3D-IC Thermal Simulationcited by 6
- 2025SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioningcited by 5
- 2025STNet: Spectral Transformation Network for Solving Operator Eigenvalue Problemcited by 2
Built on by
Not cited yet.