CompNO: A Novel Foundation Model approach for solving Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
Partial differential equations (PDEs) govern a wide range of physical phenomena, but their numerical solution remains computationally demanding, especially when repeated simulations are required across many parameter settings. Recent Scientific Foundation Models (SFMs) aim to alleviate this cost by learning universal surrogates from large collections of simulated systems, yet they typically rely on monolithic architectures with limited interpretability and high pretraining expense. In this work we introduce Compositional Neural Operators (CompNO), a compositional neural operator framework for parametric PDEs. Instead of pretraining a single large model on heterogeneous data, CompNO first learns a library of Foundation Blocks, where each block is a parametric Fourier neural operator specialized to a fundamental differential operator (e.g. convection, diffusion, nonlinear convection). These blocks are then assembled, via lightweight Adaptation Blocks, into task-specific solvers that approximate the temporal evolution operator for target PDEs. A dedicated boundary-condition operator further enforces Dirichlet constraints exactly at inference time. We validate CompNO on one-dimensional convection, diffusion, convection--diffusion and Burgers' equations from the PDEBench suite. The proposed framework achieves lower relative L2 error than strong baselines (PFNO, PDEFormer and in-context learning based models) on linear parametric systems, while remaining competitive on nonlinear Burgers' flows. The model maintains exact boundary satisfaction with zero loss at domain boundaries, and exhibits robust generalization across a broad range of Peclet and Reynolds numbers. These results demonstrate that compositional neural operators provide a scalable and physically interpretable pathway towards foundation models for PDEs.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
24 of 34 references.
References · 24
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
12 more
- 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
- 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 33
- 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
- 2024VICON: Vision In-Context Operator Networks for Multi-Physics Fluid Dynamics Predictioncited by 22
- 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
- 2025PhysiX: A Foundation Model for Physics Simulationscited by 21
- 2025BCAT: A Block Causal Transformer for PDE Foundation Models for Fluid Dynamicscited by 16
- 2025Defining Foundation Models for Computational Science: A Call for Clarity and Rigorcited by 16
- 2025A Deep Learning Framework for Multi-Operator Learning: Architectures and Approximation Theorycited by 6
- 2024Parametric Learning of Time-Advancement Operators for Unstable Flame Evolutioncited by 5
- 2023Fine-Tune Language Models as Multi-Modal Differential Equation Solverscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Datacited by 1
- 2026SCNO: Spiking Compositional Neural Operator -- Towards a Neuromorphic Foundation Model for Nuclear PDE Solvingcited by 0
- 2026Compositional Neural Operators for Multi-Dimensional Fluid Dynamicscited by 0
- 2026Compositional Embedding Architecture for Physical Field Prediction in Componentized Aerospace Systemscited by 0
- 2026Compositional Embedding Architecture for Physical Field Prediction in Componentized Aerospace Systems23 Sep 2026
- 2026Compositional Neural Operators for Multi-Dimensional Fluid Dynamics12 May 2026
- 2026SCNO: Spiking Compositional Neural Operator -- Towards a Neuromorphic Foundation Model for Nuclear PDE Solving13 Apr 2026
- 2026MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data1 Apr 2026