mlsanityData to 7 Oct 2026

CompNO: A Novel Foundation Model approach for solving Partial Differential Equations

arXiv 2601.07384 ↗First posted 12 Jan 2026cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Partial differential equations (PDEs) govern a wide range of physical phenomena, but their numerical solution remains computationally demanding, especially when repeated simulations are required across many parameter settings. Recent Scientific Foundation Models (SFMs) aim to alleviate this cost by learning universal surrogates from large collections of simulated systems, yet they typically rely on monolithic architectures with limited interpretability and high pretraining expense. In this work we introduce Compositional Neural Operators (CompNO), a compositional neural operator framework for parametric PDEs. Instead of pretraining a single large model on heterogeneous data, CompNO first learns a library of Foundation Blocks, where each block is a parametric Fourier neural operator specialized to a fundamental differential operator (e.g. convection, diffusion, nonlinear convection). These blocks are then assembled, via lightweight Adaptation Blocks, into task-specific solvers that approximate the temporal evolution operator for target PDEs. A dedicated boundary-condition operator further enforces Dirichlet constraints exactly at inference time. We validate CompNO on one-dimensional convection, diffusion, convection--diffusion and Burgers' equations from the PDEBench suite. The proposed framework achieves lower relative L2 error than strong baselines (PFNO, PDEFormer and in-context learning based models) on linear parametric systems, while remaining competitive on nonlinear Burgers' flows. The model maintains exact boundary satisfaction with zero loss at domain boundaries, and exhibits robust generalization across a broad range of Peclet and Reynolds numbers. These results demonstrate that compositional neural operators provide a scalable and physically interpretable pathway towards foundation models for PDEs.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

24 of 34 references.

References · 24

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  6. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  7. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  8. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  9. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  10. 2024Poseidon: Efficient Foundation Models for PDEscited by 186
  11. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  12. 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
12 more
  1. 2024Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networkscited by 64
  2. 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
  3. 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 33
  4. 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
  5. 2024VICON: Vision In-Context Operator Networks for Multi-Physics Fluid Dynamics Predictioncited by 22
  6. 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
  7. 2025PhysiX: A Foundation Model for Physics Simulationscited by 21
  8. 2025BCAT: A Block Causal Transformer for PDE Foundation Models for Fluid Dynamicscited by 16
  9. 2025Defining Foundation Models for Computational Science: A Call for Clarity and Rigorcited by 16
  10. 2025A Deep Learning Framework for Multi-Operator Learning: Architectures and Approximation Theorycited by 6
  11. 2024Parametric Learning of Time-Advancement Operators for Unstable Flame Evolutioncited by 5
  12. 2023Fine-Tune Language Models as Multi-Modal Differential Equation Solverscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.