Learnable composition for neural operators
Not on the map. Why?
Abstract (arXiv)
Neural operators are fast, differentiable surrogates for physical simulation, but their accuracy often degrades when domain geometry, size, or operating conditions differ from training. Supervised adaptation can recover accuracy, but even a small target set requires costly high-fidelity simulations. We therefore ask how pretraining and transfer can be designed together to reduce this deployment cost. LatentDDM first pretrains a neural operator to predict fields on small subdomains. For a new setting, it freezes this operator and trains only a lightweight module that composes the local predictions. We evaluate our method on two complementary problems: steady Darcy flow, where long-range pressure coupling must extend across increasingly large porous domains, and unsteady incompressible flow around a pitching airfoil, where rollout errors compound as target pitching frequencies exceed the training range. Compared with the capacity-matched models that process the full domain at once, LatentDDM's error is 36-56% lower on larger Darcy domains after adaptation with 16 target simulations. It also improves 20-step field rollouts in fast-pitching airfoil flow, both zero-shot and after few-shot calibration. These results identify the co-designed local pretraining and composition-level transfer as a promising design principle for physical foundation models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
31 of 43 references.
References · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 74
- 2024Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEscited by 58
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
19 more
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 33
- 2024Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solverscited by 31
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulationcited by 25
- 2023Multi-Resolution Active Learning of Fourier Neural Operatorscited by 22
- 2024VICON: Vision In-Context Operator Networks for Multi-Physics Fluid Dynamics Predictioncited by 22
- 2025BCAT: A Block Causal Transformer for PDE Foundation Models for Fluid Dynamicscited by 16
- 2025Geometric Operator Learning with Optimal Transportcited by 15
- 2022Learning Interface Conditions in Domain Decomposition Solverscited by 11
- 2024Towards General Neural Surrogate Solvers with Specialized Neural Acceleratorscited by 8
- 2026Test-time Generalization for Physics through Neural Operator Splittingcited by 8
- 2026GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Trainingcited by 8
- 2025Operator Learning with Domain Decomposition for Geometry Generalization in PDE Solvingcited by 6
- 2020AMReX: Block-Structured Adaptive Mesh Refinement for Multiphysics Applicationscited by 5
- 2024M2PDE: Compositional Generative Multiphysics and Multi-component PDE Simulationcited by 4
- 2025Convolutional-neural-operator-based transfer learning for solving PDEscited by 2
- 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulationcited by 2
- 2026BRICKS: Compositional Neural Markov Kernels for Zero-Shot Radiation-Matter Simulationcited by 2
- 2026Neural-Schwarz Tiling for Geometry-Universal PDE Solving at Scalecited by 2
- 2026Zero-shot generalization of transformer neural operators to larger domainscited by 1
Built on by
Not cited yet.