Multi-Operator Few-Shot Learning for Generalization Across PDE Families
Not on the map. Why?
Abstract (arXiv)
Learning solution operators for partial differential equations (PDEs) has become a foundational task in scientific machine learning. However, existing neural operator methods require abundant training data for each specific PDE and lack the ability to generalize across PDE families. In this work, we propose MOFS: a unified multimodal framework for multi-operator few-shot learning, which aims to generalize to unseen PDE operators using only a few demonstration examples. Our method integrates three key components: (i) multi-task self-supervised pretraining of a shared Fourier Neural Operator (FNO) encoder to reconstruct masked spatial fields and predict frequency spectra, (ii) text-conditioned operator embeddings derived from statistical summaries of input-output fields, and (iii) memory-augmented multimodal prompting with gated fusion and cross-modal gradient-based attention. We adopt a two-stage training paradigm that first learns prompt-conditioned inference on seen operators and then applies end-to-end contrastive fine-tuning to align latent representations across vision, frequency, and text modalities. Experiments on PDE benchmarks, including Darcy Flow and Navier Stokes variants, demonstrate that our model outperforms existing operator learning baselines in few-shot generalization. Extensive ablations validate the contributions of each modality and training component. Our approach offers a new foundation for universal and data-efficient operator learning across scientific domains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
16 of 20 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2021Choose a Transformer: Fourier or Galerkincited by 343
4 more
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2024STRAP: Robot Sub-Trajectory Retrieval for Augmented Policy Learningcited by 44
- 2022Meta-PDE: Learning to Solve PDEs Quickly Without a Meshcited by 18
- 2024LeMON: Learning to Learn Multi-Operator Networkscited by 14
Built on by
Not cited yet.