OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference
Not on the map. Why?
Abstract (arXiv)
Solving diverse partial differential equations (PDEs) is fundamental in science and engineering. Large language models (LLMs) have demonstrated strong capabilities in code generation, symbolic reasoning, and tool use, but reliably solving PDEs across heterogeneous settings remains challenging. Prior work on LLM-based code generation and transformer-based foundation models for PDE learning has shown promising advances. However, a persistent trade-off between execution success rate and numerical accuracy arises, particularly when generalization to unseen parameters and boundary conditions is required. In this work, we propose OpInf-LLM, an LLM parametric PDE solving framework via operator inference. The proposed framework leverages small amounts of solution data to enable accurate prediction of diverse PDE instances, including unseen parameters and configurations, and provides seamless integration with LLMs for natural language task specification and physics-based reasoning of proper feature parameterization. Its low computational demands and unified solution pipeline further enable a high execution success rate across heterogeneous settings, opening new possibilities for generalizable reduced-order modeling in LLM-based PDE solving.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 57 of its 113 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
57 of 113 references.
References · 57
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2022Message Passing Neural PDE Solverscited by 368
- 2022Autoformalization with Large Language Modelscited by 252
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
38 more
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 99
- 2019Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systemscited by 96
- 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
- 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
- 2020Data-driven reduced-order models via regularized operator inference for a single-injector combustion processcited by 42
- 2024Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistencycited by 39
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
- 2025CodePDE: An Inference Framework for LLM-driven PDE Solver Generationcited by 37
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
- 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
- 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 33
- 2024Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solverscited by 31
- 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
- 2025Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applicationscited by 26
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulationcited by 25
- 2021Non-intrusive reduced-order models for parametric partial differential equations via data-driven operator inferencecited by 23
- 2025PDE-Controller: LLMs for Autoformalization and Reasoning of PDEscited by 23
- 2021Reduced operator inference for nonlinear partial differential equationscited by 21
- 2019Learning physics-based reduced-order models for a single-injector combustion processcited by 20
- 2025Autoformalization in the Era of Large Language Models: A Surveycited by 19
- 2021Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inferencecited by 16
- 2024LLM4ED: Large Language Models for Automatic Equation Discoverycited by 13
- 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learningcited by 13
- 2025DeepSeek vs. ChatGPT vs. Claude: A Comparative Study for Scientific Computing and Scientific Machine Learning Taskscited by 12
- 2025Generative Discovery of Partial Differential Equations by Learning from Math Handbookscited by 12
- 2025MORPH: PDE Foundation Models with Arbitrary Data Modalitycited by 12
- 2025Lang-PINN: From Language to Physics-Informed Neural Networks via a Multi-Agent Frameworkcited by 11
- 2025A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptionscited by 8
- 2025Text-Trained LLMs Can Zero-Shot Extrapolate PDE Dynamics, Revealing a Three-Stage In-Context Learning Mechanismcited by 7
- 2025Towards a Common Framework for Autoformalizationcited by 7
- 2025PDE-Agent: A toolchain-augmented multi-agent framework for PDE solvingcited by 7
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generationcited by 4
- 2026Large language models for partial differential equation workflowscited by 0
- 2026GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulationcited by 0
- 2026Prior or Feedback? What an LLM Uses When Adapting Neural Operatorscited by 0
- 2026Prior or Feedback? What an LLM Uses When Adapting Neural Operators8 Oct 2026
- 2026GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulation28 Sep 2026
- 2026Large language models for partial differential equation workflows4 Aug 2026
- 2026PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generation10 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025PDE-SHARP: PDE Solver Hybrids through Analysis and Refinement Passes
- 2025Towards Reasoning for PDE Foundation Models: A Reward-Model-Driven Inference-Time-Scaling Algorithm
- 2026PDEFlow: Autonomous Agentic PDE Pipelines for Neural Operator Learning and Solver-Free Inference
- 2026AutoPDEBench: Benchmarking LLM Auto-Research for Neural PDE Solver Design
- 2026Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewards
- 2025Towards a Foundation Model for Partial Differential Equations Across Physics Domains
- 2026AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing
- 2026UniFluids: Unified Neural Operator Learning with Conditional Flow-matching