mlsanityData to 7 Oct 2026

OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference

arXiv 2602.01493 ↗First posted 2 Feb 2026cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Solving diverse partial differential equations (PDEs) is fundamental in science and engineering. Large language models (LLMs) have demonstrated strong capabilities in code generation, symbolic reasoning, and tool use, but reliably solving PDEs across heterogeneous settings remains challenging. Prior work on LLM-based code generation and transformer-based foundation models for PDE learning has shown promising advances. However, a persistent trade-off between execution success rate and numerical accuracy arises, particularly when generalization to unseen parameters and boundary conditions is required. In this work, we propose OpInf-LLM, an LLM parametric PDE solving framework via operator inference. The proposed framework leverages small amounts of solution data to enable accurate prediction of diverse PDE instances, including unseen parameters and configurations, and provides seamless integration with LLMs for natural language task specification and physics-based reasoning of proper feature parameterization. Its low computational demands and unified solution pipeline further enable a high execution success rate across heterogeneous settings, opening new possibilities for generalizable reduced-order modeling in LLM-based PDE solving.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 57 of its 113 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

57 of 113 references.

References · 57

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  3. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  4. 2024A Survey on Large Language Models for Code Generationcited by 646
  5. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  6. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  7. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  8. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  9. 2022Message Passing Neural PDE Solverscited by 368
  10. 2022Autoformalization with Large Language Modelscited by 252
  11. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
  12. 2024Poseidon: Efficient Foundation Models for PDEscited by 186
38 more
  1. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
  2. 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
  3. 2022Physics-Informed Deep Neural Operator Networkscited by 110
  4. 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 99
  5. 2019Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systemscited by 96
  6. 2019Learning Neural PDE Solvers with Convergence Guaranteescited by 77
  7. 2024Symbolic Regression with a Learned Concept Librarycited by 76
  8. 2024Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolationcited by 45
  9. 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
  10. 2020Data-driven reduced-order models via regularized operator inference for a single-injector combustion processcited by 42
  11. 2024Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistencycited by 39
  12. 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
  13. 2025CodePDE: An Inference Framework for LLM-driven PDE Solver Generationcited by 37
  14. 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
  15. 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 35
  16. 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
  17. 2024PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamicscited by 33
  18. 2024Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solverscited by 31
  19. 2024UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptationcited by 27
  20. 2025Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applicationscited by 26
  21. 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
  22. 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulationcited by 25
  23. 2021Non-intrusive reduced-order models for parametric partial differential equations via data-driven operator inferencecited by 23
  24. 2025PDE-Controller: LLMs for Autoformalization and Reasoning of PDEscited by 23
  25. 2021Reduced operator inference for nonlinear partial differential equationscited by 21
  26. 2019Learning physics-based reduced-order models for a single-injector combustion processcited by 20
  27. 2025Autoformalization in the Era of Large Language Models: A Surveycited by 19
  28. 2021Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inferencecited by 16
  29. 2024LLM4ED: Large Language Models for Automatic Equation Discoverycited by 13
  30. 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learningcited by 13
  31. 2025DeepSeek vs. ChatGPT vs. Claude: A Comparative Study for Scientific Computing and Scientific Machine Learning Taskscited by 12
  32. 2025Generative Discovery of Partial Differential Equations by Learning from Math Handbookscited by 12
  33. 2025MORPH: PDE Foundation Models with Arbitrary Data Modalitycited by 12
  34. 2025Lang-PINN: From Language to Physics-Informed Neural Networks via a Multi-Agent Frameworkcited by 11
  35. 2025A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptionscited by 8
  36. 2025Text-Trained LLMs Can Zero-Shot Extrapolate PDE Dynamics, Revealing a Three-Stage In-Context Learning Mechanismcited by 7
  37. 2025Towards a Common Framework for Autoformalizationcited by 7
  38. 2025PDE-Agent: A toolchain-augmented multi-agent framework for PDE solvingcited by 7

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PDE-SHARP: PDE Solver Hybrids through Analysis and Refinement Passes
  2. 2025Towards Reasoning for PDE Foundation Models: A Reward-Model-Driven Inference-Time-Scaling Algorithm
  3. 2026PDEFlow: Autonomous Agentic PDE Pipelines for Neural Operator Learning and Solver-Free Inference
  4. 2026AutoPDEBench: Benchmarking LLM Auto-Research for Neural PDE Solver Design
  5. 2026Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewards
  6. 2025Towards a Foundation Model for Partial Differential Equations Across Physics Domains
  7. 2026AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing
  8. 2026UniFluids: Unified Neural Operator Learning with Conditional Flow-matching