PDE-Agent: A toolchain-augmented multi-agent framework for PDE solving
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Solving Partial Differential Equations (PDEs) is a cornerstone of engineering and scientific research. Traditional methods for PDE solving are cumbersome, relying on manual setup and domain expertise. While Physics-Informed Neural Network (PINNs) introduced end-to-end neural network-based solutions, and frameworks like DeepXDE further enhanced automation, these approaches still depend on expert knowledge and lack full autonomy. In this work, we frame PDE solving as tool invocation via LLM-driven agents and introduce PDE-Agent, the first toolchain-augmented multi-agent collaboration framework, inheriting the reasoning capacity of LLMs and the controllability of external tools and enabling automated PDE solving from natural language descriptions. PDE-Agent leverages the strengths of multi-agent and multi-tool collaboration through two key innovations: (1) A Prog-Act framework with graph memory for multi-agent collaboration, which enables effective dynamic planning and error correction via dual-loop mechanisms (localized fixes and global revisions). (2) A Resource-Pool integrated with a tool-parameter separation mechanism for multi-tool collaboration. This centralizes the management of runtime artifacts and resolves inter-tool dependency gaps in existing frameworks. To validate and evaluate this new paradigm for PDE solving , we develop PDE-Bench, a multi-type PDE Benchmark for agent-based tool collaborative solving, and propose multi-level metrics for assessing tool coordination. Evaluations verify that PDE-Agent exhibits superior applicability and performance in complex multi-step, cross-step dependent tasks. This new paradigm of toolchain-augmented multi-agent PDE solving will further advance future developments in automated scientific computing. Our source code and dataset will be made publicly available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 48 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
32 of 48 references.
References · 32
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2019DeepXDE: A deep learning library for solving differential equationscited by 619
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
20 more
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 274
- 2024Tool Learning with Large Language Models: A Surveycited by 223
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 116
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 87
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
- 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoningcited by 69
- 2023Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculumcited by 65
- 2024LLM With Tools: A Surveycited by 61
- 2024What Are Tools Anyway? A Survey from the Language Model Perspectivecited by 54
- 2020A Physics-Informed Machine Learning Approach for Solving Heat Transfer Equation in Advanced Manufacturing and Engineering Applicationscited by 53
- 2023Evaluating and Improving Tool-Augmented Computation-Intensive Math Reasoningcited by 49
- 2025Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agentscited by 24
- 2019PyDEns: a Python Framework for Solving Differential Equations with Neural Networkscited by 14
- 2025OptMetaOpenFOAM: Large Language Model Driven Chain of Thought for Sensitivity Analysis and Parameter Optimization based on CFDcited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computingcited by 8
- 2026GRAFT-ATHENA: Self-Improving Agentic Teams for Autonomous Discovery and Evolutionary Numerical Algorithmscited by 6
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inferencecited by 5
- 2026Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewardscited by 2
- 2026An Agentic Evaluation Framework for AI-Generated Scientific Code in PETSccited by 1
- 2026InfEngine: A Self-Verifying and Self-Optimizing Intelligent Engine for Infrared Radiation Computingcited by 0
- 2026Large language models for partial differential equation workflowscited by 0
- 2026Large language models for partial differential equation workflows4 Aug 2026
- 2026Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewards11 Jul 2026
- 2026GRAFT-ATHENA: Self-Improving Agentic Teams for Autonomous Discovery and Evolutionary Numerical Algorithms11 May 2026
- 2026An Agentic Evaluation Framework for AI-Generated Scientific Code in PETSc16 Mar 2026
- 2026InfEngine: A Self-Verifying and Self-Optimizing Intelligent Engine for Infrared Radiation Computing22 Feb 2026
- 2026AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computing19 Feb 2026
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Lang-PINN: From Language to Physics-Informed Neural Networks via a Multi-Agent Framework
- 2026AutoPDEBench: Benchmarking LLM Auto-Research for Neural PDE Solver Design
- 2025CodePDE: An Inference Framework for LLM-driven PDE Solver Generation
- 2026EvoPINN: Agentic Discovery of Executable Algorithms for Physics-Informed Neural Networks
- 2025Automated Code Development for PDE Solvers Using Large Language Models
- 2025PDE-Controller: LLMs for Autoformalization and Reasoning of PDEs
- 2026AutoPDE: Reliable Agentic PDE Solving via Explicitly Represented Solver Strategies
- 2026PDEFlow: Autonomous Agentic PDE Pipelines for Neural Operator Learning and Solver-Free Inference