ATHENA: Agentic Team for Hierarchical Evolutionary Numerical Algorithms
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Progress in computational science depends on complex numerical workflows that must faithfully encode physical laws, yet translating conceptual insight into reliable code remains a major bottleneck. Although large language models can generate isolated code fragments, they lack the structured reasoning required to design, verify, and iteratively refine complete scientific pipelines. Here we introduce ATHENA, an agentic framework explicitly designed to emulate scientific research modeled as a knowledge-driven contextual bandit process. Its core loop separates conceptual policy from numerical realization through expert-derived conceptual scaffolding, enabling principled diagnosis, reformulation, and repair of computational strategies. Across scientific computing and scientific machine learning tasks, ATHENA autonomously derives and correctly applies exact analytical solutions, constructs stable numerical solvers, diagnoses ill-posed formulations, and orchestrates hybrid symbolic-numeric workflows. Quantitatively, ATHENA matches and frequently surpasses the accuracy of expert-authored reference solutions reported in the literature on canonical benchmarks. By reframing computation as an object of agentic reasoning, our framework enables autonomous orchestration of heterogeneous algorithms across scientific domains.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 76 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
42 of 76 references.
References · 42
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 128
- 2024Wav-KAN: Wavelet Kolmogorov-Arnold Networkscited by 118
- 2024A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networkscited by 103
- 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learningcited by 73
30 more
- 2023Residual-based attention in physics-informed neural networkscited by 72
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2025Mathematical exploration and discovery at scalecited by 66
- 2022Failure-informed adaptive sampling for PINNscited by 64
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
- 2025An AI system to help scientists write expert-level empirical softwarecited by 52
- 2020DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolationcited by 45
- 2025Optimizing the Optimizer for Physics-Informed Neural Networks and Kolmogorov-Arnold Networkscited by 41
- 2023On the training and generalization of deep operator networkscited by 31
- 2024Unveiling the optimization process of Physics Informed Neural Networks: How accurate and competitive can PINNs be?cited by 31
- 2024RiemannONets: Interpretable Neural Operators for Riemann Problemscited by 28
- 2019Multi-scale Deep Neural Networks for Solving High Dimensional PDEscited by 24
- 2024Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networkscited by 20
- 2025PINNsAgent: Automated PDE Surrogation with Large Language Modelscited by 17
- 2025Defining Foundation Models for Computational Science: A Call for Clarity and Rigorcited by 16
- 2025A multi-agentic framework for real-time, autonomous freeform metasurface designcited by 14
- 2023Failure-informed adaptive sampling for PINNs, Part II: combining with re-sampling and subset simulationcited by 13
- 2024Learning in PINNs: Phase transition, diffusion equilibrium, and generalizationcited by 13
- 2024KKANs: Kurkova-Kolmogorov-Arnold Networks and Their Learning Dynamicscited by 13
- 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learningcited by 13
- 2025DeepSeek vs. ChatGPT vs. Claude: A Comparative Study for Scientific Computing and Scientific Machine Learning Taskscited by 12
- 2025Representation Meets Optimization: Training PINNs and PIKANs for Gray-Box Discovery in Systems Pharmacologycited by 10
- 2025High precision PINNs in unbounded domains: application to singularity formulation in PDEscited by 6
- 2025A Variational Framework for Residual-Based Adaptivity in Neural PDE Solvers and Operator Learningcited by 6
- 2025Self-adaptive weighting and sampling for physics-informed neural networkscited by 6
- 2023GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Sciencecited by 5
- 2025Toward Autonomous Engineering Design: A Knowledge-Guided Multi-Agent Frameworkcited by 5
- 2025FMEnets: Flow, Material, and Energy networks for non-ideal plug flow reactor designcited by 2
- 2025An Agentic AI Workflow to Simplify Parameter Estimation of Complex Differential Equation Systemscited by 1
- 2025Flexible Swarm Learning May Outpace Foundation Models in Essential Taskscited by 1
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methodscited by 12
- 2026GRAFT-ATHENA: Self-Improving Agentic Teams for Autonomous Discovery and Evolutionary Numerical Algorithmscited by 6
- 2026The AI Scientific Community: Agentic Virtual Lab Swarmscited by 2
- 2026Agentic Symbolic Search: Characterizing PDEs Beyond Hand-crafted Expressions, Meshes, and Neural Networkscited by 2
- 2026An Agentic AI Scientific Community for Automated Neural Operator Discoverycited by 2
- 2026Physics-Audited Agentic Discovery in Scientific Machine Learningcited by 0
- 2026LLM-IDEA: Identifiability-Driven Experimental Agent for Autonomous Discovery of Mechanistic World Modelscited by 0
- 2026LLM-IDEA: Identifiability-Driven Experimental Agent for Autonomous Discovery of Mechanistic World Models8 Oct 2026
- 2026An Agentic AI Scientific Community for Automated Neural Operator Discovery13 Jul 2026
- 2026Physics-Audited Agentic Discovery in Scientific Machine Learning8 Jul 2026
- 2026Agentic Symbolic Search: Characterizing PDEs Beyond Hand-crafted Expressions, Meshes, and Neural Networks18 Jun 2026
- 2026GRAFT-ATHENA: Self-Improving Agentic Teams for Autonomous Discovery and Evolutionary Numerical Algorithms11 May 2026
- 2026The AI Scientific Community: Agentic Virtual Lab Swarms22 Mar 2026
- 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methods8 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery
- 2026EvoMaster: A Foundational Evolving Agent Framework for Agentic Science at Scale
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery
- 2026Agentic evolution of physically constrained foundation models
- 2026InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery
- 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agents
- 2026Evolving Ensemble of Agents
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discovery