What Do CAE Simulation Agents Really Need Beyond a Generic Harness?
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Computer-aided engineering (CAE) simulation is among the largest and most demanding areas of engineering, where setting up a solver such as OpenFOAM, FEniCS, or COMSOL takes real expertise. Large language model (LLM) agents promise to turn a natural-language request into a working simulation, and recent CAE agents add simulation-specific machinery: multi-agent decomposition, domain retrieval, and scripted reflection. That machinery suited weak base models; modern harnesses already supply multi-turn reasoning, tool use, and execution feedback. We ask what a CAE simulation agent still needs beyond a generic harness. With information access and repair budget held fixed, a single-agent harness matches or beats multi-agent specialized systems (FoamBench 96.4% vs. 88.2%). Ablations trace this to capabilities the harness already provides: execution-feedback repair lifts FoamBench from 71.8% with no repair round to 96.4%, while scripted reflection adds nothing. The one input that still helps is domain knowledge supplied as solver tutorials, our largest measured gain (80.9% to 96.4%).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 37 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
18 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2026Dive into Claude Code: The Design Space of Today's and Future AI Agent Systems14 Apr
- 2026Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline18 Jan
- 2025Confucius Code Agent: Scalable Agent Scaffolding for Real-World Codebases11 Dec
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep
Other references · 14
- 2023MechAgents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and integrate knowledgecited by 62
- 2024MetaOpenFOAM: an LLM-based multi-agent framework for CFDcited by 39
- 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgetscited by 28
- 2025FEABench: Evaluating Language Models on Multiphysics Reasoning Abilitycited by 21
- 2025RExBench: Can coding agents autonomously implement AI research extensions?cited by 17
- 2025Foam-Agent 2.0: An End-to-End Composable Multi-Agent Framework for Automating CFD Simulation in OpenFOAMcited by 15
- 2025Integrating Large Language Models for Automated Structural Analysiscited by 12
- 2026ALL-FEM: Agentic Large Language models Fine-tuned for Finite Element Methodscited by 12
- 2025FeaGPT: an End-to-End agentic-AI for Finite Element Analysiscited by 10
- 2025ChatCFD: An LLM-Driven Agent for End-to-End CFD Automation with Structured Knowledge and Reasoningcited by 9
- 2025FEM-Bench: A Structured Scientific Reasoning Benchmark for Evaluating Code-Generating LLMscited by 7
- 2025OptMetaOpenFOAM: Large Language Model Driven Chain of Thought for Sensitivity Analysis and Parameter Optimization based on CFDcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026What makes a harness a harness: necessary and sufficient conditions for an agent harness
- 2026Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality
- 2026Harness Engineering for Predictable Agentic Systems: An Empirical Study of Deterministic Execution Constraints
- 2026How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?
- 2026CAX-Agent: A Lightweight Agent Harness for Reliable APDL Automation
- 2026Finding the Right Fit: Model-Harness Interactions across Agent Tasks
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
- 2026Code as Agent Harness