Talk Freely, Execute Strictly: Schema-Gated Agentic AI for Flexible and Reproducible Scientific Workflows
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large language models (LLMs) can now translate a researcher's plain-language goal into executable computation, yet scientific workflows demand determinism, provenance, and governance that are difficult to guarantee when an LLM decides what runs. Semi-structured interviews with 18 experts across 10 industrial R&D stakeholders surface 2 competing requirements--deterministic, constrained execution and conversational flexibility without workflow rigidity--together with boundary properties (human-in-the-loop control and transparency) that any resolution must satisfy. We propose schema-gated orchestration as the resolving principle: the schema becomes a mandatory execution boundary at the composed-workflow level, so that nothing runs unless the complete action--including cross-step dependencies--validates against a machine-checkable specification. We operationalize the 2 requirements as execution determinism (ED) and conversational flexibility (CF), and use these axes to review 20 systems spanning 5 architectural groups along a validation-scope spectrum. Scores are assigned via a multi-model protocol--15 independent sessions across 3 LLM families--yielding substantial-to-near-perfect inter-model agreement (Krippendorff a=0.80 for ED and a=0.98 for CF), demonstrating that multi-model LLM scoring can serve as a reusable alternative to human expert panels for architectural assessment. The resulting landscape reveals an empirical Pareto front--no reviewed system achieves both high flexibility and high determinism--but a convergence zone emerges between the generative and workflow-centric extremes. We argue that a schema-gated architecture, separating conversational from execution authority, is positioned to decouple this trade-off, and distill 3 operational principles--clarification-before-execution, constrained plan-act orchestration, and tool-to-workflow-level gating--to guide adoption.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 63 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
19 of 63 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agentscited by 89
- 2014An introduction to Docker for reproducible research, with examples from the R environmentcited by 25
- 2022A Computational Inflection for Scientific Discoverycited by 22
- 2023Unnatural language processing: How do language models handle machine-generated prompts?cited by 8
- 2025The (R)evolution of Scientific Workflows in the Agentic AI Era: Towards Autonomous Sciencecited by 7
- 2024WorkflowHub: a registry for computational workflowscited by 6
- 2024Do Large Language Models Speak Scientific Workflows?cited by 6
6 more
- 2025Foundation Models for Scientific Discovery: From Paradigm Enhancement to Paradigm Transitioncited by 6
- 2018Design of a nickel-base superalloy using a neural networkcited by 3
- 2025From Prompt to Pipeline: Large Language Models for Scientific Workflow Development in Bioinformaticscited by 3
- 2025Unveiling Large Language Model Supply Chain: Structure, Domain, and Vulnerabilitiescited by 2
- 2025Ensuring Reproducibility in Generative AI Systems for General Use Cases: A Framework for Regression Testing and Open Datasetscited by 2
- 2025Report of the 2025 Workshop on Next-Generation Ecosystems for Scientific Computing: Harnessing Community, Software, and AI for Cross-Disciplinary Team Sciencecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Research Question to Scientific Workflow: Leveraging Agentic AI for Science Automation
- 2026Characterizing Large Language Model Agentic Workflows: A Study on N8n Ecosystem
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2025State and Memory is All You Need for Robust and Reliable AI Agents
- 2026GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration
- 2026A Cloud-based Multi-Agentic Workflow for Science
- 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents
- 2025A Survey on Agent Workflow -- Status and Future