Exploring Robust Multi-Agent Workflows for Environmental Data Management
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Embedding LLM-driven agents into environmental FAIR data management is compelling - they can externalize operational knowledge and scale curation across heterogeneous data and evolving conventions. However, replacing deterministic components with probabilistic workflows changes the failure mode: LLM pipelines may generate plausible but incorrect outputs that pass superficial checks and propagate into irreversible actions such as DOI minting and public release. We introduce EnviSmart, a production data management system deployed on campus-wide storage infrastructure for environmental research. EnviSmart treats reliability as an architectural property through two mechanisms: a three-track knowledge architecture that externalizes behaviors (governance constraints), domain knowledge (retrievable context), and skills (tool-using procedures) as persistent, interlocking artifacts; and a role-separated multi-agent design where deterministic validators and audited handoffs restore fail-stop semantics at trust boundaries before irreversible steps. We compare two production deployments. The University's GIS Center Ecological Archive (849 curated datasets) serves as a single-agent baseline. SF2Bench, a compound flooding benchmark comprising 2,452 monitoring stations and 8,557 published files spanning 39 years, validates the multi-agent workflow. The multi-agent approach improved both efficiency - completed by a single operator in two days with repeated artifact reuse across deployments - and reliability: audited handoffs detected and blocked a coordinate transformation error affecting all 2,452 stations before publication. A representative incident (ISS-004) demonstrated boundary-based containment with 10-minute detection latency, zero user exposure, and 80-minute resolution. This paper has been accepted at PEARC 2026.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 32 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
14 of 32 references.
References · 14
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024AI Agents That Mattercited by 219
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 149
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
- 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 119
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 50
- 2025Measuring Agents in Productioncited by 37
- 2025Failure Modes in LLM Systems: A System-Level Taxonomy for Reliable AI Applicationscited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CLIMATEAGENT: Multi-Agent Orchestration for Complex Climate Data Science Workflows
- 2026DataJoint 2.0: A Computational Substrate for Agentic Scientific Workflows
- 2026Confining Nondeterminism: AI-Driven Research Systems as DBMSs for Reliable, Non-Wasteful, Transparent, and Collaborative Research [Vision]
- 2025PublicAgent: Multi-Agent Design Principles From an LLM-Based Open Data Analysis Framework
- 2025Data Agent: A Holistic Architecture for Orchestrating Data+AI Ecosystems
- 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses
- 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systems