Confining Nondeterminism: AI-Driven Research Systems as DBMSs for Reliable, Non-Wasteful, Transparent, and Collaborative Research [Vision]
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
LLM agents that conduct research (proposing ideas, writing and running code, analyzing results) can already carry a study from research question to figures, yet cannot be fully trusted. The same question asked twice in a row returns different answers; the agent announces a number that no execution produced, and tool use does not prevent this, because nothing binds what the agent reports to what its tools returned; a small upstream change leaves downstream results silently stale, with no way to list which ones; and the agent re-runs preprocessing and rewrites code it has already produced. We argue these failures share one root: every step of today's agent loop is a stochastic LLM call whose internal state nobody, including the agent, can check. Rather than trying to see inside the LLM, we take a lesson from databases, which earn trust without being watched, because deterministic operators over well-defined state make their guarantees hold by construction. We propose organizing a research project the same way. The project lives in a deterministic, versioned dataflow engine (in effect, a query plan over materialized views), and the LLM, together with the user, is a stochastic compiler that may only edit that plan. The executor never calls the LLM; LLM output enters only as versioned code and data that the executor then runs, and any asserted result enters the record only with an execution behind it. Five design rules at this boundary turn familiar database machinery, from versioning and provenance to incremental maintenance and cost-based scheduling, into guarantees that make research reliable, non-wasteful, transparent, and collaborative. This report presents the diagnosis, the requirements, and the design; the guarantee walkthrough, a prototype, and the research agenda appear in the full version, in preparation. The LLM, we argue, should be the query compiler, never the executor.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 21 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
6 of 21 references.
Closest ancestors · 2
Same direction, newest first
- 2025Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analytics2 Sep
- 2025Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First31 Aug
Other references · 4
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Stateless Language Agents: Scaling Long-Horizon Automated Research
- 2026Beyond Execution: Auditing Experimental Fidelity in LLM-Driven Scientific Research
- 2026Research-Native by Construction: Minimal Nodes, Re-verifiable Workflows, and Compounding Memory for Long-Horizon Scientific Agents
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
- 2026AI scientists produce results without reasoning scientifically
- 2026The LLMbda Calculus: AI Agents, Conversations, and Information Flow
- 2026FirstResearch: Auditable Question Formation for LLM Scientific Discovery Agents
- 2026When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor