mlsanityData to 14 Oct 2026

Agents for Experiments, Experiments for Agents: A Design Grammar for AI-Enabled Experimental Science

arXiv 2605.17746 ↗First posted 18 May 2026cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

AI systems are becoming active participants in organizational and knowledge work. They increasingly interact with humans, coordinate workflows, and operate in multi-agent arrangements. Understanding their effects therefore requires more than measuring output accuracy; it requires evidence about mechanisms, delegation, feedback, and control. Experiments remain central to this task, but they also face a recursive challenge: we need experiments for agents to study these arrangements, and we may need agents for experiments to help search the expanding space of possible designs. Yet experimental conditions for human-AI and agentic workflows are still largely specified in prose, making them difficult to compare, reuse, or audit. We frame this as a problem of workflow representation, traceability, and governance in AI-enabled knowledge production. We introduce SEED (Structural Encoding for Experimental Discovery), a framework that represents experimental conditions as typed actor-flow graphs. SEED supports three design functions: describing conditions as interaction structures, evaluating structural novelty relative to encoded prior designs, and generating candidate designs under feasibility and governance constraints. We report a lightweight empirical feasibility test that compares graph-blind and SEEDguided generation in a medical-triage design task. In this diagnostic contrast, SEED-guided candidate designs show clearer actor-flow changes, assumptions, and governance checks, supporting the feasibility of the grammar as a design aid. The commentary closes by identifying governance tensions around novelty, replication, validity, diversity of inquiry, and accountability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 41 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

11 of 41 references.

References · 11

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  4. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  5. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  6. 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
  7. 2024Visibility into AI Agentscited by 79
  8. 2019DDTCDR: Deep Dual Transfer Cross Domain Recommendationcited by 72
  9. 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 39
  10. 2021GREED: A Neural Framework for Learning Graph Distance Functionscited by 32
  11. 2024Graph Edit Distance with General Costs Using Neural Set Divergencecited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026WhatWorkedBench: Benchmarking Experimental Understanding in AI Agents
  2. 2026The Agentic Scientist: Orchestrating Coding Agents for Automated Scientific (Co-)Discovery
  3. 2026Research-Native by Construction: Minimal Nodes, Re-verifiable Workflows, and Compounding Memory for Long-Horizon Scientific Agents
  4. 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems
  5. 2025Bohrium + SciMaster: Building the Infrastructure and Ecosystem for Agentic Science at Scale
  6. 2026Atria Dawn: The Dawn of Agentic Superintelligence
  7. 2025Evaluating Novelty in AI-Generated Research Plans Using Multi-Workflow LLM Pipelines
  8. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap