mlsanityData to 14 Oct 2026

GxP-Agent: Process-DAG Topology for Reliable Clinical Trial Programming with LLM Agents

arXiv 2608.16890 ↗First posted 13 May 2026cs.AIcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Clinical trial programming -- transforming study protocols into analysis-ready datasets under CDISC standards -- is a bottleneck in regulatory submissions, yet LLM-based code generation fails catastrophically on this task: across 11 single-shot attempts with five frontier models, none produces a valid subject-level analysis dataset. We introduce GxP-Agent, a multi-agent system that encodes regulatory process ordering as a directed acyclic graph (DAG), decomposing monolithic dataset generation into 15 domain-specific nodes executed by worker agents with pharmaverse skill context, validation gates, and conditional retry. On CDISC-Bench, a new execution-based benchmark built from the FDA pilot submission CDISCPilot01 (254 subjects, 49 ground-truth ADSL variables), GxP-Agent with Claude Sonnet 4.6 achieves 100% structural match (49/49 variables, 254 correct records) across three independent runs, compared to 59.2% for the best retrieval-augmented baseline and 0% for all single-agent and flat multi-agent approaches. The DAG topology also enables weaker models: GPT-4.1 achieves 59.2% mean structural match under the same DAG, where it scores 0% under every other architecture. The approach generalizes to ADAE (adverse events; 9-node branching DAG, 55 variables, 1,191 records), achieving 100% structural match on the first attempt. These results demonstrate that encoding domain process knowledge as graph topology -- rather than relying on LLM reasoning alone -- is a key enabler for reliable, GxP-compliant clinical trial programming.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 31 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

20 of 31 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning23 Apr

Other references · 19

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2021Program Synthesis with Large Language Modelscited by 3,637
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  9. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  12. 2023Teaching Large Language Models to Self-Debugcited by 988
7 more
  1. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  2. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  3. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 125
  4. 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 91
  5. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  6. 2024MASAI: Modular Architecture for Software-engineering AI Agentscited by 49
  7. 2024Using Large Language Models to Generate Clinical Trial Tables and Figurescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Process-Supervised Multi-Agent Reinforcement Learning for Reliable Clinical Reasoning
  2. 2026Can LLM Agents Generate Real-World Evidence? Evaluating Observational Studies in Medical Databases
  3. 2026FastOMOP: A Foundational Architecture for Reliable Agentic Real-World Evidence Generation on OMOP CDM data
  4. 2026The Last Mile of Coding Agents for Long-Document Tasks: An Empirical Study on Clinical Trial Protocol Digitization
  5. 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Space
  6. 2025LLM Agent Swarm for Hypothesis-Driven Drug Discovery
  7. 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification
  8. 2026Automatic Construction of Clinical Scoring Systems with LLM Agents