mlsanityData to 7 Oct 2026

DataFlow-Harness: A Grounded Code-Agent Platform for Constructing Editable LLM Data Pipelines

arXiv 2607.16617 ↗First posted 18 Jul 2026cs.SE cs.AIcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Large language models (LLMs) are increasingly used to automate data-processing workflows, yet coding agents typically produce scripts that are not automatically materialized as persistent, editable platform artifacts. We call this disconnect the textitNL2Pipeline gap. To bridge it, we introduce textscDataFlow-Harness, a platform that guides an LLM agent to construct platform-native directed acyclic graphs (DAGs) through typed, incremental mutations rather than free-form scripts. The platform combines textscDataFlow-Skills for procedural guidance, a Model Context Protocol (MCP) layer that exposes the live operator registry and current pipeline state, and textscDataFlow-WebUI, which synchronizes conversational authoring with a visual DAG editor. On a 12-task data-engineering benchmark, textscDataFlow-Harness achieves a 93.3% observed end-to-end pass rate. Relative to Vanilla Claude Code, it reduces measured monetary cost by 72.5% and generation latency by 49.9%; its observed pass rate is within 0.9 percentage points of the Context-Aware Claude Code baseline while its cost is 42.8% lower. Per-task analysis indicates that Skills are most useful when construction depends on implicit procedural knowledge. These results show that live platform grounding can produce persistent, editable workflow artifacts with an observed reliability close to script-generation baselines and with lower measured construction cost and latency.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 27 references that are in the map. First posted on arXiv 18 Jul 2026.

Builds on

22 of 27 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024AutoFlow: Automated Workflow Generation for Large Language Model Agents1 Jul
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 19

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  6. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  7. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  8. 2023Teaching Large Language Models to Self-Debugcited by 963
  9. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  10. 2025LIMO: Less is More for Reasoningcited by 488
  11. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 381
  12. 2023Tool Learning with Foundation Modelscited by 302
7 more
  1. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
  2. 2023Data-centric Artificial Intelligence: A Surveycited by 202
  3. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 126
  4. 2023TaskWeaver: A Code-First Agent Frameworkcited by 85
  5. 2023Data-Juicer: A One-Stop Data Processing System for Large Language Modelscited by 52
  6. 2025DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AIcited by 22
  7. 2026From Research Question to Scientific Workflow: Leveraging Agentic AI for Science Automationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Complete Cyclic Subtask Graphs for Tool-Using LLM Agents: Flexibility, Cost, and Bottlenecks in Long-Horizon Workflows
  2. 2025Agint: Agentic Graph Compilation for Software Engineering Agents
  3. 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation
  4. 2026kRAIG: A Natural Language-Driven Agent for Automated DataOps Pipeline Generation
  5. 2026CURATE: Leveraging LLM Agents to Compose, Catalog, and Deploy Reproducible Workflows
  6. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
  7. 2026GraphFlow: A Graph-Based Workflow Management for Efficient LLM-Agent Serving
  8. 2026GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration