mlsanityData to 14 Oct 2026

Trustworthy Self-Composable Big-Data-as-a-Service: An LLM-Orchestrated Multi-Agent Framework for Automated Data Engineering, AutoML, MLOps Deployment, and Drift-Aware Lifecycle Optimization

arXiv 2606.17915 ↗First posted 16 Jun 2026cs.MA cs.AI cs.DBcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Big-Data-as-a-Service (BDaaS) platforms require re liable automation across data ingestion, cleaning, feature engi neering, model development, deployment, and post-deployment monitoring. However, existing LLM-based data science agents and AutoML systems mainly focus on isolated workflow stages, leaving limited support for lifecycle-level orchestration, artifact governance, human oversight, and drift-aware adaptation. This paper proposes a trustworthy self-composable BDaaS frame work based on LLM-orchestrated multi-agent collaboration. The proposed architecture decomposes the BDaaS lifecycle into specialized agents for data ingestion, data cleaning, feature engineering, AutoML training, model evaluation, MLOps de ployment, monitoring, and drift detection. A central LLM or chestration layer coordinates agent execution, validates interme diate outputs, manages workflow context, and enables dynamic workflow composition. The framework also incorporates shared artifact governance, reproducibility support, human-in-the-loop checkpoints, and drift-aware feedback loops. A prototype-based evaluation is conducted using controlled tabular benchmark datasets with missing values, categorical variables, outliers, class imbalance, and simulated covariate drift. Compared with manual ML, AutoML-only, and single-agent LLM baselines, the pro posed multi-agent BDaaS pipeline achieves competitive predictive performance while improving lifecycle-level reliability, including workflow completion, artifact traceability, deployment readiness, reproducibility, and drift recovery. The results suggest that LLM-orchestrated multi-agent systems can extend conventional AutoML toward trustworthy, adaptive, and production-oriented BDaaS lifecycle automation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 20 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

17 of 20 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasets9 Mar
  2. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
  3. 2024Data Interpreter: An LLM Agent For Data Science28 Feb
  4. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning27 Feb
  5. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct

Other references · 12

  1. 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
  2. 2023Data-centric Artificial Intelligence: A Surveycited by 203
  3. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 128
  4. 2023Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineeringcited by 127
  5. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
  6. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 87
  7. 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
  8. 2024SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learningcited by 24
  9. 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 24
  10. 2024BudgetMLAgent: A Cost-Effective LLM Multi-Agent system for Automating Machine Learning Taskscited by 19
  11. 2024Automated data processing and feature engineering for deep learning and big data applications: a surveycited by 14
  12. 2023Data Cleaning and Machine Learning: A Systematic Literature Reviewcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Data Agent: A Holistic Architecture for Orchestrating Data+AI Ecosystems
  2. 2026Bridging LLM Agents and Data Spaces: An Architectural Mediation Approach using the Model Context Protocol
  3. 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
  4. 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI
  5. 2025A Declarative Language for Building And Orchestrating LLM-Powered Agent Workflows
  6. 2026Data Agents Under Attack: Vulnerabilities in LLM-Driven Analytical Systems
  7. 2026Orla: A Library for Serving LLM-Based Multi-Agent Systems
  8. 2025LLM and Agent-Driven Data Analysis: A Systematic Approach for Enterprise Applications and System-level Deployment