mlsanityData to 7 Oct 2026

EnterpriseLab: A Full-Stack Platform for developing and deploying agents in Enterprises

arXiv 2603.21630 ↗First posted 23 Mar 2026cs.AIcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Deploying AI agents in enterprise environments requires balancing capability with data sovereignty and cost constraints. While small language models offer privacy-preserving alternatives to frontier models, their specialization is hindered by fragmented development pipelines that separate tool integration, data generation, and training. We introduce EnterpriseLab, a full-stack platform that unifies these stages into a closed-loop framework. EnterpriseLab provides (1) a modular environment exposing enterprise applications via Model Context Protocol, enabling seamless integration of proprietary and open-source tools; (2) automated trajectory synthesis that programmatically generates training data from environment schemas; and (3) integrated training pipelines with continuous evaluation. We validate the platform through EnterpriseArena, an instantiation with 15 applications and 140+ tools across IT, HR, sales, and engineering domains. Our results demonstrate that 8B-parameter models trained within EnterpriseLab match GPT-4o's performance on complex enterprise workflows while reducing inference costs by 8-10x, and remain robust across diverse enterprise benchmarks, including EnterpriseBench (+10%) and CRMArena (+10%). EnterpriseLab provides enterprises a practical path to deploying capable, privacy-preserving agents without compromising operational capability.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 44 of its 52 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

44 of 52 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environments31 Oct
  2. 2025Scaling Synthetic Task Generation for Agents via Exploration29 Sep
  3. 2025LLM Agents Are the Antidote to Walled Gardens30 Jun
  4. 2025Small Language Models are the Future of Agentic AI2 Jun
  5. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
  6. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks18 Dec
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  8. 2024BAGEL: Bootstrapping Agents by Guiding Exploration with Language12 Mar
  9. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agents2 Feb
  10. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agent14 Jan
  11. 2023AgentBench: Evaluating LLMs as Agents7 Aug

Other references · 33

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  9. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  10. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  11. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  12. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
21 more
  1. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  2. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
  3. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  4. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  5. 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
  6. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
  7. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 155
  8. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
  9. 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learningcited by 107
  10. 2024NNetNav: Unsupervised Learning of Browser Agents Through Environment Interaction in the Wildcited by 55
  11. 2024Commit0: Library Generation from Scratchcited by 50
  12. 2024From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactionscited by 46
  13. 2025CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactionscited by 46
  14. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  15. 2025MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Modelscited by 34
  16. 2025Go-Browse: Training Web Agents with Structured Explorationcited by 32
  17. 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Modelscited by 31
  18. 2025Unveiling Challenges for LLMs in Enterprise Data Engineeringcited by 8
  19. 2024HumanEval on Latest GPT Models -- 2024cited by 7
  20. 2024Improving Small-Scale Large Language Models Function Calling for Reasoning Taskscited by 7
  21. 2025Graph2Eval: Automatic Multimodal Task Generation for Agents via Knowledge Graphscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems
  2. 2025Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI
  3. 2026EnterpriseOps-Gym: Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settings
  4. 2026EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise
  5. 2026ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software
  6. 2025Towards a Standard, Enterprise-Relevant Agentic AI Benchmark: Lessons from 5.5 billion tokens' worth of agentic AI evaluations
  7. 2026EnterpriseBench Corecraft: Training Generalizable Agents on High-Fidelity RL Environments
  8. 2025AI Agentic workflows and Enterprise APIs: Adapting API architectures for the age of AI agents