mlsanityData to 7 Oct 2026

FABRIC: Framework for Agent-Based Realistic Intelligence Creation

arXiv 2510.17995 ↗First posted 20 Oct 2025cs.AIcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction records that couple user intents with tool specifications, argument-grounded calls, and verifiable execution traces. However, collecting such data from human annotators is costly, time-consuming, and difficult to scale. We present a unified framework for synthesizing agentic data using only LLMs, without any human-in-the-loop supervision. This framework decomposes generation into modular pipelines that produce complete interaction records spanning task specifications, tool definitions, policy pseudocode, natural language exchanges, and execution traces. Records conform to strict syntactic and semantic constraints, ensuring machine-parseability and faithful alignment across inputs, outputs, and tool calls. Beyond single tasks, there is support for both multi-task and multi-turn agent interactions, enabling the construction of datasets that reflect the full spectrum of tool-use competencies. To ensure quality and consistency, the framework integrates constrained generation formats, JSON-schema validation, and judge-based filtering. This paper formalizes the schema for agentic records, details the prompt design principles that guide generation, and introduces scalable pipelines for high-quality synthetic data. By providing a reproducible, LLM-only alternative to manual collection, hence advancing the development of agentic LLMs capable of robust tool use.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 15 of its 41 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

15 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Agentic Large Language Models, a survey29 Mar
  2. 2022Language Models as Agent Models3 Dec

Other references · 13

  1. 2023Mistral 7Bcited by 3,065
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 514
  4. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  5. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
  6. 2024On the Out-Of-Distribution Generalization of Multimodal Large Language Modelscited by 30
  7. 2023Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Datacited by 13
  8. 2024Mixture cure semiparametric additive hazard models under partly interval censoring -- a penalized likelihood approachcited by 4
  9. 2023ALE: A Simulation-Based Active Learning Evaluation Framework for the Parameter-Driven Comparison of Query Strategies for NLPcited by 2
  10. 2025The observational partial order of causal structures with latent variablescited by 2
  11. 2023Mavericks at ArAIEval Shared Task: Towards a Safer Digital Space -- Transformer Ensemble Models Tackling Deception and Persuasioncited by 1
  12. 2024Navigating Knowledge Management Implementation Success in Government Organizations: A type-2 fuzzy approachcited by 1
1 more
  1. 2025SyGra: A Unified Graph-Based Framework for Scalable Generation, Quality Tagging, and Management of Synthetic Datacited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Close the Loop: Synthesizing Infinite Tool-Use Data via Multi-Agent Role-Playing
  2. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
  3. 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis
  4. 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
  5. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agents
  6. 2026Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
  7. 2025TaskCraft: Automated Generation of Agentic Tasks
  8. 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents