Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The rise of agentic systems that combine orchestration, tool use, and conversational capabilities, has been more visible by the recent advent of large language models (LLMs). While open-domain frameworks exist, applying them in private domains remains difficult due to heterogeneous tool formats, domain-specific jargon, restricted accessibility of APIs, and complex governance. Conventional solutions, such as fine-tuning on synthetic dialogue data, are burdensome and brittle under domain shifts, and risk degrading general performance. In this light, we introduce a framework for constructing private-domain tool-calling multi-agent systems that does not necessitate data generation and model tuning, by modeling user and system behaviors via tool-use documentation. With a simplified composition that assumes an orchestrator, a tool-calling agent, and a general chat agent, we show that the proposed approach enables scalable adaptation to private tools, which had been previously achieved by accompanying continual retraining. Our framework supports practical use cases, including lightweight deployment of in-house multi-agent systems, providing a sustainable method for aligning agent behavior with domain expertise in private, enterprise-level conversational ecosystems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 24 of its 50 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
24 of 50 references.
Closest ancestors · 2
Same direction, newest first
- 2025A Comprehensive Review of AI Agents: Transforming Possibilities in Technology and Beyond16 Aug
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
Other references · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
- 2018Neural Approaches to Conversational AIcited by 164
10 more
- 2020Neural Unsupervised Domain Adaptation in NLP---A Surveycited by 142
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
- 2024Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmarkcited by 62
- 2025Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Surveycited by 47
- 2023Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomiescited by 34
- 2025ToolDial: Multi-turn Dialogue Generation Method for Tool-Augmented Language Modelscited by 34
- 2023A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecturecited by 28
- 2025Fine-Tuning Lowers Safety and Disrupts Evaluation Consistencycited by 25
- 2022Building Domain-Specific Machine Learning Workflows: A Conceptual Framework for the State-of-the-Practicecited by 8
- 2023DMOps: Data Management Operation and Recipescited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
- 2024DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems
- 2026State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs
- 2026ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation
- 2025T1: A Tool-Oriented Conversational Dataset for Multi-Turn Agentic Planning
- 2026TAMUSA-Chat: A Domain-Adapted Large Language Model Conversational System for Research and Responsible Deployment
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
- 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis