MAVEN: Improving Generalization in Agentic Tool Calling
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Generalization across agentic tool-calling environments remains a central challenge for reliable agentic reasoning systems. Although large language models achieve strong results on individual benchmarks, their ability to compose reasoning strategies, preserve intermediate states, and coordinate tools across domains remains underexplored. We present MAVEN (Modular Agentic Verification and Execution Network), a lightweight symbolic reasoning scaffold for structured decomposition, adaptive tool orchestration, and intermediate verification. We evaluate MAVEN across established tool-calling benchmarks, including BFCL v3, TauBench, Tau2Bench, AceBench, and introduce MAVEN-Bench, a stress-test benchmark for multi-step mathematical and physical reasoning with explicit verification and adversarial task composition. MAVEN-Bench exposes a substantial gap between partial reasoning quality and end-to-end task success; in direct MAVEN-Bench runs, MAVEN improves its GPT-OSS-120b base model from 48% to 71% accuracy without additional training. It also remains competitive with frontier proprietary baselines while using an open-weight backbone with an estimated cost ratio of roughly 1/10, suggesting that lightweight verification-centered scaffolds can strengthen compositional reasoning and motivate more process-aware evaluation of agents in the wild.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 15 of its 17 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
15 of 17 references.
Closest ancestors · 4
Same direction, newest first
- 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2025Kimi K2: Open Agentic Intelligence28 Jul
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
Other references · 11
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
- 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
- 2025A Survey on Large Language Model Benchmarkscited by 32
- 2025On Robustness and Reliability of Benchmark-Based Evaluation of LLMscited by 23
- 2025On the Robustness of Agentic Function Callingcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025On Generalization in Agentic Tool Calling: CoreThink Agentic Reasoner and MAVEN Dataset
- 2026MAVEN: Multi-Agent Verification-Elaboration Network with In-Step Epistemic Auditing
- 2025AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
- 2025AlphaApollo: A System for Deep Agentic Reasoning
- 2025ARM: Discovering Agentic Reasoning Modules for Generalizable Multi-Agent Systems
- 2026AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
- 2025Agentic Reasoning and Tool Integration for LLMs via Reinforcement Learning
- 2026Looped Language Models Improve Compositional Tool Calling