mlsanityData to 14 Oct 2026

From Relevance to Validity: Zero-Shot Tool Selection via Functional and Contextual Validation

arXiv 2610.20388 ↗First posted 14 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language model (LLM) agents increasingly face tasks from unseen domains and execution contexts, making zero-shot tool selection essential for identifying tools that can satisfy task requirements. Existing dominant methods mainly rely on relevance ranking, but semantic matching alone cannot ensure that a tool is functionally compatible or remains applicable in a new context. We preliminarily identify a transfer-validity gap, where semantically relevant tools may still fail to satisfy functional or contextual requirements after transfer. To address this gap, we propose methodname, a progressive validation framework that complements semantic relevance with endpoint-grounded functional compatibility and task-conditioned contextual evidence. Across cross-domain and cross-dataset transfer, methodname consistently improves capability ranking, with larger gains under functional or contextual ambiguity. Ablation results further confirm the complementary contributions of functional and contextual validation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

17 of 29 references.

References · 17

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  5. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  6. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
  7. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
  8. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 144
  9. 2024ToolGen: Unified Tool Retrieval and Calling via Generationcited by 74
  10. 2024Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrievalcited by 52
  11. 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 47
  12. 2021Zero-Shot Recommender Systemscited by 46
5 more
  1. 2024ToolRerank: Adaptive and Hierarchy-Aware Reranking for Tool Retrievalcited by 41
  2. 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrieverscited by 7
  3. 2022Sufficient Invariant Learning for Distribution Shiftcited by 6
  4. 2024Non-stationary Domain Generalization: Theory and Algorithmcited by 4
  5. 2024One for Dozens: Adaptive REcommendation for All Domains with Counterfactual Augmentationcited by 1

Built on by

Not cited yet.