mlsanityData to 14 Oct 2026

LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces

arXiv 2609.21325 ↗First posted 18 Sep 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Agentic marketplaces are emerging where AI agents with varying capabilities autonomously complete specialized tasks for buyers. A major challenge of such marketplaces is that buyers cannot easily determine which agent will perform best on their tasks. Reported benchmark scores may be difficult to verify or compare across tasks, software, and budgets. We introduce LEGIT, a credentialing protocol connecting certification, reputation, and proposed marketplace allocation. Certification binds measured quality and cost per solved task to an agent configuration, task domain, evaluation budget, and evidence through a signed record. Reputation links records of past task outcomes to the same identity, subject to the reliability of the reported feedback. Buyers and agents can verify credential records and inspect optional visual profiles. Evaluations reveal cost differences between agent configurations with similar observed task success, and show that comparisons depend on the evaluation budget. These results support binding performance measurements to the tested configuration and resource limits. A complementary analysis quantifies the deposits and fees required for reputation manipulation under a stated Sybil attack model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 47 of its 67 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

47 of 67 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025AI Agents with Decentralized Identifiers and Verifiable Credentials1 Oct

Other references · 46

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  9. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  10. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  11. 2018Datasheets for Datasetscited by 1,386
  12. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
34 more
  1. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  2. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  4. 2018Model Cards for Model Reportingcited by 1,080
  5. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  6. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  7. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  8. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  9. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  10. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  11. 2024Automated Design of Agentic Systemscited by 407
  12. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
  13. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
  14. 2023Proving Test Set Contamination in Black Box Language Modelscited by 230
  15. 2024AI Agents That Mattercited by 219
  16. 2023An LLM Compiler for Parallel Function Callingcited by 179
  17. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 161
  18. 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 158
  19. 2025Measuring AI Ability to Complete Long Software Taskscited by 156
  20. 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 142
  21. 2023An Empirical Study of the Non-determinism of ChatGPT in Code Generationcited by 137
  22. 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 92
  23. 2025The Leaderboard Illusioncited by 66
  24. 2026Towards a Science of AI Agent Reliabilitycited by 65
  25. 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 48
  26. 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
  27. 2025Agent Exchange: Shaping the Future of AI Agent Economicscited by 15
  28. 2025CodeAgents: A Token-Efficient Framework for Codified Multi-Agent Reasoning in LLMscited by 9
  29. 2025syftr: Pareto-Optimal Generative AIcited by 5
  30. 2026SwarmWorld: Stigmergic technological evolution in societies of language-model agentscited by 4
  31. 2026Diagon: A Programmable Testbed for AI-Agent Cognitive Labor Marketscited by 2
  32. 2026Agent Bazaar: Enabling Economic Alignment in Multi-Agent Marketplacescited by 2
  33. 2025AgentSLA : Towards a Service Level Agreement for AI Agentscited by 1
  34. 2026Capability Advertisement as a Market for Lemons: A Trust Layer for Heterogeneous Agent Networkscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentReputation: A Decentralized Agentic AI Reputation Framework
  2. 2026TessPay: Verify-then-Pay Infrastructure for Trusted Agentic Commerce
  3. 2026Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI
  4. 2026AgentAudit: An Open, Extensible Framework for Full-Lifecycle Trust Evaluation of AI Agents
  5. 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
  6. 2026Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce
  7. 2025Inter-Agent Trust Models: A Comparative Study of Brief, Claim, Proof, Stake, Reputation and Constraint in Agentic Web Protocol Design-A2A, AP2, ERC-8004, and Beyond
  8. 2026A Decision-Centered Reference Architecture for Trustworthy Agentic Commerce