LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Agentic marketplaces are emerging where AI agents with varying capabilities autonomously complete specialized tasks for buyers. A major challenge of such marketplaces is that buyers cannot easily determine which agent will perform best on their tasks. Reported benchmark scores may be difficult to verify or compare across tasks, software, and budgets. We introduce LEGIT, a credentialing protocol connecting certification, reputation, and proposed marketplace allocation. Certification binds measured quality and cost per solved task to an agent configuration, task domain, evaluation budget, and evidence through a signed record. Reputation links records of past task outcomes to the same identity, subject to the reliability of the reported feedback. Buyers and agents can verify credential records and inspect optional visual profiles. Evaluations reveal cost differences between agent configurations with similar observed task success, and show that comparisons depend on the evaluation budget. These results support binding performance measurements to the tested configuration and resource limits. A complementary analysis quantifies the deposits and fees required for reputation manipulation under a stated Sybil attack model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 47 of its 67 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
47 of 67 references.
Closest ancestors · 1
Same direction, newest first
Other references · 46
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2018Datasheets for Datasetscited by 1,386
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
34 more
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2018Model Cards for Model Reportingcited by 1,080
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2024Automated Design of Agentic Systemscited by 407
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
- 2023Proving Test Set Contamination in Black Box Language Modelscited by 230
- 2024AI Agents That Mattercited by 219
- 2023An LLM Compiler for Parallel Function Callingcited by 179
- 2024The BrowserGym Ecosystem for Web Agent Researchcited by 161
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?cited by 158
- 2025Measuring AI Ability to Complete Long Software Taskscited by 156
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 142
- 2023An Empirical Study of the Non-determinism of ChatGPT in Code Generationcited by 137
- 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 92
- 2025The Leaderboard Illusioncited by 66
- 2026Towards a Science of AI Agent Reliabilitycited by 65
- 2025Reducing Cost of LLM Agents with Trajectory Reductioncited by 48
- 2025Efficient Agents: Building Effective Agents While Reducing Costcited by 32
- 2025Agent Exchange: Shaping the Future of AI Agent Economicscited by 15
- 2025CodeAgents: A Token-Efficient Framework for Codified Multi-Agent Reasoning in LLMscited by 9
- 2025syftr: Pareto-Optimal Generative AIcited by 5
- 2026SwarmWorld: Stigmergic technological evolution in societies of language-model agentscited by 4
- 2026Diagon: A Programmable Testbed for AI-Agent Cognitive Labor Marketscited by 2
- 2026Agent Bazaar: Enabling Economic Alignment in Multi-Agent Marketplacescited by 2
- 2025AgentSLA : Towards a Service Level Agreement for AI Agentscited by 1
- 2026Capability Advertisement as a Market for Lemons: A Trust Layer for Heterogeneous Agent Networkscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AgentReputation: A Decentralized Agentic AI Reputation Framework
- 2026TessPay: Verify-then-Pay Infrastructure for Trusted Agentic Commerce
- 2026Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI
- 2026AgentAudit: An Open, Extensible Framework for Full-Lifecycle Trust Evaluation of AI Agents
- 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
- 2026Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce
- 2025Inter-Agent Trust Models: A Comparative Study of Brief, Claim, Proof, Stake, Reputation and Constraint in Agentic Web Protocol Design-A2A, AP2, ERC-8004, and Beyond
- 2026A Decision-Centered Reference Architecture for Trustworthy Agentic Commerce