mlsanityData to 7 Oct 2026

The Open Source Economic Index of AI Adoption and Capability

arXiv 2606.26118 ↗First posted 23 May 2026cs.CY cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We work towards measuring both AI adoption and the capability of AI to perform discrete labor tasks across various occupations. To measure adoption, we develop an open-source economic index that uses publicly available user-LLM chat data and O*NET tasks to replicate studies produced by frontier AI labs, finding that occupations in the finance, computer science, and arts sectors are those with the highest adoption rates. To measure capabilities, we build a system that generates benchmark scenarios grounded in O*NET occupations, tasks, and model-context-protocol (MCP) servers. We test Kimi-k2.5 with an OpenAI agents SDK harness on scenarios across 9 occupations that appear frequently in our index, finding that AI correctly executes high-level workflows but often errs in the granular details (such as specific tool calls used).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 82 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

15 of 82 references.

References · 15

  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  2. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  5. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  6. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 264
  7. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
  8. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
  9. 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Modelscited by 129
  10. 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
  11. 2025TRAIL: Trace Reasoning and Agentic Issue Localizationcited by 98
  12. 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 88
3 more
  1. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 61
  2. 2025Remote Labor Index: Measuring AI Automation of Remote Workcited by 18
  3. 2024Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis of Emerging Labor Market Disruption
  2. 2026Who Delegates to AI? Evidence from Agent Configurations in Github
  3. 2026Bounded by Risk, Not Capability: Quantifying AI Occupational Substitution Rates via a Tech-Risk Dual-Factor Model ↗
  4. 2026Augmentation with Dilution: A Large-Scale Empirical Study of Human Contributor Ecosystems After AI Coding Agent Adoption
  5. 2026Jobs' AI Exposure Should Be Measured from Evidence, Not Model Priors
  6. 2025Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystem
  7. 2025How AI Forecasts AI Jobs: Benchmarking LLM Predictions of Labor Market Changes
  8. 2025The Adoption and Usage of AI Agents: Early Evidence from Perplexity