Computational Arbitrage in AI Model Markets
Not on the map. Why?
Abstract (arXiv)
Consider a market of competing model providers selling query access to models with varying costs and capabilities. Customers submit problem instances and are willing to pay up to a budget for a verifiable solution. An arbitrageur efficiently allocates inference budget across providers to undercut the market, thus creating a competitive offering with no model-development risk. In this work, we initiate the study of arbitrage in AI model markets, empirically demonstrating the viability of arbitrage and illustrating its economic consequences. We conduct an in-depth case study of SWE-bench GitHub issue resolution using two representative models, GPT-5 mini and DeepSeek v3.2. In this verifiable domain, simple arbitrage strategies generate net profit margins of up to 40%. Robust arbitrage strategies that generalize across different domains remain profitable. Distillation further creates strong arbitrage opportunities, potentially at the expense of the teacher model's revenue. Multiple competing arbitrageurs drive down consumer prices, reducing the marginal revenue of model providers. At the same time, arbitrage reduces market segmentation and facilitates market entry for smaller model providers by enabling earlier revenue capture. Our results suggest that arbitrage can be a powerful force in AI model markets with implications for model development, distillation, and deployment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
42 of 57 references.
References · 42
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
30 more
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
- 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 290
- 2024AI Agents That Mattercited by 219
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
- 2023Large Language Model Routing with Benchmark Datasetscited by 172
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 145
- 2023AutoMix: Automatically Mixing Language Modelscited by 125
- 2023Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modelingcited by 95
- 2024Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Modelscited by 89
- 2023Test-Time Training on Nearest Neighbors for Large Language Modelscited by 88
- 2023EcoAssistant: Using LLM Assistant More Affordably and Accuratelycited by 49
- 2024Model Equality Testing: Which Model Is This API Serving?cited by 47
- 2022Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systemscited by 44
- 2024The Larger the Better? Improved LLM Code-Generation via Budget Reallocationcited by 43
- 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 38
- 2025Weight Ensembling Improves Reasoning in Language Modelscited by 38
- 2025Cost-of-Pass: An Economic Framework for Evaluating Language Modelscited by 35
- 2024Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selectioncited by 33
- 2025Rethinking Fine-Tuning when Scaling Test-Time Compute: Limiting Confidence Improves Mathematical Reasoningcited by 29
- 2025Is Your LLM Overcharging You? Tokenization, Transparency, and Incentivescited by 13
- 2024Incentivizing Quality Text Generation via Statistical Contractscited by 10
- 2025Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Servicescited by 10
- 2025Predictive Auditing of Hidden Tokens in LLM APIs via Reasoning Length Estimationcited by 7
- 2025Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scalingcited by 7
- 2025Pay for The Second-Best Service: A Game-Theoretic Approach Against Dishonest LLM Providerscited by 6
- 2025Auditing Pay-Per-Token in Large Language Modelscited by 4
- 2025The Economics of AI Foundation Models: Openness, Competition, and Governancecited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Strategic Self-Consistencycited by 0
- 2026Strategic Self-Consistency24 Sep 2026