mlsanityData to 14 Oct 2026

Computational Arbitrage in AI Model Markets

arXiv 2603.22404 ↗First posted 23 Mar 2026cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Consider a market of competing model providers selling query access to models with varying costs and capabilities. Customers submit problem instances and are willing to pay up to a budget for a verifiable solution. An arbitrageur efficiently allocates inference budget across providers to undercut the market, thus creating a competitive offering with no model-development risk. In this work, we initiate the study of arbitrage in AI model markets, empirically demonstrating the viability of arbitrage and illustrating its economic consequences. We conduct an in-depth case study of SWE-bench GitHub issue resolution using two representative models, GPT-5 mini and DeepSeek v3.2. In this verifiable domain, simple arbitrage strategies generate net profit margins of up to 40%. Robust arbitrage strategies that generalize across different domains remain profitable. Distillation further creates strong arbitrage opportunities, potentially at the expense of the teacher model's revenue. Multiple competing arbitrageurs drive down consumer prices, reducing the marginal revenue of model providers. At the same time, arbitrage reduces market segmentation and facilitates market entry for smaller model providers by enabling earlier revenue capture. Our results suggest that arbitrage can be a powerful force in AI model markets with implications for model development, distillation, and deployment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

42 of 57 references.

References · 42

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  9. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  10. 2025OpenAI GPT-5 System Cardcited by 989
  11. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  12. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
30 more
  1. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  2. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  3. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
  4. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 290
  5. 2024AI Agents That Mattercited by 219
  6. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
  7. 2023Large Language Model Routing with Benchmark Datasetscited by 172
  8. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
  9. 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 145
  10. 2023AutoMix: Automatically Mixing Language Modelscited by 125
  11. 2023Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modelingcited by 95
  12. 2024Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Modelscited by 89
  13. 2023Test-Time Training on Nearest Neighbors for Large Language Modelscited by 88
  14. 2023EcoAssistant: Using LLM Assistant More Affordably and Accuratelycited by 49
  15. 2024Model Equality Testing: Which Model Is This API Serving?cited by 47
  16. 2022Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systemscited by 44
  17. 2024The Larger the Better? Improved LLM Code-Generation via Budget Reallocationcited by 43
  18. 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 38
  19. 2025Weight Ensembling Improves Reasoning in Language Modelscited by 38
  20. 2025Cost-of-Pass: An Economic Framework for Evaluating Language Modelscited by 35
  21. 2024Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selectioncited by 33
  22. 2025Rethinking Fine-Tuning when Scaling Test-Time Compute: Limiting Confidence Improves Mathematical Reasoningcited by 29
  23. 2025Is Your LLM Overcharging You? Tokenization, Transparency, and Incentivescited by 13
  24. 2024Incentivizing Quality Text Generation via Statistical Contractscited by 10
  25. 2025Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Servicescited by 10
  26. 2025Predictive Auditing of Hidden Tokens in LLM APIs via Reasoning Length Estimationcited by 7
  27. 2025Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scalingcited by 7
  28. 2025Pay for The Second-Best Service: A Game-Theoretic Approach Against Dishonest LLM Providerscited by 6
  29. 2025Auditing Pay-Per-Token in Large Language Modelscited by 4
  30. 2025The Economics of AI Foundation Models: Openness, Competition, and Governancecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.