mlsanityData to 14 Oct 2026

Beyond Benchmarks: The Economics of AI Inference

arXiv 2510.26136 ↗First posted 30 Oct 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The inference cost of Large Language Models (LLMs) has become a critical factor in determining their commercial viability and widespread adoption. This paper introduces a quantitative ``economics of inference'' framework, treating the LLM inference process as a compute-driven intelligent production activity. We analyze its marginal cost, economies of scale, and quality of output under various performance configurations. Based on empirical data from WiNEval-3.0, we construct the first ``LLM Inference Production Frontier,'' revealing three principles: diminishing marginal cost, diminishing returns to scale, and an optimal cost-effectiveness zone. This paper not only provides an economic basis for model deployment decisions but also lays an empirical foundation for the future market-based pricing and optimization of AI inference resources.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 8 references that are in the map. First posted on arXiv 30 Oct 2025.

Builds on

7 of 8 references.

References · 7

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  7. 2021Carbon Emissions and Large Neural Network Trainingcited by 567

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.