Beyond Benchmarks: The Economics of AI Inference
Not on the map. Why?
Abstract (arXiv)
The inference cost of Large Language Models (LLMs) has become a critical factor in determining their commercial viability and widespread adoption. This paper introduces a quantitative ``economics of inference'' framework, treating the LLM inference process as a compute-driven intelligent production activity. We analyze its marginal cost, economies of scale, and quality of output under various performance configurations. Based on empirical data from WiNEval-3.0, we construct the first ``LLM Inference Production Frontier,'' revealing three principles: diminishing marginal cost, diminishing returns to scale, and an optimal cost-effectiveness zone. This paper not only provides an economic basis for model deployment decisions but also lays an empirical foundation for the future market-based pricing and optimization of AI inference resources.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 8 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
7 of 8 references.
References · 7
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021Carbon Emissions and Large Neural Network Trainingcited by 567
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026The Headless Firm: How AI Reshapes Enterprise Boundariescited by 0
- 2026The Headless Firm: How AI Reshapes Enterprise Boundaries24 Feb 2026