The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Developers and consumers increasingly choose reasoning models (RMs) based on their listed API prices. However, how accurately do these prices reflect actual inference costs? We conduct the first systematic study of this question, evaluating 8 frontier RMs across 12 diverse tasks covering competition math, science QA, code generation, and multi-domain agents. We uncover the pricing reversal phenomenon: in 32% of model-pair comparisons, the model with a lower listed price actually incurs a higher total cost, with reversal magnitude reaching up to 28x. For example, Gemini 3 Flash's listed price is 80% cheaper than GPT-5.4's, yet its actual cost across all tasks is 38% higher. We build a formal cost attribution framework based on Shapley value, and leverage it to trace the dominating contributors to vast heterogeneity in thinking token consumption and number of interaction turns: on the same query, one model may use 900% more thinking tokens than another, or 10x more turns of environment interactions. We further show that per-query cost prediction is fundamentally difficult: repeated runs of the same query yield thinking token variation up to 9.7x, establishing an irreducible noise floor for any predictor. Thus, we propose cost distribution prediction as an open challenge. Our findings demonstrate that listed API pricing is an unreliable proxy for actual cost, calling for cost-aware model selection and transparent per-request cost monitoring.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 5 of its 56 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
5 of 56 references.
References · 5
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2025Humanity's Last Examcited by 467
- 2024Towards Optimizing the Costs of LLM Usagecited by 33
- 2024Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selectioncited by 32
- 2024Boulder2Vec: Modeling Climber Performances in Professional Bouldering Competitionscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Taskscited by 28
- 2026Statistically-Lossless Quantization of Large Language Modelscited by 4
- 2026Can a Lightweight Multimodal Model Estimate LLM Reasoning Performance? A Study for Compute-Optimal Document Inferencecited by 0
- 2026Can a Lightweight Multimodal Model Estimate LLM Reasoning Performance? A Study for Compute-Optimal Document Inference19 Aug 2026
- 2026Statistically-Lossless Quantization of Large Language Models4 May 2026
- 2026How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks24 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning the Cost of Reliable Inference
- 2026The Price of Intelligence: A Quality-Adjusted Price Index for AI Services
- 2026The Shadow Price of Reasoning: Economic Perspective on Optimal Budget Allocation for LLMs
- 2025Cost-of-Pass: An Economic Framework for Evaluating Language Models
- 2026When Independent Sampling Outperforms Agentic Reasoning
- 2026Keep, Customize, or Exit: Default Design and Token Pricing in LLM Reasoning Services
- 2026Test-Time Compute Games
- 2026The Price of Thinking: Reasoning Effort as a Model-Specific API Contract