mlsanityData to 7 Oct 2026

The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More

arXiv 2603.23971 ↗First posted 25 Mar 2026cs.CL cs.AI cs.GTcited by 3

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Developers and consumers increasingly choose reasoning models (RMs) based on their listed API prices. However, how accurately do these prices reflect actual inference costs? We conduct the first systematic study of this question, evaluating 8 frontier RMs across 12 diverse tasks covering competition math, science QA, code generation, and multi-domain agents. We uncover the pricing reversal phenomenon: in 32% of model-pair comparisons, the model with a lower listed price actually incurs a higher total cost, with reversal magnitude reaching up to 28x. For example, Gemini 3 Flash's listed price is 80% cheaper than GPT-5.4's, yet its actual cost across all tasks is 38% higher. We build a formal cost attribution framework based on Shapley value, and leverage it to trace the dominating contributors to vast heterogeneity in thinking token consumption and number of interaction turns: on the same query, one model may use 900% more thinking tokens than another, or 10x more turns of environment interactions. We further show that per-query cost prediction is fundamentally difficult: repeated runs of the same query yield thinking token variation up to 9.7x, establishing an irreducible noise floor for any predictor. Thus, we propose cost distribution prediction as an open challenge. Our findings demonstrate that listed API pricing is an unreliable proxy for actual cost, calling for cost-aware model selection and transparent per-request cost monitoring.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 5 of its 56 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

5 of 56 references.

References · 5

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  2. 2025Humanity's Last Examcited by 467
  3. 2024Towards Optimizing the Costs of LLM Usagecited by 33
  4. 2024Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selectioncited by 32
  5. 2024Boulder2Vec: Modeling Climber Performances in Professional Bouldering Competitionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning the Cost of Reliable Inference
  2. 2026The Price of Intelligence: A Quality-Adjusted Price Index for AI Services
  3. 2026The Shadow Price of Reasoning: Economic Perspective on Optimal Budget Allocation for LLMs
  4. 2025Cost-of-Pass: An Economic Framework for Evaluating Language Models
  5. 2026When Independent Sampling Outperforms Agentic Reasoning
  6. 2026Keep, Customize, or Exit: Default Design and Token Pricing in LLM Reasoning Services
  7. 2026Test-Time Compute Games
  8. 2026The Price of Thinking: Reasoning Effort as a Model-Specific API Contract