Utility-Aware Data Pricing: Token-Level Quality and Empirical Training Gain for LLMs
Not on the map. Why?
Abstract (arXiv)
Traditional ``row-count × quality coefficient'' approaches fail to capture the nonlinear utility of data for Large Language Model (LLM) capabilities. We present a utility-aware data valuation framework that moves from static accounting toward utility-based pricing. The framework combines token-level information density and data quality, empirical training contribution estimated by influence functions, proxy models, and Data Shapley values, and cryptographic mechanisms based on hash commitments, Merkle trees, and tamper-evident training ledgers. Preliminary evaluation includes a smoke-scale multi-domain study and a synthetic duplication test. Results show that proxy-based empirical gain achieves strong ranking agreement with proxy-defined realized utility and substantially outperforms row-count and token-count baselines in the tested setting, while the prototype provides a controlled sanity check of the valuation pipeline and its sensitivity to duplication-based manipulation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
10 of 16 references.
References · 10
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 339
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 281
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025For-Value: Efficient Forward-Only Data Valuation for finetuning LLMs and VLMs
- 2026Cost-Governed RAG: Unified Per-Tenant Cost Attribution Across Retrieval and Generation in Multi-Tenant LLM Systems
- 2025Market-Driven Subset Selection for Budgeted Training
- 2026Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Training
- 2025Losing is for Cherishing: Data Valuation Based on Machine Unlearning and Shapley Value
- 2026Learning the Cost of Reliable Inference
- 2025Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization
- 2025Do Data Valuations Make Good Data Prices?