mlsanityData to 7 Oct 2026

Neural Dynamic Data Valuation via Stochastic State-Adjoint Trajectories

arXiv 2404.19557 ↗First posted 30 Apr 2024stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Classical data valuation defines a data point's value through the finite marginal contribution U(Ccupi)-U(C), but estimating this quantity over coalitions requires repeated training and does not describe the contribution made along a stochastic training path. We ask whether marginal contributions of data points can be estimated from one coupled trajectory while retaining a verifiable relation to coalition-based values. To this end, we introduce Neural Dynamic Data Valuation (NDDV), which models each data point as a controlled stochastic state and computes a first-order marginal-contribution score via the adjoint equation of the Stochastic Maximum Principle (SMP). This raw sensitivity is then calibrated by a mass-preserving redistribution that increases one data point's participation while redistributing the same total weight over the remaining data points. We prove that the resulting backward adjoint recursion is the exact reverse-mode adjoint of the frozen-aggregate Euler system, bound its discrepancy from the mean-field sensitivity, and express each finite coalition marginal as an integral of local sample-weight sensitivities. These results yield pair-specific error bounds and sufficient conditions for ordering agreement with Shapley, Banzhaf, and leave-one-out values. Experiments on existing benchmarks evaluate marginal-contribution fidelity, score-release cost, corrupted-sample detection, ablations, and failure regimes. NDDV is a one-run, trajectory-conditioned estimator, not an unconditional replacement for cooperative-game values.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

36 of 58 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  3. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  4. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  5. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  6. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
  7. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
  8. 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
  9. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
  10. 2023TRAK: Attributing Model Behavior at Scalecited by 273
  11. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  12. 2019A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networkscited by 213
24 more
  1. 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
  2. 2021Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learningcited by 162
  3. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
  4. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
  5. 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
  6. 2019Data Valuation using Reinforcement Learningcited by 115
  7. 2021Sampling Permutations for Shapley Value Estimationcited by 101
  8. 2017Maximum Principle Based Algorithms for Deep Learningcited by 77
  9. 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
  10. 2022Faith-Shap: The Faithful Shapley Interaction Indexcited by 68
  11. 2018A Mean-Field Optimal Control Formulation of Deep Learningcited by 67
  12. 2019OpenML-Python: an extensible Python API for OpenMLcited by 62
  13. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  14. 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
  15. 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
  16. 2021On the Complexity of SHAP-Score-Based Explanations: Tractability via Knowledge Compilation and Non-Approximability Resultscited by 32
  17. 2023Curriculum Learning for ab initio Deep Learned Refractive Opticscited by 32
  18. 2018An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networkscited by 25
  19. 2022Deletion and Insertion Tests in Regression Modelscited by 14
  20. 2023DU-Shapley: A Shapley Value Proxy for Efficient Dataset Valuationcited by 12
  21. 2017Control Interpretations for First-Order Optimization Methodscited by 8
  22. 2023Towards Algorithmic Fairness by means of Instance-level Data Re-weighting based on Shapley Valuescited by 7
  23. 2022Learning stochastic dynamics and predicting emergent behavior using transformerscited by 5
  24. 2023Fairness-Aware Data Valuation for Supervised Learningcited by 4

Built on by

Not cited yet.