mlsanityData to 7 Oct 2026

Eigen-Value: Efficient Domain-Robust Data Valuation via Eigenvalue-Based Approach

arXiv 2510.23409 ↗First posted 27 Oct 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Data valuation has become central in the era of data-centric AI. It drives efficient training pipelines and enables objective pricing in data markets by assigning a numeric value to each data point. Most existing data valuation methods estimate the effect of removing individual data points by evaluating changes in model validation performance under in-distribution (ID) settings, as opposed to out-of-distribution (OOD) scenarios where data follow different patterns. Since ID and OOD data behave differently, data valuation methods based on ID loss often fail to generalize to OOD settings, particularly when the validation set contains no OOD data. Furthermore, although OOD-aware methods exist, they involve heavy computational costs, which hinder practical deployment. To address these challenges, we introduce Eigen-Value (EV), a plug-and-play data valuation framework for OOD robustness that uses only an ID data subset, including during validation. EV provides a new spectral approximation of domain discrepancy, which is the gap of loss between ID and OOD using ratios of eigenvalues of ID data's covariance matrix. EV then estimates the marginal contribution of each data point to this discrepancy via perturbation theory, alleviating the computational burden. Subsequently, EV plugs into ID loss-based methods by adding an EV term without any additional training loop. We demonstrate that EV achieves improved OOD robustness and stable value rankings across real-world datasets, while remaining computationally lightweight. These results indicate that EV is practical for large-scale settings with domain shift, offering an efficient path to OOD-robust data valuation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 63 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

36 of 63 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  6. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  7. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  8. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  9. 2019Natural Adversarial Examplescited by 1,401
  10. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  11. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  12. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
24 more
  1. 2021Robust fine-tuning of zero-shot modelscited by 785
  2. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  3. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
  4. 2020Normalized Loss Functions for Deep Learning with Noisy Labelscited by 257
  5. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  6. 2020Geometric Dataset Distances via Optimal Transportcited by 157
  7. 2019Efficient Task-Specific Data Valuation for Nearest Neighbor Algorithmscited by 147
  8. 2022RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rankcited by 145
  9. 2022Data Banzhaf: A Robust Data Valuation Framework for Machine Learningcited by 126
  10. 2019Data Valuation using Reinforcement Learningcited by 115
  11. 2021Large-scale Unsupervised Semantic Segmentationcited by 98
  12. 2018A Marketplace for Data: An Algorithmic Solutioncited by 75
  13. 2019Distributionally Robust Optimization: A Reviewcited by 75
  14. 2019Distributionally Robust Optimization and Generalization in Kernel Methodscited by 73
  15. 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
  16. 2018The Price of Fair PCA: One Extra Dimensioncited by 67
  17. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  18. 2021DORO: Distributional and Outlier Robust Optimizationcited by 54
  19. 2023Data-OOB: Out-of-bag Estimate as a Simple and Efficient Data Valuecited by 38
  20. 2023Towards Calibrated Robust Fine-Tuning of Vision-Language Modelscited by 35
  21. 2014Logistic Regression: Tight Bounds for Stochastic and Online Optimizationcited by 30
  22. 2025Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimizationcited by 21
  23. 2022Private Data Valuation and Fair Payment in Data Marketplacescited by 12
  24. 2025Quality over Quantity: Boosting Data Efficiency Through Ensembled Multimodal Data Curationcited by 5

Built on by

Not cited yet.