VTruST: Controllable value function based subset selection for Data-Centric Trustworthy AI
Not on the map. Why?
Abstract (arXiv)
Trustworthy AI is crucial to the widespread adoption of AI in high-stakes applications with fairness, robustness, and accuracy being some of the key trustworthiness metrics. In this work, we propose a controllable framework for data-centric trustworthy AI (DCTAI)- VTruST, that allows users to control the trade-offs between the different trustworthiness metrics of the constructed training datasets. A key challenge in implementing an efficient DCTAI framework is to design an online value-function-based training data subset selection algorithm. We pose the training data valuation and subset selection problem as an online sparse approximation formulation. We propose a novel online version of the Orthogonal Matching Pursuit (OMP) algorithm for solving this problem. Experimental results show that VTruST outperforms the state-of-the-art baselines on social, image, and scientific datasets. We also show that the data values generated by VTruST can provide effective data-centric explanations for different trustworthiness metrics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 8 Mar 2024.
Builds on
37 of 51 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2014Certifying and removing disparate impactcited by 715
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 533
- 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 425
- 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
25 more
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
- 2021Data Augmentation Can Improve Robustnesscited by 194
- 2018Counterfactual Fairness in Text Classification through Robustnesscited by 151
- 2019MNIST-C: A Robustness Benchmark for Computer Visioncited by 138
- 2019Data Valuation using Reinforcement Learningcited by 116
- 2022Robustness and Accuracy Could Be Reconcilable by (Proper) Definitioncited by 111
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2020FairBatch: Batch Selection for Model Fairnesscited by 99
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 90
- 2023LAVA: Data Valuation without Pre-Specified Learning Algorithmscited by 69
- 2021Sample Selection for Fair and Robust Trainingcited by 48
- 2022Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentationscited by 46
- 2022Efficient and Effective Augmentation Strategy for Adversarial Trainingcited by 43
- 2020Achieving Equalized Odds by Resampling Sensitive Attributescited by 42
- 2023Data Valuation Without Training of a Modelcited by 35
- 2022Fair Infinitesimal Jackknife: Mitigating the Influence of Biased Training Data Points Without Refittingcited by 26
- 2022Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular datacited by 22
- 2018Cost-Effective Training of Deep CNNs with Active Model Adaptationcited by 16
- 2022Accurate Fairness: Improving Individual Fairness without Trading Accuracycited by 16
- 2022Data-SUITE: Data-centric identification of in-distribution incongruous examplescited by 12
- 2022Understanding the Impact of Adversarial Robustness on Accuracy Disparitycited by 9
- 2021Finding High-Value Training Data Subset through Differentiable Convex Programmingcited by 5
- 2021Shared Data and Algorithms for Deep Learning in Fundamental Physicscited by 4
Built on by
Not cited yet.