mlsanityData to 7 Oct 2026

Ethical Considerations for Responsible Data Curation

arXiv 2302.03629 ↗First posted 7 Feb 2023cs.CV cs.AI cs.DBcited by 17

Not on the map. Why?

Abstract (arXiv)

Human-centric computer vision (HCCV) data curation practices often neglect privacy and bias concerns, leading to dataset retractions and unfair models. HCCV datasets constructed through nonconsensual web scraping lack crucial metadata for comprehensive fairness and robustness evaluations. Current remedies are post hoc, lack persuasive justification for adoption, or fail to provide proper contextualization for appropriate application. Our research focuses on proactive, domain-specific recommendations, covering purpose, privacy and consent, and diversity, for curating HCCV evaluation datasets, addressing privacy and bias concerns. We adopt an ante hoc reflective perspective, drawing from current practices, guidelines, dataset withdrawals, and audits, to inform our considerations and recommendations.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 125 of its 377 references that are in the map. First posted on arXiv 7 Feb 2023.

Builds on

125 of 377 references.

References · 125

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  6. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  7. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  8. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  9. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  10. 2017The Kinetics Human Action Video Datasetcited by 1,894
  11. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  12. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
38 more
  1. 2018Model Cards for Model Reportingcited by 1,068
  2. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
  3. 2018Recognition in Terra Incognitacited by 655
  4. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  5. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
  6. 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 426
  7. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  8. 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
  9. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  10. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  11. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
  12. 2015WIDER FACE: A Face Detection Benchmarkcited by 297
  13. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  14. 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
  15. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  16. 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
  17. 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
  18. 2020Large image datasets: A pyrrhic win for computer vision?cited by 237
  19. 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
  20. 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 199
  21. 2019A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cyclecited by 192
  22. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  23. 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
  24. 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
  25. 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 152
  26. 2019Mitigate Bias in Face Recognition using Skewness-Aware Reinforcement Learningcited by 145
  27. 2015End-to-end people detection in crowded scenescited by 140
  28. 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
  29. 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
  30. 2022Natural Language Descriptions of Deep Visual Featurescited by 136
  31. 2019Towards a Critical Race Methodology in Algorithmic Fairnesscited by 124
  32. 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
  33. 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
  34. 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
  35. 2021Understanding and Evaluating Racial Biases in Image Captioningcited by 108
  36. 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
  37. 2021Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Researchcited by 100
  38. 2021On Interaction Between Augmentations and Corruptions in Natural Corruption Robustnesscited by 98

50 most cited of 125 All 125 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 5; 2026: 3.

17 papers.

Sort:

By area:

  1. 2025MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversationcited by 28
  2. 2024SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIPcited by 19
  3. 2024Who's in and who's out? A case study of multimodal CLIP-filtering in DataCompcited by 15
  4. 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 14
  5. 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
  6. 2024Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributescited by 7
  7. 2024FairJob: A Real-World Dataset for Fairness in Online Systemscited by 6
  8. 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Modelscited by 6
  9. 2024Promoting the Responsible Development of Speech Datasets for Mental Health and Neurological Disorders Researchcited by 3
  10. 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
  11. 2024A Systematic Review of NeurIPS Dataset Management Practicescited by 2
  12. 2025An Evaluation Framework for Network IDS/IPS Datasets: Leveraging MITRE ATT&CK and Industry Relevance Metricscited by 1
5 more
  1. 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
  2. 2025Can Vision Transformers with ResNet's Global Features Fairly Authenticate Demographic Faces?cited by 0
  3. 2026Slurry-as-a-Service: A Modest Proposal on Scalable Pluralistic Alignment for Nutrient Optimizationcited by 0
  4. 2026A Critical Analysis of Trustworthy AI Tools, Mark Frameworks, and the Implementation Chasmscited by 0
  5. 2026Position: Fairness Failure in Generative Models is an Evaluation Problemcited by 0