mlsanityData to 14 Oct 2026

Responsible AI in Open Ecosystems: Reconciling Innovation with Risk Assessment and Disclosure

arXiv 2409.19104 ↗First posted 27 Sep 2024cs.HC cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid scaling of AI has spurred a growing emphasis on ethical considerations in both development and practice. This has led to the formulation of increasingly sophisticated model auditing and reporting requirements, as well as governance frameworks to mitigate potential risks to individuals and society. At this critical juncture, we review the practical challenges of promoting responsible AI and transparency in informal sectors like OSS that support vital infrastructure and see widespread use. We focus on how model performance evaluation may inform or inhibit probing of model limitations, biases, and other risks. Our controlled analysis of 7903 Hugging Face projects found that risk documentation is strongly associated with evaluation practices. Yet, submissions (N=789) from the platform's most popular competitive leaderboard showed less accountability among high performers. Our findings can inform AI providers and legal scholars in designing interventions and policies that preserve open-source innovation while incentivizing ethical uptake.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 117 references that are in the map. First posted on arXiv 27 Sep 2024.

Builds on

65 of 117 references.

References · 65

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2022Training language models to follow instructions with human feedbackcited by 15,971
  7. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  9. 2020Scaling Laws for Neural Language Modelscited by 6,586
  10. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  11. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  12. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
38 more
  1. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  3. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  5. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  6. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  7. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  8. 2018Datasheets for Datasetscited by 1,386
  9. 2018Model Cards for Model Reportingcited by 1,080
  10. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  11. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  12. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
  13. 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 571
  14. 2019Quantifying the Carbon Emissions of Machine Learningcited by 521
  15. 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
  16. 2018Gender Bias in Coreference Resolutioncited by 442
  17. 2021Explaining Neural Scaling Lawscited by 363
  18. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
  19. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 348
  20. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  21. 2021Deep learning: a statistical viewpointcited by 240
  22. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  23. 2022Data Contamination: From Memorization to Exploitationcited by 236
  24. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  25. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  26. 2021Trustworthy AI: From Principles to Practicescited by 207
  27. 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 203
  28. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 147
  29. 2020Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructurecited by 138
  30. 2023Auditing large language models: a three-layered approachcited by 137
  31. 2022Revisiting Neural Scaling Laws in Language and Visioncited by 132
  32. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  33. 2015The Ladder: A Reliable Leaderboard for Machine Learning Competitionscited by 69
  34. 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
  35. 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
  36. 2023An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registrycited by 47
  37. 2020Behavioral Use Licensing for Responsible AIcited by 46
  38. 2023Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix Itcited by 44

50 most cited of 65 All 65 (JSON)

Built on by

Not cited yet.