mlsanityData to 7 Oct 2026

Automatic Generation of Model and Data Cards: A Step Towards Responsible AI

arXiv 2405.06258 ↗First posted 10 May 2024cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

In an era of model and data proliferation in machine learning/AI especially marked by the rapid advancement of open-sourced technologies, there arises a critical need for standardized consistent documentation. Our work addresses the information incompleteness in current human-generated model and data cards. We propose an automated generation approach using Large Language Models (LLMs). Our key contributions include the establishment of CardBench, a comprehensive dataset aggregated from over 4.8k model cards and 1.4k data cards, coupled with the development of the CardGen pipeline comprising a two-step retrieval process. Our approach exhibits enhanced completeness, objectivity, and faithfulness in generated model and data cards, a significant step in responsible AI documentation practices ensuring better accountability and traceability.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 10 May 2024.

Builds on

28 of 47 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2017Billion-scale similarity search with GPUscited by 2,477
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  9. 2018Datasheets for Datasetscited by 1,371
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  11. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  12. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
16 more
  1. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  2. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  3. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  4. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
  5. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  6. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
  7. 2023Augmented Language Models: a Surveycited by 398
  8. 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
  9. 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
  10. 2022Compute Trends Across Three Eras of Machine Learningcited by 161
  11. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  12. 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
  13. 2022Machine Learning Model Sizes and the Parameter Gapcited by 39
  14. 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyondcited by 37
  15. 2021Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generationcited by 29
  16. 2019The Transformative Potential of Artificial Intelligencecited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 3.

9 papers.