Automatic Generation of Model and Data Cards: A Step Towards Responsible AI
Not on the map. Why?
Abstract (arXiv)
In an era of model and data proliferation in machine learning/AI especially marked by the rapid advancement of open-sourced technologies, there arises a critical need for standardized consistent documentation. Our work addresses the information incompleteness in current human-generated model and data cards. We propose an automated generation approach using Large Language Models (LLMs). Our key contributions include the establishment of CardBench, a comprehensive dataset aggregated from over 4.8k model cards and 1.4k data cards, coupled with the development of the CardGen pipeline comprising a two-step retrieval process. Our approach exhibits enhanced completeness, objectivity, and faithfulness in generated model and data cards, a significant step in responsible AI documentation practices ensuring better accountability and traceability.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 10 May 2024.
Builds on
28 of 47 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2018Datasheets for Datasetscited by 1,371
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
16 more
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2023Augmented Language Models: a Surveycited by 398
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2022Compute Trends Across Three Eras of Machine Learningcited by 161
- 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2022Machine Learning Model Sizes and the Parameter Gapcited by 39
- 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyondcited by 37
- 2021Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generationcited by 29
- 2019The Transformative Potential of Artificial Intelligencecited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 3.
9 papers.
- 2025Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Modelscited by 8
- 2025Model Hubs and Beyond: Analyzing Model Popularity, Performance, and Documentationcited by 4
- 2025EvalCards: A Framework for Standardized Evaluation Reportingcited by 4
- 2024Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)cited by 1
- 2025VERBA: Verbalizing Model Differences Using Large Language Modelscited by 0
- 2025AI Transparency Atlas: Framework, Scoring, and Real-Time Model Card Evaluation Pipelinecited by 0
- 2026Temperature-Dependent Performance of Prompting Strategies in Extended Reasoning Large Language Modelscited by 0
- 2026AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generationcited by 0
- 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generationcited by 0
- 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generation26 Apr 2026
- 2026Temperature-Dependent Performance of Prompting Strategies in Extended Reasoning Large Language Models18 Mar 2026
- 2026AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generation16 Mar 2026
- 2025AI Transparency Atlas: Framework, Scoring, and Real-Time Model Card Evaluation Pipeline13 Dec 2025
- 2025EvalCards: A Framework for Standardized Evaluation Reporting5 Nov 2025
- 2025VERBA: Verbalizing Model Differences Using Large Language Models3 Jul 2025
- 2025Model Hubs and Beyond: Analyzing Model Popularity, Performance, and Documentation19 Mar 2025
- 2025Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models15 Mar 2025
- 2024Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)24 Dec 2024