AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generation
Not on the map. Why?
Abstract (arXiv)
Transparent and standardized documentation is essential for building trustworthy generative AI (GAI) systems. However, existing automated methods for generating model and data cards still face three major challenges: (i) static templates, as most systems rely on fixed query templates that cannot adapt to diverse paper structures or evolving documentation requirements; (ii) information scarcity, since web-scale repositories such as Hugging Face often contain incomplete or inconsistent metadata, leading to missing or noisy information; and (iii) lack of benchmarks, as the absence of standardized datasets and evaluation protocols hinders fair and reproducible assessment of documentation quality. To address these limitations, we propose AdaQE-CG, an Adaptive Query Expansion for Card Generation framework that combines dynamic information extraction with cross-card knowledge transfer. Its Intra-Paper Extraction via Context-Aware Query Expansion (IPE-QE) module iteratively refines extraction queries to recover richer and more complete information from scientific papers and repositories, while its Inter-Card Completion using the MetaGAI Pool (ICC-MP) module fills missing fields by transferring semantically relevant content from similar cards in a curated dataset. In addition, we introduce MetaGAI-Bench, the first large-scale, expert-annotated benchmark for evaluating GAI documentation. Comprehensive experiments across five quality dimensions show that AdaQE-CG substantially outperforms existing approaches, exceeds human-authored data cards, and approaches human-level quality for model cards. Code, prompts, and data are publicly available at: https://github.com/haoxuan-unt2024/AdaQE-CG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
24 of 47 references.
References · 24
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
- 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 40
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
12 more
- 2021Outlining Traceability: A Principle for Operationalizing Accountability in Computing Systemscited by 26
- 2020Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberationcited by 24
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2024Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?cited by 15
- 2025Anatomy of a Machine Learning Ecosystem: 2 Million Models on Hugging Facecited by 12
- 2024Automatic Generation of Model and Data Cards: A Step Towards Responsible AIcited by 9
- 2022Prescriptive and Descriptive Approaches to Machine-Learning Transparencycited by 7
- 2023Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessmentscited by 7
- 2024The State of Data Curation at NeurIPS: An Assessment of Dataset Development Practices in the Datasets and Benchmarks Trackcited by 7
- 2025Completeness of Datasets Documentation on ML/AI repositories: an Empirical Investigationcited by 3
- 2025Model Cards Revisited: Bridging the Gap Between Theory and Practice for Ethical AI Requirementscited by 3
- 2025Blueprints of Trust: AI System Cards for End to End Transparency and Governancecited by 2
Built on by
Not cited yet.