SetGo: Metadata Readiness for Scientific AI Datasets
Not on the map. Why?
Abstract (arXiv)
Scientific datasets intended for AI use require both computational readiness for model training and metadata readiness for discovery, sharing, and reuse. The Readiness Engine for Data Integration (REDI) addresses computational readiness, but no corresponding tool evaluates whether a dataset's metadata are sufficiently complete, governed, and standards-compliant for publication and agent-based consumption. Existing FAIR assessors operate only on published repository records, and no single system covers FAIR compliance, licensing, provenance, governance, reproducibility, and catalog readiness together. We present SetGo, an open-source Python toolkit that assesses and repairs metadata readiness across these six dimensions before a dataset is published or archived. Applied to four scientific corpora, SetGo surfaces deficiencies that general-purpose tools do not detect: ERA5 climate metadata scores 4% on ACDD 1.3 compliance; materials datasets fail OPTIMADE species-definition requirements; and PDB-derived proteomics data carries licensing terms incompatible with standard SPDX identifiers. Guided enrichment raises overall FAIR scores from 52-57% to 81-91%, and a single setgo publish command pushes to Hugging Face Hub, CKAN, or OpenMetadata with ML Commons Croissant 1.0 metadata sidecars. To support interactive and automated workflows, SetGo integrates with coding agents powered by large language models (LLMs) through a /setgo skill that enables natural-language execution of the full assess-enrich-publish loop, with user involvement limited to supplying missing metadata values.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 20 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
8 of 20 references.
References · 8
- 2024Data Readiness for AI: A 360-Degree Surveycited by 15
- 2017Data Readiness Levelscited by 12
- 2024Applying the FAIR Principles to computational workflowscited by 10
- 2024AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AIcited by 9
- 2023Towards Lightweight Data Integration using Multi-workflow Provenance and Data Observabilitycited by 8
- 2024Scalable Training of Trustworthy and Energy-Efficient Predictive Graph Foundation Models for Atomistic Materials Modeling: A Case Study with HydraGNNcited by 8
- 2024WorkflowHub: a registry for computational workflowscited by 6
- 2026Automated Data Readiness for Scientific AIcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SciHorizon-DataEVA: An Agentic System for AI-Readiness Evaluation of Heterogeneous Scientific Data
- 2025AutoClimDS: Climate Data Science Agentic AI -- A Knowledge Graph is All You Need
- 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
- 2026ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery
- 2026Automated Standardization of Legacy Biomedical Metadata Using an Ontology-Constrained LLM Agent
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation
- 2024DCA-Bench: A Benchmark for Dataset Curation Agents