Croissant: A Metadata Format for ML-Ready Datasets
Not on the map. Why?
Abstract (arXiv)
Data is a critical resource for machine learning (ML), yet working with data remains a key friction point. This paper introduces Croissant, a metadata format for datasets that creates a shared representation across ML tools, frameworks, and platforms. Croissant makes datasets more discoverable, portable, and interoperable, thereby addressing significant challenges in ML data management. Croissant is already supported by several popular dataset repositories, spanning hundreds of thousands of datasets, enabling easy loading into the most commonly-used ML frameworks, regardless of where the data is stored. Our initial evaluation by human raters shows that Croissant metadata is readable, understandable, complete, yet concise.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 16 of its 62 references that are in the map. First posted on arXiv 28 Mar 2024.
Builds on
16 of 62 references.
References · 16
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2014OpenML: networked science in machine learningcited by 523
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
- 2018The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standardscited by 97
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
- 2024Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on Hugging Facecited by 27
- 2022The Principles of Data-Centric AI (DCAI)cited by 26
4 more
- 2021Packaging research artefacts with RO-Cratecited by 22
- 2021Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelinescited by 15
- 2023DMLR: Data-centric Machine Learning Research -- Past, Present and Futurecited by 11
- 2021Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangledcited by 10
Built on by
Citing papers per year: 2024: 15; 2025: 22; 2026: 42.
79 papers.
Sort:
By area:
- 2024Are We Done with MMLU?cited by 178
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agentscited by 129
- 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 74
- 2024TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphscited by 35
- 2024Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competitioncited by 20
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CADcited by 11
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2024BenchmarkCards: Standardized Documentation for Large Language Model Benchmarkscited by 8
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Reviewcited by 8
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Planscited by 7
- 2024GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysiscited by 5
38 more
- 2025Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountabilitycited by 5
- 2025Machine Learning Models Have a Supply Chain Problemcited by 4
- 2026ProactBench: Beyond What The User Asked Forcited by 4
- 2025WirelessMathLM: Teaching Mathematical Reasoning for LLMs in Wireless Communications with Reinforcement Learningcited by 3
- 2026A Sustainable AI Economy Needs Data Deals That Work for Generatorscited by 3
- 2024ELCC: the Emergent Language Corpus Collectioncited by 2
- 2024DiNO-Diffusion. Scaling Medical Diffusion via Self-Supervised Pre-Trainingcited by 2
- 2025CheMixHub: Datasets and Benchmarks for Chemical Mixture Property Predictioncited by 2
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agentscited by 2
- 2026DoTime: A Synthetic Benchmark Generator for Interventional and Counterfactual Time Seriescited by 2
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectoriescited by 2
- 2024FinML-Chain: A Blockchain-Integrated Dataset for Enhanced Financial Machine Learningcited by 1
- 2025Mutual Understanding between People and Systems via Neurosymbolic AI and Knowledge Graphscited by 1
- 2025LCDB 1.1: A Database Illustrating Learning Curves Are More Ill-Behaved Than Previously Thoughtcited by 1
- 2025Open and Sustainable AI: challenges, opportunities and the road ahead in the life sciences (October 2025 -- Version 2)cited by 1
- 2025MObyGaze: a film dataset of multimodal objectification densely annotated by expertscited by 1
- 2025AI Model Passport: Data and System Traceability Framework for Transparent AI in Healthcited by 1
- 2025Towards Sustainability Model Cardscited by 1
- 2025WHAR Datasets: An Open Source Library for Wearable Human Activity Recognitioncited by 1
- 2025Flexible metadata harvesting for ecology using large language modelscited by 1
- 2025ML-Asset Management: Curation, Discovery, and Utilizationcited by 1
- 2025AgentSLA : Towards a Service Level Agreement for AI Agentscited by 1
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Toolscited by 1
- 2026Dual-Metric Evaluation of Social Bias in Large Language Models: Evidence from an Underrepresented Nepali Cultural Contextcited by 1
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coveragecited by 1
- 2026Blockchain Infrastructure for Intelligent Cyber--Physical--Social Systems:Post-Quantum Security, Interoperability, and Trustworthy Data Economies in the Era of Embodied AIcited by 1
- 2026Traxia: A Framework for Verifiable, Agent-Native Scientific Publishingcited by 1
- 2026Auditing Generalization in AI-Generated Video Detection: A Six-Control Protocol and the VidAudit Toolkitcited by 1
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarkscited by 1
- 2026Rad-R: A Raw-ADC Radar Dataset and Capture-Invariant SSM for Hardware-Fault Diagnosiscited by 1
- 2024TIDMAD: Time Series Dataset for Discovering Dark Matter with AI Denoisingcited by 0
- 2024Mitigating Downstream Model Risks via Model Provenancecited by 0
- 2024AICat: An AI Cataloguing Approach to Support the EU AI Actcited by 0
- 2025MRM3: Machine Readable ML Model Metadatacited by 0
- 2025TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentationcited by 0
- 2025AutoExpert: Automating 3D LiDAR Annotation from Expert-Crafted Guidelinescited by 0
- 2025Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspectivecited by 0
- 2025Towards Contextual Sensitive Data Detectioncited by 0
50 most cited of 79 All 79 (JSON)
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions1 Oct 2026
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026When Evidence Changes the Subject: Subject-Typed Claim Licensing for Learned Routing27 Sep 2026
- 2026ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift20 Sep 2026
- 2026A Policy Profile for Croissant: Refusal as a Property of the Dataset17 Sep 2026
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
- 2026Which Part of the Context Layer Does the Work? Separating Semantic Content from Retrieval Scaffolding in Text-to-SQL Agents6 Sep 2026
- 2026Rad-R: A Raw-ADC Radar Dataset and Capture-Invariant SSM for Hardware-Fault Diagnosis31 Aug 2026
- 2026OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models20 Aug 2026
- 2026Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale20 Aug 2026
- 2026Traceable Trust for action-ready artificial intelligence in bioscience18 Aug 2026
- 2026Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data11 Aug 2026
38 more
- 2026On the missing data layer and a potential solution3 Aug 2026
- 2026DoTime: A Synthetic Benchmark Generator for Interventional and Counterfactual Time Series29 Jul 2026
- 2026Future Rendering neq Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window23 Jul 2026
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks14 Jul 2026
- 2026Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation11 Jul 2026
- 2026ImmigrationReason: A Structured Dataset of U.S. Immigration Appeals for Legal Reasoning Research30 Jun 2026
- 2026Auditing Generalization in AI-Generated Video Detection: A Six-Control Protocol and the VidAudit Toolkit30 Jun 2026
- 2026Building AI-Ready Data Systems for Space Life Sciences, Aerospace Medicine, and Deep Space Exploration27 Jun 2026
- 2026MacroLens: A Multi-Task Benchmark for Contextual Financial Reasoning under Macroeconomic Scenarios23 Jun 2026
- 2026Rebuttals Move Peer-Review Scores, but Initial-Review Structure Bounds the Movement20 Jun 2026
- 2026Traxia: A Framework for Verifiable, Agent-Native Scientific Publishing6 Jun 2026
- 2026Blockchain Infrastructure for Intelligent Cyber--Physical--Social Systems:Post-Quantum Security, Interoperability, and Trustworthy Data Economies in the Era of Embodied AI5 Jun 2026
- 2026Croissant Tasks: A Metadata Format for Reproducible Machine Learning Evaluations28 May 2026
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agents27 May 2026
- 2026GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction19 May 2026
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage15 May 2026
- 2026Cross-Dialect Generalization Without Retraining: Benchmarks and Evaluation of Schema-Derived Constrained Decoding for MLIR14 May 2026
- 2026Croissant Baker: Metadata Generation for Discoverable, Governable, and Reusable ML Datasets14 May 2026
- 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoning13 May 2026
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD11 May 2026
- 2026ChaosNetBench: Benchmarking Spatio-Temporal Graph Neural Networks on Chaotic Lattice Dynamics10 May 2026
- 2026ProactBench: Beyond What The User Asked For9 May 2026
- 2026MedVIGIL: Evaluating Trustworthy Medical VLMs Under Broken Visual Evidence8 May 2026
- 2026BUILD-AND-FIND: An Effort-Aware Protocol for Evaluating Agent-Managed Codebases7 May 2026
- 2026TRAVELFRAUDBENCH: A Configurable Evaluation Framework for GNN Fraud Ring Detection in Travel Networks22 Apr 2026
- 2026IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering1 Apr 2026
- 2026Dual-Metric Evaluation of Social Bias in Large Language Models: Evidence from an Underrepresented Nepali Cultural Context8 Mar 2026
- 2026From Reflection to Repair: A Scoping Review of Dataset Documentation Tools17 Feb 2026
- 2026Measuring the State of Open Science in Transportation Using Large Language Models20 Jan 2026
- 2026A Sustainable AI Economy Needs Data Deals That Work for Generators15 Jan 2026
- 2025AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research18 Dec 2025
- 2025Towards Contextual Sensitive Data Detection2 Dec 2025
- 2025AgentSLA : Towards a Service Level Agreement for AI Agents4 Nov 2025
- 2025ML-Asset Management: Curation, Discovery, and Utilization28 Sep 2025
- 2025WirelessMathLM: Teaching Mathematical Reasoning for LLMs in Wireless Communications with Reinforcement Learning27 Sep 2025
- 2025Standards in the Preparation of Biomedical Research Metadata: A Bridge2AI Perspective12 Sep 2025
- 2025Flexible metadata harvesting for ecology using large language models21 Aug 2025
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Plans19 Aug 2025
50 newest of 79 All 79 (JSON)
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agentscited by 129
- 2024GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysiscited by 5
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agentscited by 2
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectoriescited by 2
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
- 2026OR-Space: A Full-Lifecycle Workspace Benchmark for Industrial Optimization Agents27 May 2026
- 2024GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysis21 Jun 2024
- 2024AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents19 Jun 2024
- 2024Are We Done with MMLU?cited by 178
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 74
- 2024TGB 2.0: A Benchmark for Learning on Temporal Knowledge Graphs and Heterogeneous Graphscited by 35
- 2024Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competitioncited by 20
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CADcited by 11
- 2024Benchmark Data Repositories for Better Benchmarkingcited by 10
- 2024BenchmarkCards: Standardized Documentation for Large Language Model Benchmarkscited by 8
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Reviewcited by 8
- 2025ResPlan: A Large-Scale Vector-Graph Dataset of 17,000 Residential Floor Planscited by 7
- 2025Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountabilitycited by 5
- 2025Machine Learning Models Have a Supply Chain Problemcited by 4
12 most cited of 71 All 71 (JSON)
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions1 Oct 2026
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026When Evidence Changes the Subject: Subject-Typed Claim Licensing for Learned Routing27 Sep 2026
- 2026ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift20 Sep 2026
- 2026A Policy Profile for Croissant: Refusal as a Property of the Dataset17 Sep 2026
- 2026Which Part of the Context Layer Does the Work? Separating Semantic Content from Retrieval Scaffolding in Text-to-SQL Agents6 Sep 2026
- 2026Rad-R: A Raw-ADC Radar Dataset and Capture-Invariant SSM for Hardware-Fault Diagnosis31 Aug 2026
- 2026OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models20 Aug 2026
- 2026Scientific Data Skills: Enabling Agent-Ready Scientific Data Services at Scale20 Aug 2026
- 2026Traceable Trust for action-ready artificial intelligence in bioscience18 Aug 2026
- 2026Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data11 Aug 2026
- 2026On the missing data layer and a potential solution3 Aug 2026
12 newest of 71 All 71 (JSON)