OpenDataLab: Empowering General Artificial Intelligence with Open Datasets
Not on the map. Why?
Abstract (arXiv)
The advancement of artificial intelligence (AI) hinges on the quality and accessibility of data, yet the current fragmentation and variability of data sources hinder efficient data utilization. The dispersion of data sources and diversity of data formats often lead to inefficiencies in data retrieval and processing, significantly impeding the progress of AI research and applications. To address these challenges, this paper introduces OpenDataLab, a platform designed to bridge the gap between diverse data sources and the need for unified data processing. OpenDataLab integrates a wide range of open-source AI datasets and enhances data acquisition efficiency through intelligent querying and high-speed downloading services. The platform employs a next-generation AI Data Set Description Language (DSDL), which standardizes the representation of multimodal and multi-format data, improving interoperability and reusability. Additionally, OpenDataLab optimizes data processing through tools that complement DSDL. By integrating data with unified data descriptions and smart data toolchains, OpenDataLab can improve data preparation efficiency by 30%. We anticipate that OpenDataLab will significantly boost artificial general intelligence (AGI) research and facilitate advancements in related AI fields. For more detailed information, please visit the platform's official website: https://opendatalab.com.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 6 of its 14 references that are in the map. First posted on arXiv 4 Jun 2024.
Builds on
6 of 14 references.
References · 6
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2023WanJuan: A Comprehensive Multimodal Dataset for Advancing English and Chinese Large Modelscited by 50
- 2024DSDL: Data Set Description Language for Bridging Modalities and Tasks in AI Datacited by 1
Built on by
Citing papers per year: 2024: 4; 2025: 14; 2026: 11.
29 papers.
Sort:
By area:
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 31
- 2024ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Modelscited by 14
- 2025Consensus Entropy: Harnessing Multi-VLM Agreement for Self-Verifying and Self-Improving OCRcited by 12
- 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedbackcited by 12
- 2025Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoningcited by 11
- 2026DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editingcited by 11
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 10
- 2025EarthSE: A Benchmark for Evaluating Earth Scientific Exploration Capability of LLMscited by 7
- 2024The Northeast Materials Database for Magnetic Materialscited by 6
- 2025ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Datacited by 6
- 2025Easy Dataset: A Unified and Extensible Framework for Synthesizing LLM Fine-Tuning Data from Unstructured Documentscited by 6
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoningcited by 5
17 more
- 2026SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discoverycited by 4
- 2024Investigating Public Fine-Tuning Datasets: A Complex Review of Current Practices from a Construction Perspectivecited by 3
- 2025DeepForm: Reasoning Large Language Model for Communication System Formulationcited by 3
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answeringcited by 3
- 2025Multi-task Learning for Identification of Porcelain in Song and Yuan Dynastiescited by 2
- 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflowscited by 2
- 2025PCMind-2.1-Kaiyuan-2B Technical Reportcited by 2
- 2026PodBench: A Comprehensive Benchmark for Instruction-Aware Audio-Oriented Podcast Script Generationcited by 1
- 2026Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within 5090cited by 1
- 2025Automatic Task Detection and Heterogeneous LLM Speculative Decodingcited by 0
- 2025OCR-Quality: A Human-Annotated Dataset for OCR Quality Assessmentcited by 0
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoningcited by 0
- 2026RiskNet: A large-scale dataset of AI risk incidents from news with alignment and multi-dimensional annotationscited by 0
- 2026A New Multi-Domain Benchmark for Micro-Action Recognition and Detectioncited by 0
- 2026Artificial Intelligence and Innovation Ecosystem: Evolutionary Developments, Challenges, and Future Directionscited by 0
- 2026Towards Physics-Faithful Generation of Scientific Diagramscited by 0
- 2026InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttalcited by 0
- 2026Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within 509027 Aug 2026
- 2026Towards Physics-Faithful Generation of Scientific Diagrams13 Aug 2026
- 2026Artificial Intelligence and Innovation Ecosystem: Evolutionary Developments, Challenges, and Future Directions27 Jul 2026
- 2026InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal21 Jul 2026
- 2026A New Multi-Domain Benchmark for Micro-Action Recognition and Detection12 Jun 2026
- 2026RiskNet: A large-scale dataset of AI risk incidents from news with alignment and multi-dimensional annotations7 Jun 2026
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoning11 May 2026
- 2026DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editing10 Feb 2026
- 2026SciDataCopilot: An Agentic Data Preparation Framework for AGI-driven Scientific Discovery9 Feb 2026
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning31 Jan 2026
- 2026PodBench: A Comprehensive Benchmark for Instruction-Aware Audio-Oriented Podcast Script Generation21 Jan 2026
- 2025PCMind-2.1-Kaiyuan-2B Technical Report8 Dec 2025
17 more
- 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows23 Oct 2025
- 2025OCR-Quality: A Human-Annotated Dataset for OCR Quality Assessment17 Oct 2025
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering12 Oct 2025
- 2025Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning25 Sep 2025
- 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedback14 Aug 2025
- 2025Easy Dataset: A Unified and Extensible Framework for Synthesizing LLM Fine-Tuning Data from Unstructured Documents5 Jul 2025
- 2025DeepForm: Reasoning Large Language Model for Communication System Formulation10 Jun 2025
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs27 May 2025
- 2025EarthSE: A Benchmark for Evaluating Earth Scientific Exploration Capability of LLMs22 May 2025
- 2025ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data20 May 2025
- 2025Automatic Task Detection and Heterogeneous LLM Speculative Decoding13 May 2025
- 2025Consensus Entropy: Harnessing Multi-VLM Agreement for Self-Verifying and Self-Improving OCR15 Apr 2025
- 2025Multi-task Learning for Identification of Porcelain in Song and Yuan Dynasties18 Mar 2025
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation27 Nov 2024
- 2024The Northeast Materials Database for Magnetic Materials24 Sep 2024
- 2024Investigating Public Fine-Tuning Datasets: A Complex Review of Current Practices from a Construction Perspective11 Jul 2024
- 2024ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models5 Jul 2024
- 2025Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoningcited by 11
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 10
- 2025ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Datacited by 6
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoningcited by 5
- 2025DeepForm: Reasoning Large Language Model for Communication System Formulationcited by 3
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoningcited by 0
- 2026ReCrit: Transition-Aware Reinforcement Learning for Scientific Critic Reasoning11 May 2026
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning31 Jan 2026
- 2025Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning25 Sep 2025
- 2025DeepForm: Reasoning Large Language Model for Communication System Formulation10 Jun 2025
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs27 May 2025
- 2025ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data20 May 2025
- 2024ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Modelscited by 14
- 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedbackcited by 12
- 2026DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editingcited by 11
- 2025EarthSE: A Benchmark for Evaluating Earth Scientific Exploration Capability of LLMscited by 7
- 2024The Northeast Materials Database for Magnetic Materialscited by 6
- 2025Easy Dataset: A Unified and Extensible Framework for Synthesizing LLM Fine-Tuning Data from Unstructured Documentscited by 6
- 2024Investigating Public Fine-Tuning Datasets: A Complex Review of Current Practices from a Construction Perspectivecited by 3
- 2025Multi-task Learning for Identification of Porcelain in Song and Yuan Dynastiescited by 2
- 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflowscited by 2
- 2025PCMind-2.1-Kaiyuan-2B Technical Reportcited by 2
- 2026PodBench: A Comprehensive Benchmark for Instruction-Aware Audio-Oriented Podcast Script Generationcited by 1
- 2026Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within 5090cited by 1
12 most cited of 17 All 17 (JSON)
- 2026Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within 509027 Aug 2026
- 2026Towards Physics-Faithful Generation of Scientific Diagrams13 Aug 2026
- 2026Artificial Intelligence and Innovation Ecosystem: Evolutionary Developments, Challenges, and Future Directions27 Jul 2026
- 2026A New Multi-Domain Benchmark for Micro-Action Recognition and Detection12 Jun 2026
- 2026RiskNet: A large-scale dataset of AI risk incidents from news with alignment and multi-dimensional annotations7 Jun 2026
- 2026DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editing10 Feb 2026
- 2026PodBench: A Comprehensive Benchmark for Instruction-Aware Audio-Oriented Podcast Script Generation21 Jan 2026
- 2025PCMind-2.1-Kaiyuan-2B Technical Report8 Dec 2025
- 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows23 Oct 2025
- 2025OCR-Quality: A Human-Annotated Dataset for OCR Quality Assessment17 Oct 2025
- 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedback14 Aug 2025
- 2025Easy Dataset: A Unified and Extensible Framework for Synthesizing LLM Fine-Tuning Data from Unstructured Documents5 Jul 2025
12 newest of 17 All 17 (JSON)