mlsanityData to 14 Oct 2026

TabLib: A Dataset of 627M Tables with Context

arXiv 2310.07875 ↗First posted 11 Oct 2023cs.CL cs.AI cs.DBcited by 23

Not on the map. Why?

Abstract (arXiv)

It is well-established that large, diverse datasets play a pivotal role in the performance of modern AI systems for text and image modalities. However, there are no datasets for tabular data of comparable size and diversity to those available for text and images. Thus we present "TabLib'', a compilation of 627 million tables totaling 69 TiB, along with 867B tokens of context. TabLib was extracted from numerous file formats, including CSV, HTML, SQLite, PDF, Excel, and others, sourced from GitHub and Common Crawl. The size and diversity of TabLib offer considerable promise in the table modality, reminiscent of the original promise of foundational datasets for text and images, such as The Pile and LAION.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 11 Oct 2023.

Builds on

38 of 59 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  8. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  9. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  10. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  11. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  12. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
26 more
  1. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
  2. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
  3. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
  4. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
  5. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  6. 2023Data-centric Artificial Intelligence: A Surveycited by 203
  7. 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
  8. 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
  9. 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
  10. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  11. 2019Sherlock: A Deep Learning Approach to Semantic Data Type Detectioncited by 74
  12. 2023Is GPT-4 a Good Data Analyst?cited by 70
  13. 2021GitTables: A Large-Scale Corpus of Relational Tablescited by 45
  14. 2022A Survey on Table Question Answering: Recent Advancescited by 41
  15. 2019Dataset search: a surveycited by 36
  16. 2019VizNet: Towards A Large-Scale Visualization Learning and Benchmarking Repositorycited by 28
  17. 2020RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparationcited by 27
  18. 2020Efficient Joinable Table Discovery in Data Lakes: A High-Dimensional Similarity-Based Approachcited by 23
  19. 2018Ad Hoc Table Retrieval using Semantic Similaritycited by 21
  20. 2023Column Type Annotation using ChatGPTcited by 19
  21. 2020Google Dataset Search by the Numberscited by 17
  22. 2022WarpGate: A Semantic Join Discovery System for Cloud Data Warehousescited by 13
  23. 2023LakeBench: Benchmarks for Data Discovery over Data Lakescited by 10
  24. 2023Pylon: Semantic Table Union Search in Data Lakescited by 9
  25. 2021Correlation Sketches for Approximate Join-Correlation Queriescited by 8
  26. 2019Recommending Related Tablescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 11; 2026: 8.

23 papers.

Sort:

By area:

  1. 2024Why Tabular Foundation Models Should Be a Research Prioritycited by 106
  2. 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 91
  3. 2024CARTE: Pretraining and Transfer for Tabular Learningcited by 76
  4. 2024Large Scale Transfer Learning for Tabular Data via Language Modelingcited by 76
  5. 2025Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Datacited by 41
  6. 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
  7. 2025ConTextTab: A Semantics-Aware Tabular In-Context Learnercited by 34
  8. 2025Large Language Models are Good Relational Learnerscited by 24
  9. 2025TabSTAR: A Tabular Foundation Model for Tabular Data with Text Fieldscited by 18
  10. 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 14
  11. 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 9
  12. 2024LaTable: Towards Large Tabular Modelscited by 8
11 more
  1. 2025In-context Learning of Evolving Data Streams with Tabular Foundational Modelscited by 8
  2. 2025TabGemma: Text-Based Tabular ICL via LLM using Continued Pretraining and Retrievalcited by 6
  3. 2026MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detectioncited by 5
  4. 2026Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pretrainingcited by 4
  5. 2026An Efficient and Effective Evaluator for Text2SQL Models on Unseen and Unlabeled Datacited by 2
  6. 2026TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understandingcited by 2
  7. 2026MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Imagecited by 2
  8. 2026Mind the Gap? A Distributional Comparison of Real and Synthetic Priors for Tabular Foundation Modelscited by 1
  9. 2026Learning to Evaluate: Cost-Effective Model Evaluation on Unlabeled Data with Meta-Learningcited by 1
  10. 2025PLM4NDV: Minimizing Data Access for Number of Distinct Values Estimation with Pre-trained Language Modelscited by 0
  11. 2025ZeroCard: Cardinality Estimation with Zero Dependence on Target Databases -- No Data, No Query, No Retrainingcited by 0