mlsanityData to 14 Oct 2026

ZTab: Domain-based Zero-shot Annotation for Table Columns

arXiv 2603.11436 ↗First posted 12 Mar 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This study addresses the challenge of automatically detecting semantic column types in relational tables, a key task in many real-world applications. Zero-shot modeling eliminates the need for user-provided labeled training data, making it ideal for scenarios where data collection is costly or restricted due to privacy concerns. However, existing zero-shot models suffer from poor performance when the number of semantic column types is large, limited understanding of tabular structure, and privacy risks arising from dependence on high-performance closed-source LLMs. We introduce ZTab, a domain-based zero-shot framework that addresses both performance and zero-shot requirements. Given a domain configuration consisting of a set of predefined semantic types and sample table schemas, ZTab generates pseudo-tables for the sample schemas and fine-tunes an annotation LLM on them. ZTab is domain-based zero-shot in that it does not depend on user-specific labeled training data; therefore, no retraining is needed for a test table from a similar domain. We describe three cases of domain-based zero-shot. The domain configuration of ZTab provides a trade-off between the extent of zero-shot and annotation performance: a "universal domain" that contains all semantic types approaches "pure" zero-shot, while a "specialized domain" that contains semantic types for a specific application enables better zero-shot performance within that domain. Source code and datasets are available at https://github.com/hoseinzadeehsan/ZTab

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

32 of 59 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2023Mistral 7Bcited by 3,164
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  9. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 211
  10. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 154
  11. 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 137
  12. 2023Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Studycited by 116
20 more
  1. 2021TABBIE: Pretrained Representations of Tabular Datacited by 111
  2. 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 100
  3. 2021Towards Zero-Label Language Learningcited by 76
  4. 2019Sherlock: A Deep Learning Approach to Semantic Data Type Detectioncited by 74
  5. 2022Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learningcited by 50
  6. 2023Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMscited by 49
  7. 2021Annotating Columns with Pre-trained Language Modelscited by 37
  8. 2021TCN: Table Convolutional Network for Web Table Interpretationcited by 24
  9. 2023CHORUS: Foundation Models for Unified Data Discovery and Explorationcited by 24
  10. 2023Column Type Annotation using ChatGPTcited by 19
  11. 2019Learning Semantic Annotations for Tabular Datacited by 17
  12. 2021Data Lakes: A Survey of Functions and Systemscited by 15
  13. 2023ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Modelscited by 15
  14. 2020Semantic Labeling Using a Deep Contextualized Language Modelcited by 11
  15. 2018ColNet: Embedding the Semantics of Web Tables for Column Type Predictioncited by 4
  16. 2024FuseGen: PLM Fusion for Data-generation based Zero-shot Learningcited by 4
  17. 2024Graph Neural Network Approach to Semantic Type Detection in Tablescited by 3
  18. 2024KGLink: A column type annotation method that combines knowledge graph and pre-trained language modelcited by 3
  19. 2024Generating Tables from the Parametric Knowledge of Language Modelscited by 3
  20. 2025From Haystack to Needle: Label Space Reduction for Zero-shot Classificationcited by 2

Built on by

Not cited yet.