Towards Better Serialization of Tabular Data for Few-shot Classification with Large Language Models
Not on the map. Why?
Abstract (arXiv)
We present a study on the integration of Large Language Models (LLMs) in tabular data classification, emphasizing an efficient framework. Building upon existing work done in TabLLM (arXiv:2210.10723), we introduce three novel serialization techniques, including the standout LaTeX serialization method. This method significantly boosts the performance of LLMs in processing domain-specific datasets, Our method stands out for its memory efficiency and ability to fully utilize complex data structures. Through extensive experimentation, including various serialization approaches like feature combination and importance, we demonstrate our work's superiority in accuracy and efficiency over traditional models.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 6 of its 9 references that are in the map. First posted on arXiv 18 Dec 2023.
Builds on
6 of 9 references.
References · 6
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2022Unsupervised Anomaly Detection for Auditing Data and Impact of Categorical Encodingscited by 3
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 3.
12 papers.
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
- 2024Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learningcited by 17
- 2025Serialized EHR make for good text representationscited by 7
- 2024Improving LLM Group Fairness on Tabular Data via In-Context Learningcited by 6
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Datacited by 6
- 2024Quantifying Prediction Consistency Under Fine-Tuning Multiplicity in Tabular LLMscited by 5
- 2025Tab-MIA: A Benchmark Dataset for Membership Inference Attacks on Tabular Data in LLMscited by 3
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligencecited by 2
- 2025Large Language Models as Universal Predictors? An Empirical Study on Small Tabular Datasetscited by 0
- 2026CAARL: In-Context Learning for Interpretable Co-Evolving Time Series Forecastingcited by 0
- 2026LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil-Environment Systemscited by 0
- 2026LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shotscited by 0
- 2026LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots23 May 2026
- 2026LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil-Environment Systems5 May 2026
- 2026CAARL: In-Context Learning for Interpretable Co-Evolving Time Series Forecasting20 Apr 2026
- 2025Serialized EHR make for good text representations11 Oct 2025
- 2025Large Language Models as Universal Predictors? An Empirical Study on Small Tabular Datasets24 Aug 2025
- 2025Tab-MIA: A Benchmark Dataset for Membership Inference Attacks on Tabular Data in LLMs23 Jul 2025
- 2025Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligence14 Jul 2025
- 2024Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data19 Dec 2024
- 2024Improving LLM Group Fairness on Tabular Data via In-Context Learning5 Dec 2024
- 2024Quantifying Prediction Consistency Under Fine-Tuning Multiplicity in Tabular LLMs4 Jul 2024
- 2024Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learning19 Jun 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024