mlsanityData to 14 Oct 2026

LLM-as-a-Discriminator: When Synthetic Tables Still Look Real

arXiv 2606.09865 ↗First posted 1 Jun 2026cs.LG cs.CR cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Privacy and data sharing are often in tension. Many organizations use synthetic data to reduce privacy risk and still share useful data. For tabular data, auditing privacy remains hard. In many cases, even humans cannot easily tell if a table is real or synthetic. In this paper, we propose a method based on LLM discrimination. We ask an LLM to classify each table sample as REAL or SYNTHETIC. We test two settings: C1 with table only, and C2 with table plus distributional metadata. We use LLaMA as an open model and Gemini as a reference model. In our experiments, we run three synthesis models, CTGAN, TVAE, and Gaussian Copula, on two public datasets, UCI Adult and ACS Census. We collect 451 valid trials. Our results show clear differences between models. On Adult, LLaMA reaches DRS=0% in reported cells, while Gemini reaches DRS=100% for CTGAN and TVAE. On Census, LLaMA predicts SYNTHETIC for most samples, while Gemini stays high in C1 but drops for CTGAN and TVAE in C2. We also compare with a classifier two-sample test (C2ST) and record linkage as distributional baselines, and with a human pilot of 2 annotators and 240 trials. Our results show that LLM discrimination is a practical privacy audit signal when model choice, per provider reporting, and data encoding are handled with care. For reproducibility, code and experiment scripts are available at https://github.com/SlokomManel/LLM-as-a-Discriminator.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

14 of 26 references.

References · 14

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023A Survey of Large Language Modelscited by 2,576
  3. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  4. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  5. 2019Modeling Tabular data using Conditional GANcited by 699
  6. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
  7. 2022Language Models are Realistic Tabular Data Generatorscited by 294
  8. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
  9. 2020Synthetic Data -- Anonymisation Groundhog Daycited by 108
  10. 2022Are Attribute Inference Attacks Just Imputation?cited by 49
  11. 2025Mind the Confidence Gap: Overconfidence, Calibration, and Distractor Effects in Large Language Modelscited by 40
  12. 2025Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreementcited by 25
2 more
  1. 2025Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessonscited by 9
  2. 2022Comparing the Utility and Disclosure Risk of Synthetic Data with Samples of Microdatacited by 4

Built on by

Not cited yet.