mlsanityData to 7 Oct 2026

Efficient Provably Private Classification with a Tabular Foundation Model

arXiv 2610.10068 ↗First posted 7 Oct 2026cs.LG cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Tabular data underpin prediction and decision-making in medicine, finance, government and science, but often contain sensitive individual-level information, creating a need for accurate prediction while preserving privacy. Traditional private learning provides formal privacy guarantees, but requires slow dataset-specific optimisation, suffers substantial utility loss under strong privacy, and is often difficult to apply correctly. Tabular foundation models adapt rapidly to new datasets, but existing models lack formal privacy guarantees, and are highly vulnerable to membership-inference attacks, limiting their use on sensitive data. Here we introduce PrivTab, an easy to use tabular foundation model for differentially private classification that embeds a privacy mechanism within its architecture. Pretrained on simulated datasets, PrivTab uses in-context learning to transform sensitive rows into compact, provably private summaries---effectively learning how to learn under privacy. PrivTab outperforms private linear and neural-network baselines under moderate-to-strong privacy, shows negligible membership leakage, maintains well-calibrated predictions under strong privacy, and reduces dataset fitting time by 10,000 times, requiring only a single forward pass. By combining formal privacy, speed, and easy of use, PrivTab brings recent advances in AI to applications where sensitive individual-level data have limited their adoption.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 63 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

10 of 63 references.

References · 10

  1. 2016Layer Normalizationcited by 5,579
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  3. 2020GLU Variants Improve Transformercited by 1,724
  4. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  5. 2018Neural Processescited by 307
  6. 2022Debugging Differential Privacy: A Case Study for Privacy Auditingcited by 39
  7. 2026TabPFN-3: Technical Reportcited by 4
  8. 2026Differential Privacy for Transformer Embeddings of Text with Nonparametric Variational Information Bottleneckcited by 2
  9. 2025Differentially Private In-Context Learning with Nearest Neighbor Searchcited by 1
  10. 2026On Reliability of Membership Inference Vulnerability Evaluationcited by 1

Built on by

Not cited yet.