mlsanityData to 14 Oct 2026

Statistically Indistinguishable, Operationally Distinct: A Formal Barrier for Tabular Foundation Models

arXiv 2606.29091 ↗First posted 27 Jun 2026cs.LG cs.AI cs.DBcited by 1

Not on the map. Why?

Abstract (arXiv)

Tabular foundation models cannot reason about data produced by running systems without access to the rules that govern them. We make this statement falsifiable. The Operational Turing Test (OTT) constructs pairs of legal and rule-violating database states whose 1- and 2-way column-value marginals match to a total variation of <0.02; Le~Cam's lemma then bounds any values-only classifier at ≥0.49 Bayes error. Three values-only baselines (XGBoost, TabICL, TabPFN) hit the bound exactly (accuracy 0.50, pre-registered two one-sided tests (TOST) p<0.002), raw row-level access does not help, exposing relational value consistency closes most of the gap, and only a classifier fed by seven executable rule-derived audits reaches 1.00 classification accuracy. In three matched 100-state frontier large-language-model (LLM) runs, models given the schema, trigger source, rule tables, and state files classify at most 2/50 legal states as LEGAL; GPT-5.5 accepts 0/50 legal states even with higher reasoning effort and a Structured Query Language (SQL) executor. The access-ladder pattern also appears on a second schema with structurally distinct rule families (banking ledger: cross-row balance, cumulative aggregate). The barrier is identifiability, not capacity: scale, data, and richer features cannot cross it without operational grounding.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

12 of 28 references.

References · 12

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  3. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  4. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
  5. 2025TabArena: A Living Benchmark for Machine Learning on Tabular Datacited by 176
  6. 2025TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Modelscited by 132
  7. 2024CARTE: Pretraining and Transfer for Tabular Learningcited by 76
  8. 2025Griffin: Towards a Graph-Centric Relational Database Foundation Modelcited by 47
  9. 2026Relational In-Context Learning via Synthetic Pre-training with Structural Priorcited by 14
  10. 2023NameGuess: Column Name Expansion for Tabular Datacited by 13
  11. 2025SALT: Sales Autocompletion Linked Business Tables Datasetcited by 12
  12. 2025Position: Foundation Models for Tabular Data within Systemic Contexts Need Groundingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits
  2. 2026TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
  3. 2026Measuring the Dependency Gap: Diagnosing Inter-Column Fidelity in Tabular Generative Models
  4. 2026Mind the Gap? A Distributional Comparison of Real and Synthetic Priors for Tabular Foundation Models
  5. 2026Why Large Language Models Fail at Tabular Prediction
  6. 2026Model-Aware Data Cleaning for Tabular Foundation Models
  7. 2026VIP-COP: Context Optimization for Tabular Foundation Models
  8. 2026Constraint-Aware Synthetic Tabular Data Generation via Inter-Column Constraint Discovery with LLM Agents