Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?
Not on the map. Why?
Abstract (arXiv)
Tabular foundation models (TFMs) achieve strong performance on microbiome abundance data, yet their robustness under realistic distribution shift remains poorly characterized. We introduce a benchmark that evaluates the robustness of TFMs to biologically inspired perturbations across six gut microbiome datasets spanning four disease contexts. In this in-context learning setting, models receive unperturbed support sets as context and are evaluated on perturbed query samples. To isolate robustness beyond "shortcut" features, we preserve the most discriminative taxa and apply three controlled perturbation strategies: (i) removal of high-abundance (uninformative) taxa, (ii) sparsification via increased zero-inflation, and (iii) zero-imputation via spurious non-zero injections. Our results show that protecting discriminative features is insufficient to guarantee stability under support-query shift: across datasets, all perturbations degrade model performance, with zero-imputation consistently the most harmful, indicating that corrupting global feature structure can break generalization even when key taxa are retained. Sparsification disproportionately affects TFMs relative to a classical random forest baseline, suggesting greater sensitivity to zero-inflation-type shifts. The code is publicly available at: https://github.com/UMMISCO/metagenomics-fm/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
14 of 24 references.
References · 14
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
- 2014OpenML: networked science in machine learningcited by 526
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
- 2026TabICLv2: A better, faster, scalable, and open tabular foundation modelcited by 144
- 2025TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Modelscited by 132
- 2024TabDPT: Scaling Tabular Foundation Models on Real Datacited by 113
- 2024Large Scale Transfer Learning for Tabular Data via Language Modelingcited by 76
- 2025ConTextTab: A Semantics-Aware Tabular In-Context Learnercited by 34
2 more
Built on by
Not cited yet.