TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models
Not on the map. Why?
Abstract (arXiv)
The first tabular foundation model, TabPFN, and its successor TabPFNv2 have impacted tabular AI substantially, with dozens of methods building on it and hundreds of applications across different use cases. This report introduces TabPFN-2.5, the next generation of our tabular foundation model, built for datasets with up to 50,000 data points and 2,000 features, a 20x increase in data cells compared to TabPFNv2. TabPFN-2.5 is now the leading method for the industry standard benchmark TabArena (which contains datasets with up to 100,000 training data points), substantially outperforming tuned tree-based models and matching the accuracy of AutoGluon 1.4, a complex four-hour tuned ensemble that even includes the previous TabPFNv2. Remarkably, default TabPFN-2.5 has a 100% win rate against default XGBoost on small to medium-sized classification datasets (<=10,000 data points, 500 features) and a 87% win rate on larger datasets up to 100K samples and 2K features (85% for regression). For production use cases, we introduce a new distillation engine that converts TabPFN-2.5 into a compact MLP or tree ensemble, preserving most of its accuracy while delivering orders-of-magnitude lower latency and plug-and-play deployment. This new release will immediately strengthen the performance of the many applications and methods already built on the TabPFN ecosystem.
Key facts. Cited by 115 papers in the map (data through 7 Oct 2026). Builds on 42 of its 218 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
42 of 218 references.
References · 42
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2023Vision Transformers Need Registerscited by 844
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
- 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
- 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
- 2025TabArena: A Living Benchmark for Machine Learning on Tabular Datacited by 152
- 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensemblingcited by 105
- 2024Better by Default: Strong Pre-Tuned MLPs and Boosted Trees on Tabular Datacited by 87
30 more
- 2025Mitra: Mixed Synthetic Priors for Enhancing Tabular Foundation Modelscited by 67
- 2025LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligencecited by 65
- 2025Do-PFN: In-Context Learning for Causal Effect Estimationcited by 46
- 2020RealCause: Realistic Causal Inference Benchmarkingcited by 44
- 2025CausalPFN: Amortized Causal Effect Estimation via In-Context Learningcited by 43
- 2025Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Datacited by 36
- 2025Foundation Models for Causal Inference via Prior-Data Fitted Networkscited by 30
- 2025Turning Tabular Foundation Models into Graph Foundation Modelscited by 30
- 2024Revisiting Nearest Neighbor for Tabular Data: A Deep Tabular Baseline Two Decades Latercited by 28
- 2024TabPFGen -- Tabular Data Generation with TabPFNcited by 26
- 2025Exact Expressive Power of Transformers with Paddingcited by 19
- 2025xRFM: Accurate, scalable, and interpretable feature learning models for tabular datacited by 14
- 2022Detecting hidden confounding in observational data using multiple environmentscited by 13
- 2025TabPFN-Wide: Continued Pre-Training for Extreme Feature Countscited by 13
- 2025Bringing Graphs to the Table: Zero-shot Node Classification via Tabular Foundation Modelscited by 12
- 2025Estimating Interventional Distributions with Uncertain Causal Graphs through Meta-Learningcited by 11
- 2025TabPFN: One Model to Rule Them All?cited by 10
- 2025TIME: TabPFN-Integrated Multimodal Engine for Robust Tabular-Image Learningcited by 10
- 2025In-context Learning of Evolving Data Streams with Tabular Foundational Modelscited by 7
- 2023Enhancing Actuarial Non-Life Pricing Models via Transformerscited by 6
- 2025ICR-RL: Deep Reinforcement Learning via In-Context Regressioncited by 5
- 2025Modern Neural Networks for Small Tabular Datasets: The New Default for Field-Scale Digital Soil Mapping?cited by 3
- 2025Longitudinal Progression Prediction of Alzheimer's Disease with Tabular Foundation Modelcited by 3
- 2025Tabular foundation model for GEOAI benchmark problems BM/AirportSoilProperties/2/2025cited by 3
- 2025Kriging prior Regression: A Case for Kriging-Based Spatial Features with TabPFN in Soil Mappingcited by 2
- 2025Tabular Data with Class Imbalance: Predicting Electric Vehicle Crash Severity with Pretrained Transformers (TabPFN) and Mamba-Based Modelscited by 2
- 2025ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencodercited by 1
- 2025Uncertainty-Aware Tabular Prediction: Evaluating VBLL-Enhanced TabPFN in Safety-Critical Medical Datacited by 1
- 2025Uncertainty-Guided Model Selection for Tabular Foundation Models in Biomolecule Efficacy Predictioncited by 1
- 2025FuelCast: Benchmarking Tabular and Temporal Models for Ship Fuel Consumptioncited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 111.
115 papers.
Sort:
By area:
- 2026PluRel: Synthetic Data unlocks Scaling Laws for Relational Foundation Modelscited by 15
- 2026Relational In-Context Learning via Synthetic Pre-training with Structural Priorcited by 11
- 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
- 2026EveNet: A Foundation Model for Particle Collision Data Analysiscited by 8
- 2026Tabular Foundation Models are Strong Graph Anomaly Detectorscited by 8
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 8
- 2026No Need to Train Your RDB Foundation Modelcited by 8
- 2026V0: A Generalist Value Model for Any Policy at State Zerocited by 7
- 2026EXAONE Tabular 1.0 : Technical Reportcited by 7
- 2026Use What You Know: Causal Foundation Models with Partial Graphscited by 6
- 2026LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Modelscited by 6
- 2026Tabular Foundation Models Can Do Survival Analysiscited by 5
38 more
- 2026End-to-End Compression for Tabular Foundation Modelscited by 5
- 2026TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attentioncited by 5
- 2026TabClustPFN: A Prior-Fitted Network for Tabular Data Clusteringcited by 4
- 2026ScoringBench: A Benchmark for Evaluating Tabular Foundation Models with Proper Scoring Rulescited by 4
- 2026Noise Immunity in In-Context Tabular Learning: An Empirical Robustness Analysis of TabPFN's Attention Mechanismscited by 4
- 2026Tabular foundation models for in-context prediction of molecular propertiescited by 4
- 2026Is One Layer Enough? Understanding Inference Dynamics in Tabular Foundation Modelscited by 4
- 2026Causal Foundation Models with Continuous Treatmentscited by 4
- 2026RocketPFN: Accurate Time Series Classification via In-Context Learningcited by 4
- 2026TabDPT-Turbo: Efficient In-Context Learning for Tabular Predictioncited by 4
- 2026Benchmarking Optimizers for MLPs in Tabular Deep Learningcited by 3
- 2026Amortizing Causal Sensitivity Analysis via Prior Data-Fitted Networkscited by 3
- 2026VIP-COP: Context Optimization for Tabular Foundation Modelscited by 3
- 2026Mitra-v2 Technical Reportcited by 3
- 2025Comparing Task-Agnostic Embedding Models for Tabular Datacited by 2
- 2026Grables: Tabular Learning Beyond Independent Rowscited by 2
- 2026MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Imagecited by 2
- 2026KGPFN: Unlocking the Potential of Knowledge Graph Foundation Model via In-Context Learningcited by 2
- 2026Foundation Models for Credit Risk Prediction: A Game Changer?cited by 2
- 2026Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Treescited by 2
- 2026Shaping the Prior: How Synthetic Task Distributions Determine Tabular Foundation Model Qualitycited by 2
- 2026SurvPFN: Towards Foundation Models for Survival Predictionscited by 2
- 2026Towards Pretraining Text Encoders for TabPFNcited by 2
- 2026Efficient Adaptive Data Acquisition via Pretrained Belief Representationscited by 2
- 2026PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modellingcited by 2
- 2025Beyond Token-level Supervision: Unlocking the Potential of Decoding-based Regression via Reinforcement Learningcited by 1
- 2026FIRE: Multi-fidelity Regression with Distribution-conditioned In-context Learning using Tabular Foundation Modelscited by 1
- 2026Observationally Informed Adaptive Causal Experimental Designcited by 1
- 2026Engineering Regression Without Real-Data Training: Domain Adaptation for Tabular Foundation Models Using Multi-Dataset Embeddingscited by 1
- 2026FoMo X: Modular Explainability Signals for Outlier Detection Foundation Modelscited by 1
- 2026Survival In-Context: Amortized Bayesian Survival Analysis via Prior-Fitted Networkscited by 1
- 2026Selecting Feature Interactions for Generalized Additive Models by Distilling Foundation Modelscited by 1
- 2026Distilling Tabular Foundation Models for Structured Health Datacited by 1
- 2026LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Modelscited by 1
- 2026CalArena: A Large-Scale Post-Hoc Calibration Benchmarkcited by 1
- 2026Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Imagescited by 1
- 2026Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Functioncited by 1
- 2026Bounded Context Management for Tabular Foundation Models on Stream Learningcited by 1
50 most cited of 115 All 115 (JSON)
- 2026Distillation of Tabular Foundation Models into Efficient Predictors1 Oct 2026
- 2026IQS-BO: In-Context Query Selection for Bayesian Optimisation1 Oct 2026
- 2026Latent Inference-Time Guidance of Time Series Foundation Models29 Sep 2026
- 2026Adapting Linear-Time Architectures for Tabular In-Context Learning28 Sep 2026
- 2026Can Tabular Foundation Models Amortize Statistical Inference?27 Sep 2026
- 2026CAFE: Counterfactual Prediction via Fast Posterior Estimation26 Sep 2026
- 2026Support-Compiled Feature Folding: More Evidence at Lower Memory Across Tabular Foundation Models23 Sep 2026
- 2026What Do Tabular Foundation Models Compute In Context? In-Situ Representation Refinement through Attention-Gated Updates23 Sep 2026
- 2026In-Context Guidance: Learning Inter-Task Synergies via Numerical Foundational Models for Few-Shot Multitask Optimization22 Sep 2026
- 2026PACE: Plug-and-Play Contextual Embedding for Feature Screening with Pretrained Tabular Foundation Models20 Sep 2026
- 2026Causilo Technical Report19 Sep 2026
- 2026Streaming Hierarchical Inference with Tabular Foundation Models7 Sep 2026
38 more
- 2026TabBench-Bio: A Living Benchmark for Machine Learning on High-Dimensional Biomedical Tables7 Sep 2026
- 2026Mitra-v2 Technical Report3 Sep 2026
- 2026Do Tabular Foundation Models Know Physics? Contamination, Units, and the Deterministic Limit2 Sep 2026
- 2026The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Era29 Aug 2026
- 2026SymboLLM-FE: LLM-Accelerated Symbolic Regression for Automated Feature Engineering on Tabular Data28 Aug 2026
- 2026EXAONE Tabular 1.0 : Technical Report26 Aug 2026
- 2026Tabular foundation models for non-tabular tasks23 Aug 2026
- 2026Lost in Aggregation: How Benchmarks Overlook Irreplaceable Model Strengths19 Aug 2026
- 2026TabNSM: Neural Sparse Mixer for Tabular Regression18 Aug 2026
- 2026Training Fair Tabular Foundation Models14 Aug 2026
- 2026On the Brittleness of Maximum Likelihood Estimation for Gaussian Process Hyperparameter Optimization13 Aug 2026
- 2026TACTICL: Task-Aware Compression of Tabular ICL Models11 Aug 2026
- 2026In-Context Density Estimation for Tabular Data10 Aug 2026
- 2026TS2TabPFN: Time Series Classification and Extrinsic Regression through Feature Extraction and a Tabular Foundation Model4 Aug 2026
- 2026TabDPT-Turbo: Efficient In-Context Learning for Tabular Prediction2 Aug 2026
- 2026Memory Efficient Tabular Foundation Models30 Jul 2026
- 2026PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling26 Jul 2026
- 2026Topological Signatures of Context-Level Reliability in TabPFN20 Jul 2026
- 2026Surprisingly Simple and Effective Multi-Domain Graph Foundation Model through Graph-to-Table Alignment13 Jul 2026
- 2026TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddings13 Jul 2026
- 2026TabLoRA: Parameter-Efficient Low-Rank Ensemble Learning for Large-Scale Tabular Data11 Jul 2026
- 2026Onnes: A Physics-Grounded Multi-Agent LLM Simulator for Cryogenic Fault Diagnosis in Quantum Computing Infrastructure7 Jul 2026
- 2026InvWeaver: Deductive Feedback for Invariant Synthesis in Interacting-Loop Programs6 Jul 2026
- 2026Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation6 Jul 2026
- 2026Evolutionary Feature Engineering for Structured Data2 Jul 2026
- 2026In-Context Residual Calibration for Uncertainty Quantification of Energy Time Series over Graphs30 Jun 2026
- 2026Probing Memorization of Tabular In-Context Learning30 Jun 2026
- 2026Statistically Indistinguishable, Operationally Distinct: A Formal Barrier for Tabular Foundation Models27 Jun 2026
- 2026Efficient Adaptive Data Acquisition via Pretrained Belief Representations23 Jun 2026
- 2026Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?23 Jun 2026
- 2026RocketPFN: Accurate Time Series Classification via In-Context Learning19 Jun 2026
- 2026A Causal DAG Prior for Synthetic Time-Series Classification Datasets19 Jun 2026
- 2026Rejections Based on Predictive Uncertainty Enable Reliable Routine Soil Spectroscopy19 Jun 2026
- 2026Bounded Context Management for Tabular Foundation Models on Stream Learning17 Jun 2026
- 2026Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Function11 Jun 2026
- 2026BSTabDiff: Block-Subunit Diffusion Priors for High-Dimensional Tabular Data Generation8 Jun 2026
- 2026TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention5 Jun 2026
- 2026Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models3 Jun 2026
50 newest of 115 All 115 (JSON)
- 2026Relational In-Context Learning via Synthetic Pre-training with Structural Priorcited by 11
- 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
- 2026EveNet: A Foundation Model for Particle Collision Data Analysiscited by 8
- 2026Tabular Foundation Models are Strong Graph Anomaly Detectorscited by 8
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 8
- 2026No Need to Train Your RDB Foundation Modelcited by 8
- 2026V0: A Generalist Value Model for Any Policy at State Zerocited by 7
- 2026EXAONE Tabular 1.0 : Technical Reportcited by 7
- 2026Use What You Know: Causal Foundation Models with Partial Graphscited by 6
- 2026LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Modelscited by 6
- 2026Tabular Foundation Models Can Do Survival Analysiscited by 5
- 2026End-to-End Compression for Tabular Foundation Modelscited by 5
12 most cited of 111 All 111 (JSON)
- 2026Distillation of Tabular Foundation Models into Efficient Predictors1 Oct 2026
- 2026IQS-BO: In-Context Query Selection for Bayesian Optimisation1 Oct 2026
- 2026Latent Inference-Time Guidance of Time Series Foundation Models29 Sep 2026
- 2026Adapting Linear-Time Architectures for Tabular In-Context Learning28 Sep 2026
- 2026Can Tabular Foundation Models Amortize Statistical Inference?27 Sep 2026
- 2026CAFE: Counterfactual Prediction via Fast Posterior Estimation26 Sep 2026
- 2026Support-Compiled Feature Folding: More Evidence at Lower Memory Across Tabular Foundation Models23 Sep 2026
- 2026What Do Tabular Foundation Models Compute In Context? In-Situ Representation Refinement through Attention-Gated Updates23 Sep 2026
- 2026In-Context Guidance: Learning Inter-Task Synergies via Numerical Foundational Models for Few-Shot Multitask Optimization22 Sep 2026
- 2026PACE: Plug-and-Play Contextual Embedding for Feature Screening with Pretrained Tabular Foundation Models20 Sep 2026
- 2026Causilo Technical Report19 Sep 2026
- 2026Streaming Hierarchical Inference with Tabular Foundation Models7 Sep 2026
12 newest of 111 All 111 (JSON)