SkillTFM: Gated Skill Evolution for Training-Free Adaptation of Tabular Foundation Models
Not on the map. Why?
Abstract (arXiv)
Tabular data are ubiquitous in real-world applications and are crucial for data-driven prediction and decision-making across science, industry, finance, healthcare, and public services. Tabular foundation models (TFMs) have emerged as a promising paradigm for general-purpose tabular learning, offering reusable predictors across diverse datasets and substantially reducing the need for task-specific training, tuning, and model development. However, their practical deployment remains constrained by distribution shifts, heterogeneous feature semantics, and task-specific patterns that are difficult to capture without costly fine-tuning or additional labeled data. To this end, we propose SkillTFM, a training-free system that shifts TFM adaptation from parameter updates to the gated evolution of agentic skills. The core of SkillTFM is a verifiable and extensible skill bank that couples boundary evidence identification with gated skill evolution: the former characterizes task structure and base-model failure patterns, whereas the latter retrieves and extends reusable skills subject to explicit validation. Across simulated boundary settings and real-world electricity-price forecasting, SkillTFM improves AUC by 0.128--0.142, raises nonlinear-boundary AUC from 0.699 to 0.898. Furthermore, experiments across TFM backbones demonstrate the effectiveness and generality of SkillTFM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
26 of 42 references.
References · 26
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
14 more
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2024TabDPT: Scaling Tabular Foundation Models on Real Datacited by 97
- 2024CARTE: Pretraining and Transfer for Tabular Learningcited by 69
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 66
- 2026SkillOS: Learning Skill Curation for Self-Evolving Agentscited by 45
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 38
- 2026LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Modelscited by 6
- 2026DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanismscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
- 2025On Finetuning Tabular Foundation Models
- 2026VIP-COP: Context Optimization for Tabular Foundation Models
- 2026Distillation of Tabular Foundation Models into Efficient Predictors
- 2026Xiaomi-TabLDM: A Tabular Foundation Model Technical Report
- 2026LAB-Tab: LLM-Augmented Bayesian Network Adaptation for Few-Shot Tabular Generation
- 2026TabSCM: A practical Framework for Generating Realistic Tabular Data
- 2026TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention