mlsanityData to 7 Oct 2026

SkillTFM: Gated Skill Evolution for Training-Free Adaptation of Tabular Foundation Models

arXiv 2608.06137 ↗First posted 6 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Tabular data are ubiquitous in real-world applications and are crucial for data-driven prediction and decision-making across science, industry, finance, healthcare, and public services. Tabular foundation models (TFMs) have emerged as a promising paradigm for general-purpose tabular learning, offering reusable predictors across diverse datasets and substantially reducing the need for task-specific training, tuning, and model development. However, their practical deployment remains constrained by distribution shifts, heterogeneous feature semantics, and task-specific patterns that are difficult to capture without costly fine-tuning or additional labeled data. To this end, we propose SkillTFM, a training-free system that shifts TFM adaptation from parameter updates to the gated evolution of agentic skills. The core of SkillTFM is a verifiable and extensible skill bank that couples boundary evidence identification with gated skill evolution: the former characterizes task structure and base-model failure patterns, whereas the latter retrieves and extends reusable skills subject to explicit validation. Across simulated boundary settings and real-world electricity-price forecasting, SkillTFM improves AUC by 0.128--0.142, raises nonlinear-boundary AUC from 0.699 to 0.898. Furthermore, experiments across TFM backbones demonstrate the effectiveness and generality of SkillTFM.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 42 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

26 of 42 references.

References · 26

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2017On Calibration of Modern Neural Networkscited by 4,860
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  6. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  7. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  8. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  10. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  11. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  12. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
14 more
  1. 2021Transformers Can Do Bayesian Inferencecited by 338
  2. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
  3. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
  4. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
  5. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  6. 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 120
  7. 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
  8. 2024TabDPT: Scaling Tabular Foundation Models on Real Datacited by 97
  9. 2024CARTE: Pretraining and Transfer for Tabular Learningcited by 69
  10. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 66
  11. 2026SkillOS: Learning Skill Curation for Self-Evolving Agentscited by 45
  12. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 38
  13. 2026LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Modelscited by 6
  14. 2026DAG-FM: A Foundation Model for Causal Discovery under Heterogeneous Causal Mechanismscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
  2. 2025On Finetuning Tabular Foundation Models
  3. 2026VIP-COP: Context Optimization for Tabular Foundation Models
  4. 2026Distillation of Tabular Foundation Models into Efficient Predictors
  5. 2026Xiaomi-TabLDM: A Tabular Foundation Model Technical Report
  6. 2026LAB-Tab: LLM-Augmented Bayesian Network Adaptation for Few-Shot Tabular Generation
  7. 2026TabSCM: A practical Framework for Generating Realistic Tabular Data
  8. 2026TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention