mlsanityData to 14 Oct 2026

Tabular foundation models for in-context prediction of molecular properties

arXiv 2604.16123 ↗First posted 17 Apr 2026cs.LG physics.chem-phcited by 6

Not on the map. Why?

Abstract (arXiv)

Accurate molecular property prediction is central to drug discovery, catalysis, and process design, yet real-world applications are often limited by small datasets. Molecular foundation models provide a promising direction by learning transferable molecular representations; however, they typically involve task-specific fine-tuning, require machine learning expertise, and often fail to outperform classical baselines. Tabular foundation models (TFMs) offer a fundamentally different paradigm: they perform predictions through in-context learning, enabling inference without task-specific training. Here, we evaluate TFMs in the low- to medium-data regime across both standardized pharmaceutical benchmarks and chemical engineering datasets. We evaluate both frozen molecular foundation model representations, as well as classical descriptors and fingerprints. Across the benchmarks, the approach shows excellent predictive performance while reducing computational cost, compared to fine-tuning, with these advantages also transferring to practical engineering data settings. In particular, combining TFMs with CheMeleon embeddings yields up to 100% win rates on 30 MoleculeACE tasks, while compact RDKit2d and Mordred descriptors provide strong descriptor-based alternatives. Molecular representation emerges as a key determinant in TFM performance, with molecular foundation model embeddings and 2D descriptor sets both providing substantial gains over classic molecular fingerprints on many tasks. These results suggest that in-context learning with TFMs provides a highly accurate and cost-efficient alternative for property prediction in practical applications.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

22 of 44 references.

References · 22

  1. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  2. 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 383
  3. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
  4. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
  5. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
  6. 2025TabArena: A Living Benchmark for Machine Learning on Tabular Datacited by 176
  7. 2026TabICLv2: A better, faster, scalable, and open tabular foundation modelcited by 144
  8. 2025TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Modelscited by 132
  9. 2016Low Data Drug Discovery with One-shot Learningcited by 91
  10. 2022polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informaticscited by 48
  11. 2023Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Languagecited by 44
  12. 2022TransPolymer: a Transformer-based language model for polymer property predictionscited by 43
10 more
  1. 2025Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Datacited by 41
  2. 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 20
  3. 2025Benchmarking Pretrained Molecular Embedding Models For Molecular Representation Learningcited by 15
  4. 2025Deep Learning Foundation Models from Classical Molecular Descriptorscited by 14
  5. 2022Gibbs-Helmholtz Graph Neural Network: capturing the temperature dependency of activity coefficients at infinite dilutioncited by 12
  6. 2024PolyCL: Contrastive Learning for Polymer Representation Learning via Explicit and Implicit Augmentationscited by 7
  7. 2024Be aware of overfitting by hyperparameter optimization!cited by 5
  8. 2025Molecular Machine Learning in Chemical Process Designcited by 5
  9. 2025Superior Molecular Representations from Intermediate Encoder Layerscited by 4
  10. 2026Multitask-Informed Prior for In-Context Learning on Tabular Data: Application to Steel Property Predictioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.