A Systematic Evaluation of Co-folding Model Representations for Small-Molecule Learning
Not on the map. Why?
Abstract (arXiv)
Small-molecule foundation models are typically pretrained on standalone molecular data, unlike vision and language models that often benefit from cross-modal or relational supervision. Protein-ligand co-folding provides a molecular analogue of such supervision by exposing models to atom-level ligand-protein interactions, raising the question of whether co-folding models can yield strong small-molecule representations. We study this question using Boltz2, a modern co-folding model, by transferring its atom-level ligand representations to standalone small-molecule tasks. Through systematic probing and distillation, we show that Boltz2 representations match or outperform existing models on the ADMET benchmark, accelerate molecular generative modeling, and improve sample efficiency in structure-guided ligand optimization. We further find that Boltz2 representations are complementary to those learned from conventional standalone molecular supervision, including 3D conformers, bioassay labels, and quantum-chemical properties. Finally, we extend representation alignment to reinforcement learning, showing that dense representation-level supervision can complement scalar rewards in molecular discovery. These results identify protein-ligand co-folding as a promising pretraining paradigm for small-molecule representation learning and position Boltz2 as a strong, off-the-shelf molecular foundation model.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
34 of 49 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
- 2019Graph Transformer Networkscited by 520
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 384
- 2024The Platonic Representation Hypothesiscited by 362
22 more
- 2021GFlowNet Foundationscited by 286
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 273
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 244
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 191
- 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 108
- 2023Autoregressive Diffusion Model for Graph Generationcited by 82
- 2024DeFoG: Discrete Flow Matching for Graph Generationcited by 76
- 2023Graph Generation with Diffusion Mixturecited by 52
- 2023Local Search GFlowNetscited by 45
- 2024On the Scalability of GNNs for Molecular Graphscited by 36
- 2024SynFlowNet: Design of Diverse and Novel Molecules with Synthesis Constraintscited by 26
- 2023Learning Energy Decompositions for Partial Inference of GFlowNetscited by 24
- 2024Generative Flows on Synthetic Pathway for Drug Designcited by 20
- 2024textttMiniMol: A Parameter-Efficient Foundation Model for Molecular Learningcited by 19
- 2023A Simple and Scalable Representation for Graph Generationcited by 15
- 2024Pessimistic Backward Policy for GFlowNetscited by 13
- 2024Advancing Graph Generation through Beta Diffusioncited by 13
- 2025Simple and Critical Iterative Denoising: A Recasting of Discrete Diffusion in Graph Generationcited by 9
- 2025Learning Flexible Forward Trajectories for Masked Molecular Diffusioncited by 6
- 2023Uni-QSAR: an Auto-ML Tool for Molecular Property Predictioncited by 4
Built on by
Not cited yet.