mlsanityData to 14 Oct 2026

Elite-Weighted Supervised Fine-tuning for Goal-Directed Molecular Optimization

arXiv 2609.00189 ↗First posted 31 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Goal-directed optimization is essential for steering molecular generators to propose candidates with desired properties. However, it is often implemented with policy-gradient reinforcement learning, which requires a generation-trajectory log-probability whose form depends on the model architecture and generation procedure. This makes an optimizer difficult to reuse across architectures and conditional generative designs. Supervised fine-tuning needs none of that machinery, but its update is driven by a fixed dataset, so the reward never enters the update. We introduce Elite-Weighted Supervised Fine-tuning (EW-SFT), which uses reward to guide elite selection of high-scoring molecules, and updates the model by its own pretraining loss on that set. Ablations show that reward information is passed primarily through elite selection, rather than through continuous weighting within the selected set. Because the update consumes only scored molecules and the model's native loss, the same rule applies across autoregressive, masked-diffusion, and discrete-flow generators, and across de novo, motif-extension, and linker-design tasks. Under a fixed budget of 3D shape alignment oracle calls on two kinase reference compounds, EW-SFT consistently outperforms the corresponding native optimizers. It further improves goal-directed optimization under a 2D similarity oracle on four held-out references and achieves comparable performance on a sample-efficiency benchmark without a trajectory-level RL formulation. These results demonstrate that EW-SFT is a unified and effective optimizer across molecular generators, design constraints, references, and oracles.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

21 of 41 references.

References · 21

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  3. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  4. 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
  5. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 305
  6. 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 297
  7. 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 267
  8. 2020Implementation Matters in Deep Policy Gradients: A Case Study on PPO and TRPOcited by 186
  9. 2020What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Studycited by 162
  10. 2022Sample Efficiency Matters: A Benchmark for Practical Molecular Optimizationcited by 155
  11. 2021Learning to Extend Molecular Scaffolds with Structural Motifscited by 71
  12. 2021Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generationcited by 68
9 more
  1. 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 67
  2. 2020Guiding Deep Molecular Optimization with Genetic Explorationcited by 51
  3. 2025GenMol: A Drug Discovery Generalist with Discrete Diffusioncited by 50
  4. 2023Gotta be SAFE: A New Framework for Molecular Designcited by 48
  5. 2023Genetic algorithms are strong baselines for molecule generationcited by 31
  6. 2017Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networkscited by 12
  7. 2025Refine Drugs, Don't Complete Them: Uniform-Source Discrete Flows for Fragment-Based Drug Discoverycited by 5
  8. 2025REINFORCE-ING Chemical Language Models for Drug Discoverycited by 3
  9. 2026Advancing Ligand-based Virtual Screening and Molecular Generation with Pretrained Molecular Embedding Distancecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026On the Design Space of Discrete Diffusion Online Adaptation for Molecular Optimization
  2. 2026MARCO: Multi-Round Agentic Reinforcement for Conditional Molecular Optimization
  3. 2026Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design
  4. 2024Diversity-Aware Reinforcement Learning for de novo Drug Design
  5. 2026Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling
  6. 2025Iterative Distillation for Reward-Guided Fine-Tuning of Diffusion Models in Biomolecular Design
  7. 2024Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models
  8. 2025Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-Tuning