Reward Transport: Property Control in Flow Matching via Noise-Space Alignment
On the map: Diffusion models → Flow matching, time series and science
also in 1 more
Abstract (arXiv)
The coupling in flow matching -- the rule pairing noise vectors with data points -- is typically treated as a computational choice. We show that this coupling can instead serve as an alignment interface: by matching noise and data according to a target molecular property, it embeds controllable structure directly into the learned flow field. Building on this view, we introduce Reward Transport, which uses optimal transport coupling at training time to align a scalar noise-space coordinate with molecular rewards; at inference, varying this coordinate steers the generated distribution without requiring an oracle, reward model, gradient guidance, or additional computation. In the coupling-preserving limit, thresholding this coordinate recovers the Cross-Entropy Method's truncated reward distribution, providing a principled, continuously adjustable distribution-level control knob. Empirically, on ZINC-250K and GuacaMol, sweeping the scalar induces monotone control of logP and consistent QED control over its operating range; most tellingly, the same knob produces opposite structural responses for different targets, growing molecules for logP but shrinking them for QED, which rules out a generic size bias. The interface is complementary to classifier-free guidance and conditional flow matching, while a negative result under epsilon-prediction diffusion clarifies where coupling-level alignment is structurally absent. Code: https://github.com/KehanGuo2/reward-transport
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 33 of its 43 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
33 of 43 references.
Closest ancestors · 7
Same direction, newest first
- 2024Improving Molecular Graph Generation with Flow Matching and Optimal Transport8 Nov
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplings28 Apr
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
- 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar
Other references · 26
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2020On Layer Normalization in the Transformer Architecturecited by 906
14 more
- 2018Computational Optimal Transportcited by 765
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 363
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 301
- 2018GuacaMol: Benchmarking Models for De Novo Molecular Designcited by 294
- 2021GFlowNet Foundationscited by 286
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 199
- 2020MoFlow: An Invertible Flow Model for Generating Molecular Graphscited by 183
- 2026Generative Modeling via Driftingcited by 98
- 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
- 2019Self-Referencing Embedded Strings (SELFIES): A 100% robust molecular string representationcited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Gradient-Free Noise Optimization for Reward Alignment in Generative Models
- 2025Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-Tuning
- 2026Trust-Region Noise Search for Black-Box Alignment of Diffusion and Flow Models
- 2026A Unified Density Operator View of Flow Control and Merging
- 2025Beyond Optimal Transport: Model-Aligned Coupling for Flow Matching
- 2026Meta Flow Maps enable scalable reward alignment
- 2026Beyond Random Couplings: Contrastive Noise Alignment in Generative Flows
- 2026TRACE: Transport Alignment Conformal Prediction via Diffusion and Flow Matching Models