Robust Inference-Time Steering of Protein Diffusion Models via Embedding Optimization
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
A core challenge in structural biophysics is generating biomolecular conformations that are both physically plausible and consistent with experimental measurements. While sequence-to-structure diffusion models provide powerful priors, posterior sampling methods steer generation by perturbing atomic coordinates with gradients from experimental likelihoods. However, when the target lies in a low-density region of the prior, these methods require aggressive upweighting of the likelihood that can destabilize sampling and be sensitive to hyperparameters. We propose EmbedOpt, an inference-time steering framework that introduces an orthogonal optimization axis: rather than performing posterior sampling under a fixed prior, EmbedOpt directly optimizes the prior by updating the model's conditional embedding. This embedding space encodes rich coevolutionary signals, so optimizing it shifts the structural prior to align with experimental constraints. Empirically, EmbedOpt matches coordinate-based posterior sampling baselines on sparse distance constraints and outperforms them on cryo-electron microscopy map fitting, including real, noisy experimental ones. Furthermore, EmbedOpt's smooth optimization behavior yields robustness to hyperparameters spanning two orders of magnitude and enables comparable performance with fewer diffusion steps. Code is available at https://github.com/rs-station/embedopt.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 14 of its 39 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
14 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2025Unlocking hidden biomolecular conformational landscapes in diffusion models at inference time2 Dec
- 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Models30 Jun
Other references · 12
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2023Manifold Preserving Guided Diffusioncited by 153
- 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
- 2025DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Modelscited by 21
- 2025Multiscale guidance of protein structure prediction with heterogeneous cryo-EM datacited by 8
- 2025A Statistical Benchmark for Diffusion Posterior Sampling Algorithmscited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Modelscited by 1
- 2026ConforNets: Latents-Based Conformational Control in OpenFold3cited by 0
- 2026CrystalBoltz: End-to-End Protein Structure Determination via Experiment-Guided Diffusion for X-Ray Crystallographycited by 0
- 2026A Mean-Field Framework for Inference-Time Distributional Control of Diffusion Modelscited by 0
- 2026Fold'EM: Direct atomic structure inference from Cryo-EM particlescited by 0
- 2026Error-Corrected Inference-Time Scaling for Imperfect Diffusion Modelscited by 0
- 2026Error-Corrected Inference-Time Scaling for Imperfect Diffusion Models1 Oct 2026
- 2026Fold'EM: Direct atomic structure inference from Cryo-EM particles1 Oct 2026
- 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models28 Sep 2026
- 2026A Mean-Field Framework for Inference-Time Distributional Control of Diffusion Models9 Aug 2026
- 2026CrystalBoltz: End-to-End Protein Structure Determination via Experiment-Guided Diffusion for X-Ray Crystallography15 May 2026
- 2026ConforNets: Latents-Based Conformational Control in OpenFold320 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024On diffusion posterior sampling via sequential Monte Carlo for zero-shot scaffolding of protein motifs
- 2026Inference-Time Projection for Physically Valid Biomolecular Diffusion Models
- 2026Ligand-Conditioned Discrete Diffusion for Protein Sequence-Structure Co-Design
- 2023Graph Denoising Diffusion for Inverse Protein Folding
- 2024Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
- 2023Protein Design with Guided Discrete Diffusion
- 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Review
- 2023DiAMoNDBack: Diffusion-denoising Autoregressive Model for Non-Deterministic Backmapping of Cα Protein Traces