mlsanityData to 14 Oct 2026

FACET: Factorized Asymmetric Conditioning for Efficient Transport in High-Fidelity Fluorescence Microscopy Synthesis

arXiv 2610.05353 ↗First posted 4 Oct 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Fluorescence microscopy reveals where proteins localize, but only a limited number of proteins can be imaged in the same cell; generating these images from amino-acid sequence and the cell's morphological context enables in silico localization of unimaged proteins. The two conditions, however, play asymmetric roles: morphological context is spatially aligned with the target, whereas sequence is non-spatial and must specify protein-dependent localization within it, with recurring coarse patterns shared across proteins and finer protein-specific variation. Existing generators condition on both jointly, without separating what each explains. We introduce FACET (Factorized Asymmetric Conditioning for Efficient Transport), a probabilistic generative framework that encodes this structure as an explicit inductive bias: sequence semantics are learned from what context leaves unexplained, coarse localization regularities are shared across proteins through a semantic memory, and protein-specific variation is a bounded residual around them. A variance-preserving state projection further lets FACET perform continuous stochastic transport through a pretrained diffusion predictor with minimal parameter overhead. On held-out proteins, FACET improves spatial overlap by 34.3% on the Human Protein Atlas and 14.0% on OpenCell over a backbone-matched baseline, and reduces FID by 27.2% and 46.5%, respectively, with 75% fewer network evaluations. It also substantially improves protein-association structure recovery and yields better-calibrated predictions, while detailed ablations show complementary contributions from its design choices. These results identify factorized asymmetric conditioning, rather than generator capacity alone, as a key lever for high-fidelity, efficient, and biologically meaningful cellular image synthesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

23 of 49 references.

References · 23

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2017On Calibration of Modern Neural Networkscited by 4,960
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  10. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  11. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  12. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
11 more
  1. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  2. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  3. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 344
  4. 2016Ladder Variational Autoencoderscited by 318
  5. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  6. 2022Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)cited by 122
  7. 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 116
  8. 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignmentcited by 29
  9. 2025B'ezierFlow: Learning B'ezier Stochastic Interpolant Schedulers for Few-Step Generationcited by 7
  10. 2025PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representationscited by 6
  11. 2026Retrieval-Augmented Interpretable Learning: Towards Task-Specific Zero-Shot Models in Healthcarecited by 1

Built on by

Not cited yet.