mlsanityData to 14 Oct 2026

Drift Variation Autoencoder: Unifying Generation and Representation Learning through Conditional Posterior Flow Matching

arXiv 2608.25138 ↗First posted 25 Aug 2026cs.LG cs.AIcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Stochastic masking, cropping, or modality removal makes deterministic reconstruction an incomplete target: one observation can admit many clean completions. This work takes the corresponding posterior P(Xmid C) as the common statistical object for conditional generation and generatively sufficient representation learning. Drift Variation autoencoder trains a masked encoder Z=E(C) and a conditional flow decoder with one clean-prediction Flow Matching loss. The analysis first decomposes the ideal conditional KL into generator approximation and the representation deficiency I(X;Cmid Z). It then derives orthogonal risk decompositions for conditional Flow Matching. For an affine Gaussian path, the clean-prediction representation gap is zero if and only if P(Xmid Z)=P(Xmid C). Thus the encoder-dependent excess clean-prediction risk induced by Flow Matching and the profiled ideal conditional KL have the same posterior-sufficient zero set, without being numerically equal objectives. An exact conditional field with a zero-noise endpoint then generates P(Xmid Z) and hence P(Xmid C) at a joint ideal optimum. The result extends to continuous multimodal product spaces when the complete modality tuple remains the Flow target for every observation mask. On CrossGeom-4, an 18-run controlled benchmark, observable factors have linear-probe R2 of 0.9990-0.9992, shuffling the joint model's encoder condition increases conditional error by 13.5×-15.7×, and joint target attention reduces disagreement on an unobserved factor shared by two outputs by 90.1-92.8% relative to independent target decoders. Visible modalities are also generated and reconstructed, directly validating the full-tuple objective. Unconditional mode balance remains imperfect, delimiting the empirical claim to a controlled multimodal proof of concept.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 27 of its 32 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

27 of 32 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis6 Mar
  2. 2025High-Performance Self-Supervised Learning by Joint Training of Flow Matching17 Dec
  3. 2025On Flow Matching KL Divergence7 Nov
  4. 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun
  5. 2024Flow Matching Guide and Code9 Dec
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  8. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  9. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  10. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  11. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
  12. 2025Diffusion Transformers with Representation Autoencoderscited by 295
8 more
  1. 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 291
  2. 2023Denoising Diffusion Autoencoders are Unified Self-supervised Learnerscited by 130
  3. 20234M: Massively Multimodal Masked Modelingcited by 120
  4. 2021Diffusion-Based Representation Learningcited by 57
  5. 2025Understanding Representation Dynamics of Diffusion Models via Low-Dimensional Modelingcited by 18
  6. 2025Adapting Self-Supervised Representations as a Latent Space for Efficient Generationcited by 13
  7. 2022Representation Learning with Diffusion Modelscited by 6
  8. 2026Zero-Flow Encoderscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CAR-Flow: Condition-Aware Reparameterization Aligns Source and Target for Better Flow Matching
  2. 2026On the Diffusibility of High-Dimensional Latents
  3. 2026Noise-Robust Conditional Flow Matching: Generating Clean Samples from Noisy Datasets
  4. 2026Posterior Augmented Flow Matching
  5. 2026Discriminative Flow Matching: Beyond Time-Conditioning in Generative Restoration via Flow-State Representations
  6. 2026Posterior Flow Matching
  7. 2023Flow Matching in Latent Space
  8. 2025Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy