Contrastive-Augmented Flow Matching for Style-Content Disentanglement
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Learning representations that separate content and style is crucial for controllable generation and compositional generalization. However, diffusion and flow-based models trained primarily with generative objectives often produce entangled or misaligned factors. To address this gap, we introduce Contrastive Augmented Flow Matching (CAtFM), a framework that integrates contrastive regularization into an invertible flow matching formulation to promote structured content-style representations. Rather than constraining intermediate latents or velocity fields, we apply contrastive supervision to predicted endpoints during training, enforcing semantic consistency across transported distributions while allowing disentanglement to emerge implicitly, without assuming strictly pure or fully factorized content and style representations. Our main experiments operate in the CLIP embedding space, with additional validation using frozen DINO and ALIGN encoders. Across synthetic data, in-domain styles, and real-world benchmarks (ImageNet, WikiArt, DomainNet, and DTD), CAtFM improves content and style retrieval, enhances embedding cluster separation, and achieves stronger open-set robustness compared to generative and discriminative baselines. Overall, CAtFM provides a simple way to couple discriminative constraints with deterministic transport, improving disentanglement and robustness under distribution shift.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 74 of its 95 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
74 of 95 references.
Closest ancestors · 13
Same direction, newest first
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug
- 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Models3 Feb
- 2024Flowing from Words to Pixels: A Noise-Free Framework for Cross-Modality Evolution19 Dec
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations14 Oct
- 2024StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Models4 Sep
- 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
- 2024Measuring Style Similarity in Diffusion Models1 Apr
- 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representations11 Mar
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Models28 Nov
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
1 more
Other references · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Flow Matching for Generative Modelingcited by 5,426
38 more
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2013Describing Textures in the Wildcited by 2,110
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2018Disentangling by Factorisingcited by 614
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2024Flow Matching Guide and Codecited by 291
- 2017Sampling Matters in Deep Embedding Learningcited by 285
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 240
- 2017No Fuss Distance Metric Learning using Proxiescited by 225
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2021Decoupled Contrastive Learningcited by 141
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2022Disentangled Representation Learningcited by 111
- 2020ProxyNCA++: Revisiting and Revitalizing Proxy Neighborhood Component Analysiscited by 107
- 2022Action Matching: Learning Stochastic Dynamics from Samplescited by 94
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024Fisher Flow Matching for Generative Modeling over Discrete Datacited by 68
- 2025Diffuse and Disperse: Image Generation with Representation Regularizationcited by 67
- 2013Recognizing Image Stylecited by 64
- 2024Diffusion Models and Representation Learning: A Surveycited by 53
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2022Investigating Why Contrastive Learning Benefits Robustness Against Label Noisecited by 46
- 2023Evaluating Data Attribution for Text-to-Image Modelscited by 45
- 2023Boosting Latent Diffusion with Flow Matchingcited by 44
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026UniCSG: Unified High-Fidelity Content-Constrained Style-Driven Generation via Staged Semantic and Frequency Disentanglement
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models
- 2023CLAP: Isolating Content from Style through Contrastive Learning with Augmented Prompts
- 2025Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy
- 2024Extended Flow Matching: a Method of Conditional Generation with Generalized Continuity Equation
- 2024WikiStyle+: A Multimodal Approach to Content-Style Representation Disentanglement for Artistic Image Stylization
- 2025StyleBlend: Enhancing Style-Specific Content Creation in Text-to-Image Diffusion Models
- 2026DICE: Disentangling Artist Style from Content via Contrastive Subspace Decomposition in Diffusion Models