mlsanityData to 14 Oct 2026

Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis

arXiv 2609.29581 ↗First posted 14 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Although diffusion-based methods have substantially improved the controllability of multimodal face synthesis, their semantic alignment remains suboptimal because most existing approaches rely on implicit latent-space objectives to model the relationship between denoising variables and multimodal conditions. Such implicit modeling is often insufficient to enforce precise correspondence between synthesized faces and conditional inputs, especially under long-tailed semantic mask distributions where rare attributes receive weak optimization signals. To address these limitations, we propose ECtextsuperscript2Face, a multimodal face synthesis framework that improves semantic alignment through explicit semantic supervision and distribution-aware optimization. First, we introduce Explicit Conditional Consistency Guidance (ECCG), which imposes direct consistency supervision in pixel space by decoding an approximate reverse estimate of the clean latent and explicitly aligning the synthesized image with textual descriptions and semantic masks. A temporal dynamic modulation function is further designed to adapt the supervision strength according to the timestep-dependent reliability of reverse estimation. Second, we propose Long-Tail Adaptive Flow Matching (LAFM), which reweights spatial optimization signals based on semantic attribute frequency, with normalized weights to maintain numerical stability during training. Importantly, all additional modules are used only during training and introduce no extra inference overhead. Extensive experiments show that ECtextsuperscript2Face consistently outperforms competitive baselines in both generation quality and semantic alignment, achieving a 29.38% improvement in mask accuracy on rare attributes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 39 of its 51 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

39 of 51 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Multivariate Diffusion Transformer with Decoupled Attention for High-Fidelity Mask-Text Collaborative Facial Generation16 Nov
  2. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generation12 Aug
  3. 2023Collaborative Diffusion for Multi-Modal Face Generation and Editing20 Apr
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  7. 2022clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIP5 Oct

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  12. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
20 more
  1. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  2. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  3. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  4. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
  5. 2023Flow Matching in Latent Spacecited by 160
  6. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  7. 2024Diffusion Models in Low-Level Vision: A Surveycited by 74
  8. 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 60
  9. 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
  10. 2021E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversioncited by 33
  11. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 33
  12. 2022Face Generation and Editing with StyleGAN: A Surveycited by 28
  13. 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
  14. 2024LaVin-DiT: Large Vision Diffusion Transformercited by 21
  15. 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
  16. 2022GAN-based Facial Attribute Manipulationcited by 16
  17. 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generationcited by 12
  18. 2023Learning to Generate Semantic Layouts for Higher Text-Image Correspondence in Text-to-Image Synthesiscited by 11
  19. 2024Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularizationcited by 8
  20. 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MMFace-DiT: A Dual-Stream Diffusion Transformer for High-Fidelity Multimodal Face Generation
  2. 2023Text-Guided 3D Face Synthesis -- From Generation to Editing
  3. 2026MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation
  4. 2025GRASP: Guided Residual Adapters with Sample-wise Partitioning
  5. 2026Identity-Conditioned Latent Consistency Distillation for Face Synthesis
  6. 2026FADRA: Frequency-Aware Diffusion with Residual Adaptation for Video Face Restoration
  7. 2025LAFR: Efficient Diffusion-based Blind Face Restoration via Latent Codebook Alignment Adapter
  8. 2024Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis