mlsanityData to 14 Oct 2026

TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models

arXiv 2601.08011 ↗First posted 12 Jan 2026cs.CV cs.AI cs.LGcited by 4

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Current text-conditioned diffusion editors handle single object replacement well but struggle when a new object and a new style must be introduced simultaneously. We present Twin-Prompt Attention Blend (TP-Blend), a lightweight training-free framework that receives two separate textual prompts, one specifying a blend object and the other defining a target style, and injects both into a single denoising trajectory. TP-Blend is driven by two complementary attention processors. Cross-Attention Object Fusion (CAOF) first averages head-wise attention to locate spatial tokens that respond strongly to either prompt, then solves an entropy-regularised optimal transport problem that reassigns complete multi-head feature vectors to those positions. CAOF updates feature vectors at the full combined dimensionality of all heads (e.g., 640 dimensions in SD-XL), preserving rich cross-head correlations while keeping memory low. Self-Attention Style Fusion (SASF) injects style at every self-attention layer through Detail-Sensitive Instance Normalization. A lightweight one-dimensional Gaussian filter separates low- and high-frequency components; only the high-frequency residual is blended back, imprinting brush-stroke-level texture without disrupting global geometry. SASF further swaps the Key and Value matrices with those derived from the style prompt, enforcing context-aware texture modulation that remains independent of object fusion. Extensive experiments show that TP-Blend produces high-resolution, photo-realistic edits with precise control over both content and appearance, surpassing recent baselines in quantitative fidelity, perceptual quality, and inference speed.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 176 of its 193 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

176 of 193 references.

Closest ancestors · 59

Same direction, newest first

  1. 2025Grouped Speculative Decoding for Autoregressive Image Generation11 Aug
  2. 2025Devil is in the Detail: Towards Injecting Fine Details of Image Prompt in Image Generation via Conflict-free Guidance and Stratified Attention4 Aug
  3. 2025Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis28 Jul
  4. 2025FairHuman: Boosting Hand and Face Quality in Human Image Generation with Minimum Potential Delay Fairness in Diffusion Models3 Jul
  5. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  6. 2025Fair Generation without Unfair Distortions: Debiasing Text-to-Image Generation with Entanglement-Free Attention16 Jun
  7. 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation4 Jun
  8. 2025One-Way Ticket:Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion Models28 May
  9. 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis15 May
  10. 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
  11. 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning10 Apr
  12. 2025Concept Lancet: Image Editing with Compositional Representation Transplant3 Apr
38 more
  1. 2025Multi-party Collaborative Attention Control for Image Customization2 Apr
  2. 2025Spatial Transport Optimization by Repositioning Attention Map for Training-Free Text-to-Image Synthesis28 Mar
  3. 2025Scaling Down Text Encoders of Text-to-Image Diffusion Models25 Mar
  4. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model25 Mar
  5. 2025FDS: Frequency-Aware Denoising Score for Text-Guided Latent Diffusion Image Editing24 Mar
  6. 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing16 Mar
  7. 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform4 Mar
  8. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models3 Mar
  9. 2025Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Think27 Feb
  10. 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models20 Feb
  11. 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation17 Feb
  12. 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
  13. 2024Dual Diffusion for Unified Image Generation and Understanding31 Dec
  14. 2024Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generation25 Dec
  15. 2024UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation25 Dec
  16. 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec
  17. 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training12 Dec
  18. 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformers12 Dec
  19. 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion5 Dec
  20. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation5 Dec
  21. 2024Self-Cross Diffusion Guidance for Text-to-Image Synthesis of Similar Subjects28 Nov
  22. 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generation27 Nov
  23. 2024Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis25 Nov
  24. 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov
  25. 2024SeedEdit: Align Image Re-Generation to Image Editing11 Nov
  26. 2024Minority-Focused Text-to-Image Generation via Prompt Optimization10 Oct
  27. 2024OmniGen: Unified Image Generation17 Sep
  28. 2024IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation12 Sep
  29. 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
  30. 2024Rethinking Training for De-biasing Text-to-Image Generation: Unlocking the Potential of Stable Diffusion22 Aug
  31. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
  32. 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generation30 Jun
  33. 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objects14 Jun
  34. 2024FreeTuner: Any Subject in Any Style with Training-free Diffusion23 May
  35. 2024SemanticDraw: Towards Real-Time Interactive Content Creation from Image Diffusion Models14 Mar
  36. 2024Text2Street: Controllable Text-to-image Generation for Street Views7 Feb
  37. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
  38. 2023Fair Text-to-Image Diffusion via Fair Mapping29 Nov

50 newest of 59 All 59 (JSON)

Other references · 117

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  9. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  10. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  11. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  12. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
38 more
  1. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  2. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
  3. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  4. 2023Style Aligned Image Generation via Shared Attentioncited by 216
  5. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
  6. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  7. 2016Stochastic Optimization for Large-scale Optimal Transportcited by 189
  8. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  9. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  10. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  11. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  12. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  13. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  14. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  15. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  16. 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 71
  17. 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
  18. 2025GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generationcited by 57
  19. 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generationcited by 56
  20. 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 53
  21. 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
  22. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  23. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  24. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  25. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  26. 2024OSV: One Step is Enough for High-Quality Image to Video Generationcited by 36
  27. 2024Language-Guided Image Tokenization for Generationcited by 36
  28. 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
  29. 2024Generative Image Layer Decomposition with Visual Effectscited by 34
  30. 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
  31. 2025Localized Concept Erasure for Text-to-Image Diffusion Models Using Training-Free Gated Low-Rank Adaptationcited by 33
  32. 2023Text-Driven Image Editing via Learnable Regionscited by 31
  33. 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
  34. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  35. 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generationcited by 30
  36. 2024DreamOmni: Unified Image Generation and Editingcited by 30
  37. 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 29
  38. 2024SeaS: Few-shot Industrial Anomaly Image Generation with Separation and Sharing Fine-tuningcited by 27

50 most cited of 117 All 117 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Local Prompt Adaptation for Style-Consistent Multi-Object Generation in Diffusion Models
  2. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models
  3. 2025ISAC: Training-Free Instance-to-Semantic Attention Control for Multi-Instance Generation
  4. 2023Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis
  5. 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer
  6. 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models
  7. 2026Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference
  8. 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generation