TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Current text-conditioned diffusion editors handle single object replacement well but struggle when a new object and a new style must be introduced simultaneously. We present Twin-Prompt Attention Blend (TP-Blend), a lightweight training-free framework that receives two separate textual prompts, one specifying a blend object and the other defining a target style, and injects both into a single denoising trajectory. TP-Blend is driven by two complementary attention processors. Cross-Attention Object Fusion (CAOF) first averages head-wise attention to locate spatial tokens that respond strongly to either prompt, then solves an entropy-regularised optimal transport problem that reassigns complete multi-head feature vectors to those positions. CAOF updates feature vectors at the full combined dimensionality of all heads (e.g., 640 dimensions in SD-XL), preserving rich cross-head correlations while keeping memory low. Self-Attention Style Fusion (SASF) injects style at every self-attention layer through Detail-Sensitive Instance Normalization. A lightweight one-dimensional Gaussian filter separates low- and high-frequency components; only the high-frequency residual is blended back, imprinting brush-stroke-level texture without disrupting global geometry. SASF further swaps the Key and Value matrices with those derived from the style prompt, enforcing context-aware texture modulation that remains independent of object fusion. Extensive experiments show that TP-Blend produces high-resolution, photo-realistic edits with precise control over both content and appearance, surpassing recent baselines in quantitative fidelity, perceptual quality, and inference speed.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 176 of its 193 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
176 of 193 references.
Closest ancestors · 59
Same direction, newest first
- 2025Grouped Speculative Decoding for Autoregressive Image Generation11 Aug
- 2025Devil is in the Detail: Towards Injecting Fine Details of Image Prompt in Image Generation via Conflict-free Guidance and Stratified Attention4 Aug
- 2025Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesis28 Jul
- 2025FairHuman: Boosting Hand and Face Quality in Human Image Generation with Minimum Potential Delay Fairness in Diffusion Models3 Jul
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025Fair Generation without Unfair Distortions: Debiasing Text-to-Image Generation with Entanglement-Free Attention16 Jun
- 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation4 Jun
- 2025One-Way Ticket:Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion Models28 May
- 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesis15 May
- 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning10 Apr
- 2025Concept Lancet: Image Editing with Compositional Representation Transplant3 Apr
38 more
- 2025Multi-party Collaborative Attention Control for Image Customization2 Apr
- 2025Spatial Transport Optimization by Repositioning Attention Map for Training-Free Text-to-Image Synthesis28 Mar
- 2025Scaling Down Text Encoders of Text-to-Image Diffusion Models25 Mar
- 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model25 Mar
- 2025FDS: Frequency-Aware Denoising Score for Text-Guided Latent Diffusion Image Editing24 Mar
- 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing16 Mar
- 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transform4 Mar
- 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models3 Mar
- 2025Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Think27 Feb
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models20 Feb
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation17 Feb
- 2025One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt23 Jan
- 2024Dual Diffusion for Unified Image Generation and Understanding31 Dec
- 2024Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generation25 Dec
- 2024UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation25 Dec
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec
- 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training12 Dec
- 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformers12 Dec
- 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion5 Dec
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation5 Dec
- 2024Self-Cross Diffusion Guidance for Text-to-Image Synthesis of Similar Subjects28 Nov
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generation27 Nov
- 2024Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis25 Nov
- 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov
- 2024SeedEdit: Align Image Re-Generation to Image Editing11 Nov
- 2024Minority-Focused Text-to-Image Generation via Prompt Optimization10 Oct
- 2024OmniGen: Unified Image Generation17 Sep
- 2024IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation12 Sep
- 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
- 2024Rethinking Training for De-biasing Text-to-Image Generation: Unlocking the Potential of Stable Diffusion22 Aug
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
- 2024LLM4GEN: Leveraging Semantic Representation of LLMs for Text-to-Image Generation30 Jun
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objects14 Jun
- 2024FreeTuner: Any Subject in Any Style with Training-free Diffusion23 May
- 2024SemanticDraw: Towards Real-Time Interactive Content Creation from Image Diffusion Models14 Mar
- 2024Text2Street: Controllable Text-to-image Generation for Street Views7 Feb
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
- 2023Fair Text-to-Image Diffusion via Fair Mapping29 Nov
50 newest of 59 All 59 (JSON)
Other references · 117
- 2017Attention Is All You Needcited by 60,361
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
38 more
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2023Style Aligned Image Generation via Shared Attentioncited by 216
- 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2016Stochastic Optimization for Large-scale Optimal Transportcited by 189
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2023Expressive Text-to-Image Generation with Rich Textcited by 89
- 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 71
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
- 2025GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generationcited by 57
- 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generationcited by 56
- 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 53
- 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2024OSV: One Step is Enough for High-Quality Image to Video Generationcited by 36
- 2024Language-Guided Image Tokenization for Generationcited by 36
- 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
- 2024Generative Image Layer Decomposition with Visual Effectscited by 34
- 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
- 2025Localized Concept Erasure for Text-to-Image Diffusion Models Using Training-Free Gated Low-Rank Adaptationcited by 33
- 2023Text-Driven Image Editing via Learnable Regionscited by 31
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generationcited by 30
- 2024DreamOmni: Unified Image Generation and Editingcited by 30
- 2024SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Modelscited by 29
- 2024SeaS: Few-shot Industrial Anomaly Image Generation with Separation and Sharing Fine-tuningcited by 27
50 most cited of 117 All 117 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devicescited by 3
- 2026AUHead: Realistic Emotional Talking Head Generation via Action Units Controlcited by 1
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effectscited by 0
- 2026Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentationcited by 0
- 2026Delta-K: Boosting Multi-Instance Generation via Cross-Attention Augmentation10 Mar 2026
- 2026AUHead: Realistic Emotional Talking Head Generation via Action Units Control10 Feb 2026
- 2026A Unified and Controllable Framework for Layered Image Generation with Visual Effects21 Jan 2026
- 2026SnapGen++: Unleashing Diffusion Transformers for Efficient High-Fidelity Image Generation on Edge Devices13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Local Prompt Adaptation for Style-Consistent Multi-Object Generation in Diffusion Models
- 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models
- 2025ISAC: Training-Free Instance-to-Semantic Attention Control for Multi-Instance Generation
- 2023Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Models
- 2026Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference
- 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generation