An Efficient and Harmonized Framework for Balanced Cross-Domain Feature Integration
Not on the map. Why?
Abstract (arXiv)
Despite significant advancements in image generation using advanced generative frameworks, cross-image integration of content and style remains a key challenge. Current generative models, while powerful, frequently depend on vague textual prompts to define styles--creating difficulties in balancing content semantics and style preservation. We propose a novel framework that utilizes customized models to learn style representations. It enhances content preservation through cross-model feature and attention modulation, leveraging the inherent semantic consistency across models. Additionally, we introduce fixed feature and adaptive attention fusion to achieve the desired balance between content and style. We further develop spatial (mask-guided localized) and temporal (multi-style compositional) multi-model combinations, enabling flexible fusion of models and styles. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in balancing content preservation and stylistic coherence.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 27 Mar 2024.
Builds on
33 of 50 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
21 more
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
- 2018Image Generation from Scene Graphscited by 324
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 216
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 66
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
- 2024Visual Style Prompting with Swapping Self-Attentioncited by 62
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2023StyleAdapter: A Unified Stylized Image Generation Modelcited by 39
- 2022Composing Ensembles of Pre-trained Models via Iterative Consensuscited by 28
- 2023InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Advisercited by 17
- 2023Z^*: Zero-shot Style Transfer via Attention Rearrangementcited by 17
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 2.
7 papers.
- 2024A Survey on LoRA of Large Language Modelscited by 67
- 2024Unified Parameter-Efficient Unlearning for LLMscited by 24
- 2025SplitFlux: Learning to Decouple Content and Style from a Single Imagecited by 5
- 2024Training-free Color-Style Disentanglement for Constrained Text-to-Image Synthesiscited by 4
- 2024From Noise to Nuance: Advances in Deep Generative Image Modelscited by 3
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfercited by 1
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfercited by 0
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer14 Apr 2026
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer16 Feb 2026
- 2025SplitFlux: Learning to Decouple Content and Style from a Single Image19 Nov 2025
- 2024From Noise to Nuance: Advances in Deep Generative Image Models12 Dec 2024
- 2024Unified Parameter-Efficient Unlearning for LLMs30 Nov 2024
- 2024Training-free Color-Style Disentanglement for Constrained Text-to-Image Synthesis4 Sep 2024
- 2024A Survey on LoRA of Large Language Models8 Jul 2024