mlsanityData to 7 Oct 2026

An Efficient and Harmonized Framework for Balanced Cross-Domain Feature Integration

arXiv 2403.18461 ↗First posted 27 Mar 2024cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Despite significant advancements in image generation using advanced generative frameworks, cross-image integration of content and style remains a key challenge. Current generative models, while powerful, frequently depend on vague textual prompts to define styles--creating difficulties in balancing content semantics and style preservation. We propose a novel framework that utilizes customized models to learn style representations. It enhances content preservation through cross-model feature and attention modulation, leveraging the inherent semantic consistency across models. Additionally, we introduce fixed feature and adaptive attention fusion to achieve the desired balance between content and style. We further develop spatial (mask-guided localized) and temporal (multi-style compositional) multi-model combinations, enabling flexible fusion of models and styles. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in balancing content preservation and stylistic coherence.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 27 Mar 2024.

Builds on

33 of 50 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  9. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  10. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  11. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  12. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
21 more
  1. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  2. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  3. 2015A Neural Algorithm of Artistic Stylecited by 480
  4. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  5. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  6. 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
  7. 2018Image Generation from Scene Graphscited by 324
  8. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  9. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  10. 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMCcited by 216
  11. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
  12. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  13. 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
  14. 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 66
  15. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  16. 2024Visual Style Prompting with Swapping Self-Attentioncited by 62
  17. 2022Modeling Image Composition for Complex Scene Generationcited by 43
  18. 2023StyleAdapter: A Unified Stylized Image Generation Modelcited by 39
  19. 2022Composing Ensembles of Pre-trained Models via Iterative Consensuscited by 28
  20. 2023InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Advisercited by 17
  21. 2023Z^*: Zero-shot Style Transfer via Attention Rearrangementcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 1; 2026: 2.

7 papers.