mlsanityData to 14 Oct 2026

FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining

arXiv 2606.20506 ↗First posted 18 Jun 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Style-content dual-reference generation aims to synthesize an image that preserves the structure and semantics of a content reference while adopting the style of a separate style reference.Despite recent progress, this setting remains challenging because models must balance content fidelity, style alignment, and instruction following avoiding semantic leakage from the style reference.A key bottleneck is the lack of large-scale triplet data with clean content-style separation and broad long-tail style coverage.In this work, we propose FreeStyle, a scalable dual-reference generation framework based on community LoRA mining.We treat community LoRAs as compositional anchors for style and content, and design a rigorous generation and filtering pipeline to construct large-scale Style-Reference and Content-Reference triplets across multiple base models.To address content leakage, we adopt a two-stage curriculum with stage-specific disentanglement mechanisms: an attention-level enrichment constraint that suppresses style-reference leakage in the style-transfer stage, and a frequency-aware RoPE modulation strategy that targets positional-correspondence-based leakage in the harder dual-reference stage.We also introduce a benchmark covering both style-reference and dual-reference generation, with evaluations on style similarity, content preservation, aesthetics, instruction following, and leakage rejection. The benchmark incorporates a style-invariant Content Alignment Score (CAS) and introduces a calibrated VLM-based Rejection Score for evaluating generation reliability and leakage suppression.Extensive experiments show that our model achieves a strong balance among style alignment, content preservation, and leakage suppression.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 73 of its 116 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

73 of 116 references.

References · 73

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  10. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
38 more
  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  13. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  14. 2025Qwen3-VL Technical Reportcited by 2,793
  15. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  16. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  17. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  18. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  19. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  20. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  21. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  22. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  23. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  24. 2025Qwen-Image Technical Reportcited by 1,044
  25. 2017Universal Style Transfer via Feature Transformscited by 354
  26. 2016A Learned Representation For Artistic Stylecited by 341
  27. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  28. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  29. 2023Style Aligned Image Generation via Shared Attentioncited by 216
  30. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  31. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
  32. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
  33. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  34. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  35. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  36. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
  37. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
  38. 2017Deep Photo Style Transfercited by 168

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026UniCSG: Unified High-Fidelity Content-Constrained Style-Driven Generation via Staged Semantic and Frequency Disentanglement
  2. 2026CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfer
  3. 2024A LoRA is Worth a Thousand Pictures
  4. 2025SCAdapter: Content-Style Disentanglement for Diffusion Style Transfer
  5. 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation
  6. 2024Style-Friendly SNR Sampler for Style-Driven Generation
  7. 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models
  8. 2025Expanding the Content-Style Frontier: a Balanced Subspace Blending Approach for Content-Style LoRA Fusion