FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining
Not on the map. Why?
Abstract (arXiv)
Style-content dual-reference generation aims to synthesize an image that preserves the structure and semantics of a content reference while adopting the style of a separate style reference.Despite recent progress, this setting remains challenging because models must balance content fidelity, style alignment, and instruction following avoiding semantic leakage from the style reference.A key bottleneck is the lack of large-scale triplet data with clean content-style separation and broad long-tail style coverage.In this work, we propose FreeStyle, a scalable dual-reference generation framework based on community LoRA mining.We treat community LoRAs as compositional anchors for style and content, and design a rigorous generation and filtering pipeline to construct large-scale Style-Reference and Content-Reference triplets across multiple base models.To address content leakage, we adopt a two-stage curriculum with stage-specific disentanglement mechanisms: an attention-level enrichment constraint that suppresses style-reference leakage in the style-transfer stage, and a frequency-aware RoPE modulation strategy that targets positional-correspondence-based leakage in the harder dual-reference stage.We also introduce a benchmark covering both style-reference and dual-reference generation, with evaluations on style similarity, content preservation, aesthetics, instruction following, and leakage rejection. The benchmark incorporates a style-invariant Content Alignment Score (CAS) and introduces a calibrated VLM-based Rejection Score for evaluating generation reliability and leakage suppression.Extensive experiments show that our model achieves a strong balance among style alignment, content preservation, and leakage suppression.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 73 of its 116 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
73 of 116 references.
References · 73
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
38 more
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2025Qwen-Image Technical Reportcited by 1,044
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2016A Learned Representation For Artistic Stylecited by 341
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2023Style Aligned Image Generation via Shared Attentioncited by 216
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2021StyTr2: Image Style Transfer with Transformerscited by 187
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
- 2017Deep Photo Style Transfercited by 168
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026UniCSG: Unified High-Fidelity Content-Constrained Style-Driven Generation via Staged Semantic and Frequency Disentanglement
- 2026CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfer
- 2024A LoRA is Worth a Thousand Pictures
- 2025SCAdapter: Content-Style Disentanglement for Diffusion Style Transfer
- 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation
- 2024Style-Friendly SNR Sampler for Style-Driven Generation
- 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models
- 2025Expanding the Content-Style Frontier: a Balanced Subspace Blending Approach for Content-Style LoRA Fusion