DCoAR: Deep Concept Injection into Unified Autoregressive Models for Personalized Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
The unified autoregressive (AR) model excels at multimodal understanding and generation. However, its full potential in the domain of customized image generation has yet to be fully realized. Existing customization approaches for unified AR models face a fundamental dilemma: adaptation-based methods suffer from overfitting and scalability bottlenecks, while concept-injection paradigms are constrained by a shallow injection strategy that leads to poor visual fidelity and impaired re-contextualization. To address this, we propose DCoAR, a novel deep concept injection framework that maintains a completely frozen pre-trained model. DCoAR deeply integrates new concepts through a Layer-wise Multimodal Context Learning (LMCL) strategy, which is stabilized by a multi-faceted regularization scheme: a Dual Prior Preservation (DPP) loss to mitigate semantic drift and a Context-Aware Self-Regularization (CASR) loss to enhance re-contextualization. The framework also enables training-free subject customization in user-provided styles. Experiments demonstrate that DCoAR significantly outperforms previous injection-based methods and achieves performance competitive with adaptation-based approaches while requiring substantially fewer trainable parameters. Code: https://github.com/KZF-kzf/CoAR
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 10 Aug 2025.
Builds on
41 of 48 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
29 more
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2016Pixel Recurrent Neural Networkscited by 816
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
- 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 37
- 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
- 2025YoChameleon: Personalized Vision and Language Generationcited by 20
- 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generationcited by 13
- 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformerscited by 11
- 2023A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidancecited by 10
- 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6
- 2025Personalized Text-to-Image Generation with Auto-Regressive Modelscited by 6
- 2025FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalizationcited by 5
- 2025StyleAR: Customizing Multimodal Autoregressive Model for Style-Aligned Text-to-Image Generationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.