mlsanityData to 14 Oct 2026

DCoAR: Deep Concept Injection into Unified Autoregressive Models for Personalized Text-to-Image Generation

arXiv 2508.07341 ↗First posted 10 Aug 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The unified autoregressive (AR) model excels at multimodal understanding and generation. However, its full potential in the domain of customized image generation has yet to be fully realized. Existing customization approaches for unified AR models face a fundamental dilemma: adaptation-based methods suffer from overfitting and scalability bottlenecks, while concept-injection paradigms are constrained by a shallow injection strategy that leads to poor visual fidelity and impaired re-contextualization. To address this, we propose DCoAR, a novel deep concept injection framework that maintains a completely frozen pre-trained model. DCoAR deeply integrates new concepts through a Layer-wise Multimodal Context Learning (LMCL) strategy, which is stabilized by a multi-faceted regularization scheme: a Dual Prior Preservation (DPP) loss to mitigate semantic drift and a Context-Aware Self-Regularization (CASR) loss to enhance re-contextualization. The framework also enables training-free subject customization in user-provided styles. Experiments demonstrate that DCoAR significantly outperforms previous injection-based methods and achieves performance competitive with adaptation-based approaches while requiring substantially fewer trainable parameters. Code: https://github.com/KZF-kzf/CoAR

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 48 references that are in the map. First posted on arXiv 10 Aug 2025.

Builds on

41 of 48 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
29 more
  1. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  2. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  3. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  4. 2016Pixel Recurrent Neural Networkscited by 816
  5. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  6. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  7. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  8. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  9. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  10. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
  11. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  12. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  13. 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 150
  14. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  15. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  16. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
  17. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
  18. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  19. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
  20. 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 37
  21. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  22. 2025YoChameleon: Personalized Vision and Language Generationcited by 20
  23. 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generationcited by 13
  24. 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformerscited by 11
  25. 2023A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidancecited by 10
  26. 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6
  27. 2025Personalized Text-to-Image Generation with Auto-Regressive Modelscited by 6
  28. 2025FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalizationcited by 5
  29. 2025StyleAR: Customizing Multimodal Autoregressive Model for Style-Aligned Text-to-Image Generationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.