mlsanityData to 14 Oct 2026

SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generation

arXiv 2312.16272 ↗First posted 26 Dec 2023cs.CVcited by 143

Not on the map. Why?

Cited by 59 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advancements in subject-driven image generation have led to zero-shot generation, yet precise selection and focus on crucial subject representations remain challenging. Addressing this, we introduce the SSR-Encoder, a novel architecture designed for selectively capturing any subject from single or multiple reference images. It responds to various query modalities including text and masks, without necessitating test-time fine-tuning. The SSR-Encoder combines a Token-to-Patch Aligner that aligns query inputs with image patches and a Detail-Preserving Subject Encoder for extracting and preserving fine features of the subjects, thereby generating subject embeddings. These embeddings, used in conjunction with original text embeddings, condition the generation process. Characterized by its model generalizability and efficiency, the SSR-Encoder adapts to a range of custom models and control modules. Enhanced by the Embedding Consistency Regularization Loss for improved training, our extensive experiments demonstrate its effectiveness in versatile and high-quality image generation, indicating its broad applicability. Project page: https://ssr-encoder.github.io

Key facts. Cited by 143 papers in the map (data through 14 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 26 Dec 2023.

Builds on

49 of 59 references.

References · 49

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
37 more
  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  13. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  14. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  15. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  16. 2023Vision Transformers Need Registerscited by 871
  17. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  18. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  19. 2021Extract Free Dense Labels from CLIPcited by 583
  20. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  21. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  22. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  23. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  24. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  25. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
  26. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  27. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  28. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  29. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
  30. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
  31. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  32. 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 142
  33. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Modelscited by 117
  34. 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 78
  35. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
  36. 2023Real-World Image Variation by Aligning Diffusion Inversion Chaincited by 37
  37. 2023Pluralistic Aging Diffusion Autoencodercited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 40; 2025: 72; 2026: 31.

143 papers.

Sort:

By area:

  1. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  2. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  3. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  4. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  5. 2025Controllable Video Generation: A Surveycited by 98
  6. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
  7. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  8. 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 57
  9. 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Spacecited by 51
  10. 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
  11. 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Modelcited by 45
  12. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
38 more
  1. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  2. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  3. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  4. 2024EditWorld: Simulating World Dynamics for Instruction-Following Image Editingcited by 38
  5. 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 37
  6. 2024MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesiscited by 35
  7. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
  8. 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
  9. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  10. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
  11. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  12. 2024StableGarment: Garment-Centric Generation via Stable Diffusioncited by 27
  13. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  14. 2025USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learningcited by 27
  15. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 26
  16. 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformerscited by 26
  17. 2024FreeTuner: Any Subject in Any Style with Training-free Diffusioncited by 24
  18. 2025All Patches Matter, More Patches Better: Enhance AI-Generated Image Detection via Panoptic Patch Learningcited by 24
  19. 2025Personalize Anything for Free with Diffusion Transformercited by 23
  20. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  21. 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 22
  22. 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
  23. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  24. 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
  25. 2024From Parts to Whole: A Unified Reference Framework for Controllable Human Image Generationcited by 17
  26. 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
  27. 2025AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generationcited by 16
  28. 2025RealGeneral: Unifying Visual Generation via Temporal In-Context Learning with Video Modelscited by 16
  29. 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
  30. 2024EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Promptscited by 14
  31. 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
  32. 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 14
  33. 2025GRE Suite: Geo-localization Inference via Fine-Tuned Vision-Language Models and Enhanced Reasoning Chainscited by 14
  34. 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
  35. 2024CustomContrast: A Multilevel Contrastive Perspective For Subject-Driven Text-to-Image Customizationcited by 13
  36. 2024GroundingBooth: Grounding Text-to-Image Customizationcited by 13
  37. 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
  38. 2025OmniPSD: Layered PSD Generation with Diffusion Transformercited by 13

50 most cited of 143 All 143 (JSON)