mlsanityData to 7 Oct 2026

AnyDoor: Zero-shot Object-level Image Customization

arXiv 2307.09481 ↗First posted 18 Jul 2023cs.CVcited by 411

On the map: Diffusion models → Video generation

Abstract (arXiv)

This work presents AnyDoor, a diffusion-based image generator with the power to teleport target objects to new scenes at user-specified locations in a harmonious way. Instead of tuning parameters for each object, our model is trained only once and effortlessly generalizes to diverse object-scene combinations at the inference stage. Such a challenging zero-shot setting requires an adequate characterization of a certain object. To this end, we complement the commonly used identity feature with detail features, which are carefully designed to maintain texture details yet allow versatile local variations (e.g., lighting, orientation, posture, etc.), supporting the object in favorably blending with different surroundings. We further propose to borrow knowledge from video datasets, where we can observe various forms (i.e., along the time axis) of a single object, leading to stronger model generalizability and robustness. Extensive experiments demonstrate the superiority of our approach over existing alternatives as well as its great potential in real-world applications, such as virtual try-on and object moving. Project page is https://damo-vilab.github.io/AnyDoor-Page/.

Key facts. Cited by 411 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 52 of its 70 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

52 of 70 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2023Segment Anythingcited by 8,158
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  3. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  5. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  6. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  7. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  8. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  9. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  10. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  11. 2019Video Instance Segmentationcited by 391
  12. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  13. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  14. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  15. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  16. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  17. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
  18. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  19. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  20. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  21. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  22. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  23. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  24. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197
  25. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  26. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  27. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 134
  28. 2021Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentationcited by 133
  29. 2015Salient Object Detection: A Benchmarkcited by 130
  30. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Modelscited by 116
  31. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
  32. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
  33. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  34. 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
  35. 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
  36. 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
  37. 2023DreamEdit: Subject-driven Image Editingcited by 37
  38. 2023Collage Diffusioncited by 33

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 21; 2024: 167; 2025: 148; 2026: 75.

411 papers.

Sort:

By area:

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2025VACE: All-in-One Video Creation and Editingcited by 467
  3. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  4. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  5. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  6. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  7. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  8. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
  9. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
  10. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  11. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  12. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
38 more
  1. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  2. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
  3. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  4. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
  5. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  6. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
  7. 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
  8. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
  9. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
  10. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 99
  11. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  12. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  13. 2023VideoLCM: Video Latent Consistency Modelcited by 90
  14. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  15. 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
  16. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 67
  17. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  18. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
  19. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  20. 2024Zero-shot Image Editing with Reference Imitationcited by 64
  21. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  22. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  23. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
  24. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
  25. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  26. 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
  27. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  28. 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
  29. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  30. 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
  31. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  32. 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 46
  33. 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
  34. 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
  35. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  36. 2024DiP-GO: A Diffusion Pruner via Few-step Gradient Optimizationcited by 43
  37. 2024Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditionscited by 42
  38. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42

50 most cited of 411 All 411 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025ANYPORTAL: Zero-Shot Consistent Video Background Replacement
  2. 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image
  3. 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation
  4. 2025DreamInsert: Zero-Shot Image-to-Video Object Insertion from A Single Image
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Object
  6. 2024LoMOE: Localized Multi-Object Editing via Multi-Diffusion
  7. 2025Conditional Latent Diffusion Models for Zero-Shot Instance Segmentation
  8. 2024Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation