mlsanityData to 14 Oct 2026

AlbumFill: Album-Guided Reasoning and Retrieval for Personalized Image Completion

arXiv 2605.02892 ↗First posted 4 May 2026cs.CV cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Personalized image completion aims to restore occluded regions in personal photos while preserving identity and appearance. Existing methods either rely on generic inpainting models that often fail to maintain identity consistency, or assume that suitable reference images are explicitly provided. In practice, suitable references are often not explicitly provided, requiring the system to search for identity-consistent images within personal photo collections. We present AlbumFill, a training-free framework that retrieves identity-consistent references from personal albums for personalized completion. Given an occluded image and a personal album, a vision-language model infers missing semantic cues to guide composed image retrieval, and the retrieved references are used by reference-based completion models. To facilitate this task, we introduce a dataset containing 54K human-centric samples with associated album images. Experiments across multiple baselines demonstrate the difficulty of personalized completion and highlight the importance of identity-consistent reference retrieval. Project Page: https://liagm.github.io/AlbumFill/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

50 of 60 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2025Qwen3 Technical Reportcited by 8,820
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  11. 2025Qwen2.5-VL Technical Reportcited by 5,587
  12. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
38 more
  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  8. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  9. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  11. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  12. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  13. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  14. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  15. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  16. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  17. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  18. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  19. 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 176
  20. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
  21. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
  22. 2023Vision-by-Language for Training-Free Compositional Image Retrievalcited by 103
  23. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  24. 2024Zero-shot Image Editing with Reference Imitationcited by 65
  25. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
  26. 2023Context-I2W: Mapping Images to Context-dependent Words for Accurate Zero-Shot Composed Image Retrievalcited by 52
  27. 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
  28. 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
  29. 2024Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrievalcited by 36
  30. 2024Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrievalcited by 32
  31. 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25
  32. 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
  33. 2023Training-free Zero-shot Composed Image Retrieval with Local Concept Rerankingcited by 23
  34. 2025Fine-grained Textual Inversion Network for Zero-Shot Composed Image Retrievalcited by 18
  35. 2024SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editingcited by 13
  36. 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editingcited by 10
  37. 2015Person Recognition in Personal Photo Collectionscited by 3
  38. 2025CompleteMe: Reference-based Human Image Completioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval
  2. 2026MultiCompose: Multi-Concept Personalized Composition with Per-Subject Attribute Binding
  3. 2025SynergyAmodal: Deocclude Anything with Text Control
  4. 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigm
  5. 2023Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR
  6. 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprints
  7. 2025IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
  8. 2025From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusion