Omni-Attribute: Open-vocabulary Attribute Encoder for Visual Concept Personalization
Not on the map. Why?
Abstract (arXiv)
Visual concept personalization aims to transfer only specific image attributes, such as identity, expression, lighting, and style, into unseen contexts. However, existing methods rely on holistic embeddings from general-purpose image encoders, which entangle multiple visual factors and make it difficult to isolate a single attribute. This often leads to information leakage and incoherent synthesis. To address this limitation, we introduce Omni-Attribute, the first open-vocabulary image attribute encoder designed to learn high-fidelity, attribute-specific representations. Our approach jointly designs the data and model: (i) we curate semantically linked image pairs annotated with positive and negative attributes to explicitly teach the encoder what to preserve or suppress; and (ii) we adopt a dual-objective training paradigm that balances generative fidelity with contrastive disentanglement. The resulting embeddings prove effective for open-vocabulary attribute retrieval, personalization, and compositional generation, achieving state-of-the-art performance across multiple benchmarks.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 63 of its 76 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
63 of 76 references.
References · 63
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
38 more
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2025DINOv3cited by 1,297
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2024OmniGen: Unified Image Generationcited by 388
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2024LoRA vs Full Fine-tuning: An Illusion of Equivalencecited by 102
- 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
- 2022Disentangling Visual Embeddings for Attributes and Objectscited by 55
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ID-Sim: An Identity-Focused Similarity Metriccited by 0
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generationcited by 0
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metriccited by 0
- 2026Kernel-Based Steering of CLIP with Vision-Language Model Preferencescited by 0
- 2026Kernel-Based Steering of CLIP with Vision-Language Model Preferences26 Sep 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation11 Jun 2026
- 2026ID-Sim: An Identity-Focused Similarity Metric6 Apr 2026