FlexIP: Dynamic Control of Preservation and Personality for Customized Image Generation
Not on the map. Why?
Abstract (arXiv)
With the rapid advancement of 2D generative models, preserving subject identity while enabling diverse editing has emerged as a critical research focus. Existing methods typically face inherent trade-offs between identity preservation and personalized manipulation. We introduce FlexIP, a novel framework that decouples these objectives through two dedicated components: a Personalization Adapter for stylistic manipulation and a Preservation Adapter for identity maintenance. By explicitly injecting both control mechanisms into the generative model, our framework enables flexible parameterized control during inference through dynamic tuning of the weight adapter. Experimental results demonstrate that our approach breaks through the performance limitations of conventional methods, achieving superior identity preservation while supporting more diverse personalized generation capabilities (Project Page: https://flexip-tech.github.io/flexip/).
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 62 of its 63 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
62 of 63 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesiscited by 6
- 2025From Competition to Synergy: Unlocking Reinforcement Learning for Subject-Driven Image Generationcited by 4
- 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generationcited by 3
- 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation9 Mar 2026
- 2025From Competition to Synergy: Unlocking Reinforcement Learning for Subject-Driven Image Generation21 Oct 2025
- 2025Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis29 May 2025