FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects remains challenging due to difficulties in preserving subject fidelity and preventing cross-subject attribute leakage. We present FocusDPO, a framework that adaptively identifies focus regions based on dynamic semantic correspondence and supervision image complexity. During training, our method progressively adjusts these focal areas across noise timesteps, implementing a weighted strategy that rewards information-rich patches while penalizing regions with low prediction confidence. The framework dynamically adjusts focus allocation during the DPO process according to the semantic complexity of reference images and establishes robust correspondence mappings between generated and reference subjects. Extensive experiments demonstrate that our method substantially enhances the performance of existing pre-trained personalized generation models, achieving state-of-the-art results on both single-subject and multi-subject personalized image synthesis benchmarks. Our method effectively mitigates attribute leakage while preserving superior subject fidelity across diverse generation scenarios, advancing the frontier of controllable multi-subject image synthesis.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 38 of its 42 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
38 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewards29 Sep
- 2023Aligning Text-to-Image Models using Human Feedback23 Feb
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
23 more
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 450
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024OmniGen: Unified Image Generationcited by 394
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2024Token-level Direct Preference Optimizationcited by 135
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customizationcited by 39
- 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2025D2iT: Dynamic Diffusion Transformer for Accurate Image Generationcited by 9
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Scaling Multi-Reference Image Generation with Dynamic Reward Optimizationcited by 3
- 2026Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimizationcited by 0
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026Scaling Multi-Reference Image Generation with Dynamic Reward Optimization25 Jun 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025FOCUS: Optimal Control for Multi-Entity World Modeling in Text-to-Image Generation
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
- 2025DynASyn: Multi-Subject Personalization Enabling Dynamic Action Synthesis
- 2025Multi-party Collaborative Attention Control for Image Customization
- 2025PSR: Scaling Multi-Subject Personalized Image Generation with Pairwise Subject-Consistency Rewards
- 2026SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusion
- 2024DreamBlend: Advancing Personalized Fine-tuning of Text-to-Image Diffusion Models
- 2026Redirecting the Flow: Image Customization through Attention Distribution Shift