mlsanityData to 14 Oct 2026

FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus

arXiv 2509.01181 ↗First posted 1 Sep 2025cs.CV cs.AIcited by 3

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects remains challenging due to difficulties in preserving subject fidelity and preventing cross-subject attribute leakage. We present FocusDPO, a framework that adaptively identifies focus regions based on dynamic semantic correspondence and supervision image complexity. During training, our method progressively adjusts these focal areas across noise timesteps, implementing a weighted strategy that rewards information-rich patches while penalizing regions with low prediction confidence. The framework dynamically adjusts focus allocation during the DPO process according to the semantic complexity of reference images and establishes robust correspondence mappings between generated and reference subjects. Extensive experiments demonstrate that our method substantially enhances the performance of existing pre-trained personalized generation models, achieving state-of-the-art results on both single-subject and multi-subject personalized image synthesis benchmarks. Our method effectively mitigates attribute leakage while preserving superior subject fidelity across diverse generation scenarios, advancing the frontier of controllable multi-subject image synthesis.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 38 of its 42 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

38 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
  2. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewards29 Sep
  3. 2023Aligning Text-to-Image Models using Human Feedback23 Feb

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  9. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
23 more
  1. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  3. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  4. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 450
  5. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  6. 2024OmniGen: Unified Image Generationcited by 394
  7. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  8. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  9. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  10. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  11. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  12. 2024In-Context LoRA for Diffusion Transformerscited by 158
  13. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  14. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  15. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  16. 2024Token-level Direct Preference Optimizationcited by 135
  17. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  18. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
  19. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  20. 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customizationcited by 39
  21. 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
  22. 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
  23. 2025D2iT: Dynamic Diffusion Transformer for Accurate Image Generationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FOCUS: Optimal Control for Multi-Entity World Modeling in Text-to-Image Generation
  2. 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
  3. 2025DynASyn: Multi-Subject Personalization Enabling Dynamic Action Synthesis
  4. 2025Multi-party Collaborative Attention Control for Image Customization
  5. 2025PSR: Scaling Multi-Subject Personalized Image Generation with Pairwise Subject-Consistency Rewards
  6. 2026SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusion
  7. 2024DreamBlend: Advancing Personalized Fine-tuning of Text-to-Image Diffusion Models
  8. 2026Redirecting the Flow: Image Customization through Attention Distribution Shift