Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation
Not on the map. Why?
Abstract (arXiv)
Despite recent advances in personalized image generation, existing models consistently fail to produce reliable multi-human scenes, often merging or losing facial identity. We present Ar2Can, a novel two-stage framework that disentangles spatial planning from identity rendering for multi-human generation. The Architect predicts structured layouts, specifying where each person should appear. The Artist then synthesizes photorealistic images, guided by a spatially-grounded face matching reward that combines Hungarian spatial alignment with identity similarity. This approach ensures faces are rendered at correct locations and faithfully preserve reference identities. We develop two Architect variants, seamlessly integrated with our diffusion-based Artist model. This is optimized via Group Relative Policy Optimization (GRPO) using compositional rewards for count accuracy, image quality, and identity matching. Evaluated on the MultiHuman-Testbench, Ar2Can achieves substantial improvements in both count accuracy and identity preservation, while maintaining high perceptual quality. Notably, our method achieves these results using primarily synthetic data, without requiring real multi-human images. Project page: https://qualcomm-ai-research.github.io/ar2can/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
35 of 45 references.
References · 35
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
23 more
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2024OmniGen: Unified Image Generationcited by 388
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 284
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2025DreamO: A Unified Framework for Image Customizationcited by 82
- 2023ChatPose: Chatting about 3D Human Posecited by 71
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 55
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
- 2025UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Rewardcited by 18
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 16
- 2017Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusioncited by 12
- 2024ID-Patch: Robust ID Association for Group Photo Personalizationcited by 11
- 2025MultiHuman-Testbench: Benchmarking Image Generation for Multiple Humanscited by 8
- 2025Resolving the Identity Crisis in Text-to-Image Generationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
- 2024CapHuman: Capture Your Moments in Parallel Universes
- 2026IdGlow: Dynamic Identity Modulation for Multi-Subject Generation
- 2024Fusion is all you need: Face Fusion for Customized Identity-Preserving Image Synthesis
- 2025Generating Synthetic Data via Augmentations for Improved Facial Resemblance in DreamBooth and InstantID
- 2026Photorealistic Novel View Synthesis of Human Faces using Next-Scale Transformers
- 2026PortraitGen: Exemplar-Driven GRPO with Dual-Reward Guidance for Photorealistic Portrait Generation
- 2026FaceSnap: Enhanced ID-fidelity Network for Tuning-free Portrait Customization