Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes
Not on the map. Why?
Abstract (arXiv)
Despite recent progress, text-to-image models still struggle to generate semantically diverse and compositionally accurate multi-person interaction scenes, often collapsing to repetitive layouts, stereotypical poses, and poorly grounded interactions. In this work, we bridge this gap by introducing a dual pose-image representation that brings person-centric structural priors into pretrained diffusion transformers. Our model jointly predicts a 2D pose visualization image and its corresponding RGB image, enabling structure and appearance to co-evolve during learning. At its core, a cross-modal alignment scheme binds text, pose, and image representations, ensuring consistent grounding across modalities. Furthermore, we design an iterative scene construction scheme, progressively generating complex multi-human interactions while effectively decomposing the overall generation complexity. Extensive experiments demonstrate that our method substantially improves prompt alignment and scene diversity in multi-person image generation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 73 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
47 of 73 references.
References · 47
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
35 more
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 142
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
- 2021Lite-HRNet: A Lightweight High-Resolution Networkcited by 91
- 2023ChatPose: Chatting about 3D Human Posecited by 72
- 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generationcited by 69
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
- 2025Boosting Generative Image Modeling via Joint Image-Feature Synthesiscited by 45
- 2024StableGarment: Garment-Centric Generation via Stable Diffusioncited by 27
- 2024GrounDiT: Grounding Diffusion Transformers via Noisy Patch Transplantationcited by 24
- 2023JointNet: Extending Text-to-Image Diffusion for Dense Distribution Modelingcited by 23
- 2024RealCompo: Balancing Realism and Compositionality Improves Text-to-Image Diffusion Modelscited by 18
- 2024UniPose: A Unified Multimodal Framework for Human Pose Comprehension, Generation and Editingcited by 18
- 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generationcited by 17
- 2023Multi-Concept T2I-Zero: Tweaking Only The Text Embeddings and Nothing Elsecited by 13
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generationcited by 12
- 2025Scaling Group Inference for Diverse and High-Quality Generationcited by 12
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformerscited by 11
- 2022What's in a Decade? Transforming Faces Through Timecited by 9
- 2025MultiHuman-Testbench: Benchmarking Image Generation for Multiple Humanscited by 8
- 2025VerbDiff: Text-Only Diffusion Models with Enhanced Interaction Awarenesscited by 7
- 2025LOTS of Fashion! Multi-Conditioning for Image Generation via Sketch-Text Pairingcited by 7
- 2025InstanceGen: Image Generation with Instance-level Instructionscited by 6
- 2025HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusioncited by 5
- 2023Learning Human-Human Interactions in Images from Weak Textual Supervisioncited by 3
- 2024PersonaCraft: Personalized and Controllable Full-Body Multi-Human Scene Generation Using Occlusion-Aware 3D-Conditioned Diffusioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Person Interaction Generation from Two-Person Motion Priors
- 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animation
- 2023GenZI: Zero-Shot 3D Human-Scene Interaction Generation
- 2022HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generation
- 2024Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer
- 2025Learning to Generate Human-Human-Object Interactions from Textual Descriptions
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
- 2025Multi-identity Human Image Animation with Structural Video Diffusion