ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Subject-driven image generation has shown great success in creating personalized content, but its capabilities are largely confined to single subjects in common poses. Current approaches face a fundamental conflict when handling multiple subjects with complex, distinct actions: preserving individual identities while enforcing precise pose structures. This challenge often leads to identity fusion and pose distortion, as appearance and structure signals become entangled within the model's architecture. To resolve this conflict, we introduce ASTRA(Adaptive Synthesis through Targeted Retrieval Augmentation), a novel framework that architecturally disentangles subject appearance from pose structure within a unified Diffusion Transformer. ASTRA achieves this through a dual-pronged strategy. It first employs a Retrieval-Augmented Pose (RAG-Pose) pipeline to provide a clean, explicit structural prior from a curated database. Then, its core generative model learns to process these dual visual conditions using our Enhanced Universal Rotary Position Embedding (EURoPE), an asymmetric encoding mechanism that decouples identity tokens from spatial locations while binding pose tokens to the canvas. Concurrently, a Disentangled Semantic Modulation (DSM) adapter offloads the identity preservation task into the text conditioning stream. Extensive experiments demonstrate that our integrated approach achieves superior disentanglement. On our designed COCO-based complex pose benchmark, ASTRA achieves a new state-of-the-art in pose adherence, while maintaining high identity fidelity and text alignment in DreamBench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 41 of its 47 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
41 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024GPT-4o System Cardcited by 4,588
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
28 more
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2024OmniGen: Unified Image Generationcited by 394
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 137
- 2014Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)cited by 109
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2025DreamO: A Unified Framework for Image Customizationcited by 83
- 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Modelscited by 27
- 2025ImageRAG: Dynamic Image Retrieval for Reference-Guided Image Generationcited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation
- 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulation
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generation
- 2026MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation
- 2025DynASyn: Multi-Subject Personalization Enabling Dynamic Action Synthesis
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation