mlsanityData to 14 Oct 2026

ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding

arXiv 2604.13938 ↗First posted 15 Apr 2026cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Subject-driven image generation has shown great success in creating personalized content, but its capabilities are largely confined to single subjects in common poses. Current approaches face a fundamental conflict when handling multiple subjects with complex, distinct actions: preserving individual identities while enforcing precise pose structures. This challenge often leads to identity fusion and pose distortion, as appearance and structure signals become entangled within the model's architecture. To resolve this conflict, we introduce ASTRA(Adaptive Synthesis through Targeted Retrieval Augmentation), a novel framework that architecturally disentangles subject appearance from pose structure within a unified Diffusion Transformer. ASTRA achieves this through a dual-pronged strategy. It first employs a Retrieval-Augmented Pose (RAG-Pose) pipeline to provide a clean, explicit structural prior from a curated database. Then, its core generative model learns to process these dual visual conditions using our Enhanced Universal Rotary Position Embedding (EURoPE), an asymmetric encoding mechanism that decouples identity tokens from spatial locations while binding pose tokens to the canvas. Concurrently, a Disentangled Semantic Modulation (DSM) adapter offloads the identity preservation task into the text conditioning stream. Extensive experiments demonstrate that our integrated approach achieves superior disentanglement. On our designed COCO-based complex pose benchmark, ASTRA achieves a new state-of-the-art in pose adherence, while maintaining high identity fidelity and text alignment in DreamBench.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 41 of its 47 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

41 of 47 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generator29 Sep

Other references · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
28 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  6. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  8. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  9. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  10. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  11. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  12. 2024OmniGen: Unified Image Generationcited by 394
  13. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
  14. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  15. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  16. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  17. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  18. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  19. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  20. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  21. 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 137
  22. 2014Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)cited by 109
  23. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  24. 2025DreamO: A Unified Framework for Image Customizationcited by 83
  25. 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
  26. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  27. 2024BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Modelscited by 27
  28. 2025ImageRAG: Dynamic Image Retrieval for Reference-Guided Image Generationcited by 21

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RAVA: Retrieval-Augmented Viewpoint Alignment for Subject-Driven Image Generation
  2. 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulation
  3. 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
  4. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generation
  5. 2026MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
  6. 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation
  7. 2025DynASyn: Multi-Subject Personalization Enabling Dynamic Action Synthesis
  8. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation