mlsanityData to 14 Oct 2026

RAISE: Requirement-Adaptive Evolutionary Refinement for Training-Free Text-to-Image Alignment

arXiv 2603.00483 ↗First posted 28 Feb 2026cs.CV cs.AIcited by 7

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent text-to-image (T2I) diffusion models achieve remarkable realism, yet faithful prompt-image alignment remains challenging, particularly for complex prompts with multiple objects, relations, and fine-grained attributes. Existing training-free inference-time scaling methods rely on fixed iteration budgets that cannot adapt to prompt difficulty, while reflection-tuned models require carefully curated reflection datasets and extensive joint fine-tuning of diffusion and vision-language models, often overfitting to reflection paths data and lacking transferability across models. We introduce RAISE (Requirement-Adaptive Self-Improving Evolution), a training-free, requirement-driven evolutionary framework for adaptive T2I generation. RAISE formulates image generation as a requirement-driven adaptive scaling process, evolving a population of candidates at inference time through a diverse set of refinement actions-including prompt rewriting, noise resampling, and instructional editing. Each generation is verified against a structured checklist of requirements, enabling the system to dynamically identify unsatisfied items and allocate further computation only where needed. This achieves adaptive test-time scaling that aligns computational effort with semantic query complexity. On GenEval and DrawBench, RAISE attains state-of-the-art alignment (0.94 overall GenEval) while incurring fewer generated samples (reduced by 30-40%) and VLM calls (reduced by 80%) than prior scaling and reflection-tuned baselines, demonstrating efficient, generalizable, and model-agnostic multi-round self-improvement. Code is available at https://github.com/LiyaoJiang1998/RAISE.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 35 of its 42 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

35 of 42 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning22 Apr
  2. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflection15 Mar
  3. 2024Emu3: Next-Token Prediction is All You Need27 Sep
  4. 2024FRAP: Faithful and Realistic Text-to-Image Generation with Adaptive Prompt Weighting21 Aug
  5. 2024Towards Better Text-to-Image Generation Alignment via Attention Modulation22 Apr
  6. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  7. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 27

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  10. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  12. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
15 more
  1. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  2. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  3. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  4. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  5. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  6. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  7. 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
  8. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  9. 2025Seedream 3.0 Technical Reportcited by 154
  10. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  11. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
  12. 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 92
  13. 2024Not All Noises Are Created Equally:Diffusion Noise Selection and Optimizationcited by 71
  14. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
  15. 2025Test-time Prompt Refinement for Text-to-Image Modelscited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evolutionary Token-Level Prompt Optimization for Diffusion Models
  2. 2026Iterative Refinement Improves Compositional Image Generation
  3. 2025POET: Preference Optimization for Enhanced Text-to-Image Generation
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models
  5. 2025M3T2IBench: A Large-Scale Multi-Category, Multi-Instance, Multi-Relation Text-to-Image Benchmark
  6. 2025CARINOX: Inference-time Scaling with Category-Aware Reward-based Initial Noise Optimization and Exploration
  7. 2025Inference-Time Alignment of Diffusion Models via Evolutionary Algorithms
  8. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting