mlsanityData to 7 Oct 2026

VisionDirector: Vision-Language Guided Closed-Loop Refinement for Generative Image Synthesis

arXiv 2512.19243 ↗First posted 22 Dec 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Generative models can now produce photorealistic imagery, yet they still struggle with the long, multi-goal prompts that professional designers issue. To expose this gap and better evaluate models' performance in real-world settings, we introduce Long Goal Bench (LGBench), a 2,000-task suite (1,000 T2I and 1,000 I2I) whose average instruction contains 18 to 22 tightly coupled goals spanning global layout, local object placement, typography, and logo fidelity. We find that even state-of-the-art models satisfy fewer than 72 percent of the goals and routinely miss localized edits, confirming the brittleness of current pipelines. To address this, we present VisionDirector, a training-free vision-language supervisor that (i) extracts structured goals from long instructions, (ii) dynamically decides between one-shot generation and staged edits, (iii) runs micro-grid sampling with semantic verification and rollback after every edit, and (iv) logs goal-level rewards. We further fine-tune the planner with Group Relative Policy Optimization, yielding shorter edit trajectories (3.1 versus 4.2 steps) and stronger alignment. VisionDirector achieves new state of the art on GenEval (plus 7 percent overall) and ImgEdit (plus 0.07 absolute) while producing consistent qualitative improvements on typography, multi-object scenes, and pose editing.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 37 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

34 of 37 references.

References · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2025Qwen-Image Technical Reportcited by 973
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  11. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
22 more
  1. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  2. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  3. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  4. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  6. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  8. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  9. 2024OmniGen: Unified Image Generationcited by 388
  10. 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 298
  11. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  12. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  13. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  14. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  15. 2025Seedream 3.0 Technical Reportcited by 146
  16. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  17. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  18. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
  19. 2025VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learningcited by 41
  20. 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
  21. 2025A Survey of Interactive Generative Videocited by 23
  22. 2025Position: Interactive Generative Video as Next-Generation Game Enginecited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.