mlsanityData to 7 Oct 2026

FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark

arXiv 2509.09680 ↗First posted 11 Sep 2025cs.CV cs.CLcited by 37

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

The advancement of open-source text-to-image (T2I) models has been hindered by the absence of large-scale, reasoning-focused datasets and comprehensive evaluation benchmarks, resulting in a performance gap compared to leading closed-source systems. To address this challenge, We introduce FLUX-Reason-6M and PRISM-Bench (Precise and Robust Image Synthesis Measurement Benchmark). FLUX-Reason-6M is a massive dataset consisting of 6 million high-quality FLUX-generated images and 20 million bilingual (English and Chinese) descriptions specifically designed to teach complex reasoning. The image are organized according to six key characteristics: Imagination, Entity, Text rendering, Style, Affection, and Composition, and design explicit Generation Chain-of-Thought (GCoT) to provide detailed breakdowns of image generation steps. The whole data curation takes 15,000 A100 GPU days, providing the community with a resource previously unattainable outside of large industrial labs. PRISM-Bench offers a novel evaluation standard with seven distinct tracks, including a formidable Long Text challenge using GCoT. Through carefully designed prompts, it utilizes advanced vision-language models for nuanced human-aligned assessment of prompt-image alignment and image aesthetics. Our extensive evaluation of 19 leading models on PRISM-Bench reveals critical performance gaps and highlights specific areas requiring improvement. Our dataset, benchmark, and evaluation code are released to catalyze the next wave of reasoning-oriented T2I generation. Project page: https://flux-reason-6m.github.io/ .

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 72 references that are in the map. First posted on arXiv 11 Sep 2025.

Builds on

36 of 72 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
  2. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
  3. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar

Other references · 33

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  7. 2025Qwen-Image Technical Reportcited by 973
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  9. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  10. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  12. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
21 more
  1. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  2. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  3. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  4. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
  5. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  6. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  7. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  8. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  9. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
  10. 2025Seedream 3.0 Technical Reportcited by 146
  11. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  12. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
  13. 2021VinVL: Revisiting Visual Representations in Vision-Language Modelscited by 109
  14. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  15. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
  16. 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
  17. 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 52
  18. 2024EvalMuse-40K: A Reliable and Fine-Grained Benchmark with Comprehensive Human Annotations for Text-to-Image Generation Model Evaluationcited by 37
  19. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
  20. 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 25
  21. 2024PUMA: Empowering Unified MLLM with Multi-granular Visual Generationcited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 28.

37 papers.

Sort:

By area:

  1. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  2. 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
  3. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
  4. 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 19
  5. 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 16
  6. 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
  7. 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
  8. 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 13
  9. 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generationcited by 13
  10. 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
  11. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
  12. 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
25 more
  1. 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Modelscited by 10
  2. 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
  3. 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
  4. 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Modelcited by 8
  5. 2025VA-π: Variational Policy Alignment for Pixel-Aware Autoregressive Generationcited by 6
  6. 2026Unified Thinker: A General Reasoning Modular Core for Image Generationcited by 5
  7. 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
  8. 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 4
  9. 2025FlowSteer: Guiding Few-Step Image Synthesis with Authentic Trajectoriescited by 2
  10. 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 2
  11. 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
  12. 2025Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selectioncited by 1
  13. 2026Guiding Token-Sparse Diffusion Modelscited by 1
  14. 2026Granulon: Awakening Pixel-Level Visual Encoders with Adaptive Multi-Granularity Semantics for MLLMcited by 1
  15. 2026Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoningcited by 1
  16. 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generationcited by 1
  17. 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generationcited by 0
  18. 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metriccited by 0
  19. 2026CAPEval: A Decoupled Caption Evaluation across Understanding and Generationcited by 0
  20. 2026Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generationcited by 0
  21. 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
  22. 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modelingcited by 0
  23. 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessmentcited by 0
  24. 2026PAIQ: Patch-Aligned Semantic Injection via Residual Rotationcited by 0
  25. 2026Looped Diffusion Transformercited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
  2. 2025MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems
  3. 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
  4. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
  5. 2025When Visualizing is the First Step to Reasoning: MIRA, a Benchmark for Visual Chain-of-Thought
  6. 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimization
  7. 2026TACIT Benchmark: A Programmatic Visual Reasoning Benchmark for Generative and Discriminative Models
  8. 2024ReMI: A Dataset for Reasoning with Multiple Images