FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The advancement of open-source text-to-image (T2I) models has been hindered by the absence of large-scale, reasoning-focused datasets and comprehensive evaluation benchmarks, resulting in a performance gap compared to leading closed-source systems. To address this challenge, We introduce FLUX-Reason-6M and PRISM-Bench (Precise and Robust Image Synthesis Measurement Benchmark). FLUX-Reason-6M is a massive dataset consisting of 6 million high-quality FLUX-generated images and 20 million bilingual (English and Chinese) descriptions specifically designed to teach complex reasoning. The image are organized according to six key characteristics: Imagination, Entity, Text rendering, Style, Affection, and Composition, and design explicit Generation Chain-of-Thought (GCoT) to provide detailed breakdowns of image generation steps. The whole data curation takes 15,000 A100 GPU days, providing the community with a resource previously unattainable outside of large industrial labs. PRISM-Bench offers a novel evaluation standard with seven distinct tracks, including a formidable Long Text challenge using GCoT. Through carefully designed prompts, it utilizes advanced vision-language models for nuanced human-aligned assessment of prompt-image alignment and image aesthetics. Our extensive evaluation of 19 leading models on PRISM-Bench reveals critical performance gaps and highlights specific areas requiring improvement. Our dataset, benchmark, and evaluation code are released to catalyze the next wave of reasoning-oriented T2I generation. Project page: https://flux-reason-6m.github.io/ .
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 72 references that are in the map. First posted on arXiv 11 Sep 2025.
Builds on
36 of 72 references.
Closest ancestors · 3
Same direction, newest first
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
Other references · 33
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
21 more
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 159
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
- 2021VinVL: Revisiting Visual Representations in Vision-Language Modelscited by 109
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
- 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 59
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 52
- 2024EvalMuse-40K: A Reliable and Fine-Grained Benchmark with Comprehensive Human Annotations for Text-to-Image Generation Model Evaluationcited by 37
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
- 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 25
- 2024PUMA: Empowering Unified MLLM with Multi-granular Visual Generationcited by 20
Built on by
Citing papers per year: 2025: 9; 2026: 28.
37 papers.
Sort:
By area:
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 19
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 16
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 13
- 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generationcited by 13
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
25 more
- 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Modelscited by 10
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Modelcited by 8
- 2025VA-π: Variational Policy Alignment for Pixel-Aware Autoregressive Generationcited by 6
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generationcited by 5
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 4
- 2025FlowSteer: Guiding Few-Step Image Synthesis with Authentic Trajectoriescited by 2
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 2
- 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
- 2025Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selectioncited by 1
- 2026Guiding Token-Sparse Diffusion Modelscited by 1
- 2026Granulon: Awakening Pixel-Level Visual Encoders with Adaptive Multi-Granularity Semantics for MLLMcited by 1
- 2026Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoningcited by 1
- 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generationcited by 1
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generationcited by 0
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metriccited by 0
- 2026CAPEval: A Decoupled Caption Evaluation across Understanding and Generationcited by 0
- 2026Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generationcited by 0
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modelingcited by 0
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessmentcited by 0
- 2026PAIQ: Patch-Aligned Semantic Injection via Residual Rotationcited by 0
- 2026Looped Diffusion Transformercited by 0
- 2026Looped Diffusion Transformer30 Sep 2026
- 2026PAIQ: Patch-Aligned Semantic Injection via Residual Rotation29 Sep 2026
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment29 Sep 2026
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling10 Sep 2026
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing25 Aug 2026
- 2026Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generation16 Aug 2026
- 2026CAPEval: A Decoupled Caption Evaluation across Understanding and Generation3 Aug 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generation29 Jun 2026
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation14 May 2026
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling30 Apr 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
25 more
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
- 2026Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoning19 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model9 Mar 2026
- 2026Granulon: Awakening Pixel-Level Visual Encoders with Adaptive Multi-Granularity Semantics for MLLM9 Mar 2026
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model1 Mar 2026
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering24 Feb 2026
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing12 Feb 2026
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Models2 Feb 2026
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility17 Jan 2026
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation15 Jan 2026
- 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models6 Jan 2026
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generation6 Jan 2026
- 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generation5 Jan 2026
- 2026Guiding Token-Sparse Diffusion Models4 Jan 2026
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection2 Jan 2026
- 2025ThinkGen: Generalized Thinking for Visual Generation29 Dec 2025
- 2025VA-π: Variational Policy Alignment for Pixel-Aware Autoregressive Generation22 Dec 2025
- 2025Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selection18 Dec 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2025FlowSteer: Guiding Few-Step Image Synthesis with Authentic Trajectories24 Nov 2025
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captions10 Nov 2025
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct 2025
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching15 Oct 2025
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visuals6 Oct 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 19
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Modelcited by 8
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 4
- 2025FlowSteer: Guiding Few-Step Image Synthesis with Authentic Trajectoriescited by 2
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 2
- 2025Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selectioncited by 1
- 2026Guiding Token-Sparse Diffusion Modelscited by 1
- 2026Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generationcited by 0
- 2026Looped Diffusion Transformercited by 0
- 2026Looped Diffusion Transformer30 Sep 2026
- 2026Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generation16 Aug 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model9 Mar 2026
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model1 Mar 2026
- 2026Guiding Token-Sparse Diffusion Models4 Jan 2026
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection2 Jan 2026
- 2025Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selection18 Dec 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2025FlowSteer: Guiding Few-Step Image Synthesis with Authentic Trajectories24 Nov 2025
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching15 Oct 2025
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 16
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
- 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Modelscited by 10
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utilitycited by 8
- 2026Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoningcited by 1
- 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generationcited by 1
- 2026SciIR: A Large-scale Training Dataset and Benchmark for Scientific Image Reasoning Generation29 Jun 2026
- 2026Thinking with Constructions: A Benchmark and Policy Optimization for Visual-Text Interleaved Geometric Reasoning19 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility17 Jan 2026
- 2026MMErroR: A Benchmark for Erroneous Reasoning in Vision-Language Models6 Jan 2026
- 2025ThinkGen: Generalized Thinking for Visual Generation29 Dec 2025
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct 2025
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visuals6 Oct 2025
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
- 2025Generating an Image From 1,000 Words: Enhancing Text-to-Image With Structured Captionscited by 13
- 2026NextFlow: Unified Sequential Modeling Activates Multimodal Understanding and Generationcited by 13
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generationcited by 5
- 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generationcited by 0
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metriccited by 0
- 2026CAPEval: A Decoupled Caption Evaluation across Understanding and Generationcited by 0
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
12 most cited of 14 All 14 (JSON)
- 2026PAIQ: Patch-Aligned Semantic Injection via Residual Rotation29 Sep 2026
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling10 Sep 2026
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing25 Aug 2026
- 2026CAPEval: A Decoupled Caption Evaluation across Understanding and Generation3 Aug 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation14 May 2026
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering24 Feb 2026
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing12 Feb 2026
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Models2 Feb 2026
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation15 Jan 2026
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generation6 Jan 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
- 2025MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
- 2025When Visualizing is the First Step to Reasoning: MIRA, a Benchmark for Visual Chain-of-Thought
- 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimization
- 2026TACIT Benchmark: A Programmatic Visual Reasoning Benchmark for Generative and Discriminative Models
- 2024ReMI: A Dataset for Reasoning with Multiple Images