From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation
Not on the map. Why?
Abstract (arXiv)
Large-scale image generation has benefited from advances in data scale, quality, rebalancing, and recaptioning, yet conventional pipelines typically optimize task-specific datasets in isolation. A central challenge is not only how to curate each task-specific corpus, but also how to organize heterogeneous supervision according to the dependencies among generative capabilities. We present a capability-driven data infrastructure that couples capability-specific supervision construction with capability-aligned curriculum scheduling. Its three specialized yet interoperable data engines build complementary relational supervision for text-image grounding, inter-image transformation, and image-knowledge association, while caption experts align T2I and editing supervision across tasks and granularities. A multi-stage curriculum jointly evolves task composition, visual-concept distribution, data quality, and image resolution along the dependency order of capability acquisition, with capability-aware evaluation closing the loop through targeted retrieval, expert construction, and gap-aware resampling. At scale, the framework curates a 440M-image T2I corpus, 120M editing pairs, and over 27M image-entity pairs. With this infrastructure, we train multimodal diffusion models at two scales from scratch, with 3B and 6B sizes respectively. We conduct quantitative evaluation on CPI-Bench, along with qualitative evaluations across diverse text-to-image and editing scenarios. Experimental results present broad visual coverage, versatile rendering, and effective transfer across generative capabilities.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 45 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
41 of 45 references.
References · 41
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025DINOv3cited by 1,414
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2024OmniGen: Unified Image Generationcited by 394
- 2024The Faiss librarycited by 376
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
29 more
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2025LongCat-Image Technical Reportcited by 100
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
- 2024What If We Recaption Billions of Web Images with LLaMA-3?cited by 87
- 2024Zero-shot Image Editing with Reference Imitationcited by 65
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
- 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 43
- 2024On the Scalability of Diffusion-based Text-to-Image Generationcited by 36
- 2026FireRed-Image-Edit-1.0 Technical Reportcited by 36
- 2026Qwen-Image-2.0 Technical Reportcited by 36
- 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
- 2024DreamOmni: Unified Image Generation and Editingcited by 30
- 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 20
- 2025UniVG: A Generalist Diffusion Model for Unified Image Generation and Editingcited by 19
- 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
- 2024Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Modelscited by 14
- 2024Instruction-based Image Manipulation by Watching How Things Movecited by 12
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editingcited by 10
- 2025Beyond Static Scenes: Camera-controllable Background Generation for Human Motioncited by 6
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 5
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidancecited by 4
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
- 2026CPI-Bench: A Comprehensive, Practical and Intelligent Benchmark for Real-World Image Editingcited by 3
- 2026Scaling Properties of Text Conditioning in Visual Generationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2026DanceOPD: On-Policy Generative Field Distillation
- 2025LightGen: Efficient Image Generation through Knowledge Distillation and Direct Preference Optimization
- 2025Uncovering Intrinsic Capabilities: A Paradigm for Data Curation in Vision-Language Models
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing
- 2025Image-POSER: Reflective RL for Multi-Expert Image Generation and Editing
- 2026Iterative Refinement Improves Compositional Image Generation
- 2025Chain-of-Image Generation: Toward Monitorable and Controllable Image Generation