DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation
Not on the map. Why?
Abstract (arXiv)
Text-rich image generation is one of the most challenging settings in image generation, since models must simultaneously produce visually realistic images and render legible, semantically aligned, and layout-consistent text. Existing data pipelines usually follow a static crawl-filter-freeze paradigm. They collect candidate samples, filter them once, and freeze the accepted data for training. However, rejected samples are usually discarded, although they often contain useful failure signals such as OCR errors and semantic mismatches. As a result, later construction rounds may repeat the same failure modes. To address these limitations, we propose DataEvolver, a self-evolving multi-agent framework for text-rich image data construction. DataEvolver treats data construction as feedback-driven construction policy evolution. A Retriever collects candidate samples, a Verifier assigns quality scores and rejection causes, a Critic summarizes round-level feedback into semantic feedback, and a Generator completes under-covered regions through targeted synthesis. The updated feedback memory then guides the next construction round. Experiments on text-rich image generation benchmarks show that DataEvolver produces more useful training data than fixed-dataset baselines under matched data budgets. At the 0.75M scale on PixArt-alpha, DataEvolver improves OCR-F1 over the strongest baseline by 85.3 percent on TextScenesHQ and 35.3 percent on LongTextBench. The improvements are consistent across both evaluated benchmarks and also transfer to Show-o2, indicating that the benefit of DataEvolver is not tied to a single downstream generator. These results suggest that rejected samples can provide actionable feedback for improving text-rich image data construction.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 34 of its 39 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
34 of 39 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
22 more
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
- 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 205
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
- 2024MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversitycited by 38
- 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 27
- 2023Building Efficient Universal Classifiers with Natural Language Inferencecited by 22
- 2025Oasis: One Image is All You Need for Multimodal Instruction Data Synthesiscited by 14
Built on by
Citing papers per year: 2026: 3.
3 papers.