mlsanityData to 14 Oct 2026

DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation

arXiv 2606.31537 ↗First posted 30 Jun 2026cs.CV cs.MAcited by 3

Not on the map. Why?

Abstract (arXiv)

Text-rich image generation is one of the most challenging settings in image generation, since models must simultaneously produce visually realistic images and render legible, semantically aligned, and layout-consistent text. Existing data pipelines usually follow a static crawl-filter-freeze paradigm. They collect candidate samples, filter them once, and freeze the accepted data for training. However, rejected samples are usually discarded, although they often contain useful failure signals such as OCR errors and semantic mismatches. As a result, later construction rounds may repeat the same failure modes. To address these limitations, we propose DataEvolver, a self-evolving multi-agent framework for text-rich image data construction. DataEvolver treats data construction as feedback-driven construction policy evolution. A Retriever collects candidate samples, a Verifier assigns quality scores and rejection causes, a Critic summarizes round-level feedback into semantic feedback, and a Generator completes under-covered regions through targeted synthesis. The updated feedback memory then guides the next construction round. Experiments on text-rich image generation benchmarks show that DataEvolver produces more useful training data than fixed-dataset baselines under matched data budgets. At the 0.75M scale on PixArt-alpha, DataEvolver improves OCR-F1 over the strongest baseline by 85.3 percent on TextScenesHQ and 35.3 percent on LongTextBench. The improvements are consistent across both evaluated benchmarks and also transfer to Show-o2, indicating that the benefit of DataEvolver is not tied to a single downstream generator. These results suggest that rejected samples can provide actionable feedback for improving text-rich image data construction.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 34 of its 39 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

34 of 39 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
22 more
  1. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  5. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  6. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  7. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  8. 2023DataComp: In search of the next generation of multimodal datasetscited by 644
  9. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
  10. 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
  11. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  12. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  13. 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
  14. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 205
  15. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
  16. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
  17. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
  18. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
  19. 2024MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversitycited by 38
  20. 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 27
  21. 2023Building Efficient Universal Classifiers with Natural Language Inferencecited by 22
  22. 2025Oasis: One Image is All You Need for Multimodal Instruction Data Synthesiscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.