mlsanityData to 14 Oct 2026

Alchemist: Unlocking Efficiency in Text-to-Image Model Training via Meta-Gradient Data Selection

arXiv 2512.16905 ↗First posted 18 Dec 2025cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advances in Text-to-Image (T2I) generative models, such as Imagen, Stable Diffusion, and FLUX, have led to remarkable improvements in visual quality. However, their performance is fundamentally limited by the quality of training data. Web-crawled and synthetic image datasets often contain low-quality or redundant samples, which lead to degraded visual fidelity, unstable training, and inefficient computation. Hence, effective data selection is crucial for improving data efficiency. Existing approaches rely on costly manual curation or heuristic scoring based on single-dimensional features in Text-to-Image data filtering. Although meta-learning based method has been explored in LLM, there is no adaptation for image modalities. To this end, we propose **Alchemist**, a meta-gradient-based framework to select a suitable subset from large-scale text-image data pairs. Our approach automatically learns to assess the influence of each sample by iteratively optimizing the model from a data-centric perspective. Alchemist consists of two key stages: data rating and data pruning. We train a lightweight rater to estimate each sample's influence based on gradient information, enhanced with multi-granularity perception. We then use the Shift-Gsampling strategy to select informative subsets for efficient model training. Alchemist is the first automatic, scalable, meta-gradient-based data selection framework for Text-to-Image model training. Experiments on both synthetic and web-crawled datasets demonstrate that Alchemist consistently improves visual quality and downstream performance. Training on an Alchemist-selected 50% of the data can outperform training on the full dataset.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 49 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

36 of 49 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  6. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  7. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  8. 2023Data Selection for Language Models via Importance Resamplingcited by 329
  9. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
  10. 2024A Survey on Data Selection for Language Modelscited by 236
  11. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  12. 2024QuRating: Selecting High-Quality Data for Training Language Modelscited by 157
22 more
  1. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  2. 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
  3. 2022Coverage-centric Coreset Selection for High Pruning Ratescited by 117
  4. 2022BOME! Bilevel Optimization Made Easy: A Simple First-Order Approachcited by 105
  5. 2023On Penalty-based Bilevel Gradient Descent Methodcited by 87
  6. 2024SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selectioncited by 64
  7. 2016Coresets and Sketchescited by 63
  8. 2023On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximationcited by 51
  9. 2020Predicting Performance for Natural Language Processing Taskscited by 49
  10. 2024Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHFcited by 41
  11. 2024Data Selection via Optimal Control for Language Modelscited by 38
  12. 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmarkcited by 38
  13. 2024STAR: Scale-wise Text-conditioned AutoRegressive image generationcited by 28
  14. 2025Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Modelscited by 19
  15. 2025Efficient Data Selection at Scale via Influence Distillationcited by 15
  16. 2025DataRater: Meta-Learned Dataset Curationcited by 13
  17. 2024FairDeDup: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplicationcited by 11
  18. 2024WanJuan-CC: A Safe and High-Quality Open-sourced English Webtext Datasetcited by 10
  19. 2024ELFS: Label-Free Coreset Selection with Proxy Training Dynamicscited by 10
  20. 2025Data Efficacy for Language Model Trainingcited by 8
  21. 2023A Generalized Alternating Method for Bilevel Learning under the Polyak-Lojasiewicz Conditioncited by 5
  22. 2023Quality and Quantity: Unveiling a Million High-Quality Images for Text-to-Image Synthesis in Fashion Designcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Match & Choose: Model Selection Framework for Fine-tuning Text-to-Image Diffusion Models
  2. 2024FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models
  3. 2024VersaT2I: Improving Text-to-Image Models with Versatile Reward
  4. 2026i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models
  5. 2024EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models
  6. 2024MaxFusion: Plug&Play Multi-Modal Generation in Text-to-Image Diffusion Models
  7. 2023KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis
  8. 2023Wuerstchen: An Efficient Architecture for Large-Scale Text-to-Image Diffusion Models