mlsanityData to 7 Oct 2026

Curriculum Sampling: A Two-Phase Curriculum for Efficient Training of Flow Matching

arXiv 2603.12517 ↗First posted 12 Mar 2026cs.LG cs.CVcited by 3

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Timestep sampling p(t) is a central design choice in Flow Matching models, yet common practice increasingly favors static middle-biased distributions (e.g., Logit-Normal). We show that this choice induces a speed--quality trade-off: middle-biased sampling accelerates early convergence but yields worse asymptotic fidelity than Uniform sampling. By analyzing per-timestep training losses, we identify a U-shaped difficulty profile with persistent errors near the boundary regimes, implying that under-sampling the endpoints leaves fine details unresolved. Guided by this insight, we propose Curriculum Sampling, a two-phase schedule that begins with middle-biased sampling for rapid structure learning and then switches to Uniform sampling for boundary refinement. On CIFAR-10, Curriculum Sampling improves the best FID from 3.85 (Uniform) to 3.22 while reaching peak performance at 100k rather than 150k training steps. Our results highlight that timestep sampling should be treated as an evolving curriculum rather than a fixed hyperparameter.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 11 of its 16 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

11 of 16 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Improving the Training of Rectified Flows30 May
  2. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
  3. 2022Flow Matching for Generative Modeling6 Oct
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 7

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
  5. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  6. 2025Mean Flows for One-step Generative Modelingcited by 524
  7. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Difficulty-Calibrated Interpolation Paths for Conditional Flow Matching
  2. 2026Prediction--Loss Alignment for Sampler--Robust Flow Matching Training
  3. 2024See Further When Clear: Curriculum Consistency Model
  4. 2026Sharpen Your Flow: Sharpness-Aware Sampling for Flow Matching
  5. 2025Score-Regularized Joint Sampling with Importance Weights for Flow Matching
  6. 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching
  7. 2026Gaussian Flow-Matching Schedules: Implications for Sampling and Training
  8. 2025Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch