MeanFlowNFT: Bringing Forward-Process RL to Average-Velocity Generators
Not on the map. Why?
Abstract (arXiv)
MeanFlow generators achieve fast few-step sampling by predicting average velocities over time intervals, making them attractive for efficient generation. Reinforcement learning (RL) has become a powerful way to align diffusion and flow models with human preferences and task-specific objectives. In particular, DiffusionNFT offers an efficient forward-process RL framework that does not require reverse-process trajectories or likelihood estimation. However, applying such RL methods to MeanFlow remains underexplored. DiffusionNFT optimizes instantaneous velocities, whereas MeanFlow samples with average velocities. To bridge this gap, we introduce MeanFlowNFT. Inspired by the MeanFlow identity, which bridges average and instantaneous velocities, we construct an induced instantaneous-velocity predictor. We apply the DiffusionNFT objective to this predictor, making reward optimization well-defined for MeanFlow. Sampling remains based on the average velocity, preserving MeanFlow's fast few-step generation. We further prove that MeanFlowNFT inherits DiffusionNFT's strict policy-improvement guarantee. Experiments on image and video generation show that MeanFlowNFT consistently improves baselines. Moreover, it outperforms prior state-of-the-art RL-tuned few-step generators on most metrics (6 of 8 on SD3.5-M), and can even surpass multi-step RL-tuned diffusion while using only a few sampling steps. For instance, on Wan 2.1, 4-step MeanFlowNFT reaches a VBench score of 84.33, surpassing 50-step LongCat-Video RL (82.57).
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 59 of its 64 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
59 of 64 references.
References · 59
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023Consistency Modelscited by 1,778
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2023Adversarial Diffusion Distillationcited by 741
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 466
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2024One Step Diffusion via Shortcut Modelscited by 373
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
- 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 43
- 2026Transition Matching Distillation for Fast Video Generationcited by 27
- 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimizationcited by 25
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 23
- 2025Flash-DMD: Towards High-Fidelity Few-Step Image Generation with Efficient Distillation and Joint Reinforcement Learningcited by 17
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026QAMM: Adjoint MeanFlow Matching for Few-Step Offline Reinforcement Learningcited by 0
- 2026Where Should Physics Enter a Molecular Crystal Generator?cited by 0
- 2026MeanFlowAdvantage: Stable Reward Fine-Tuning for Few-Step Average-Velocity Generatorscited by 0
- 2026FlowMap-OPD: Rollout--Kernel Separation for On-Policy Distillation of Few-Step Flow-Map Generatorscited by 0
- 2026FlowMap-OPD: Rollout--Kernel Separation for On-Policy Distillation of Few-Step Flow-Map Generators29 Sep 2026
- 2026MeanFlowAdvantage: Stable Reward Fine-Tuning for Few-Step Average-Velocity Generators29 Sep 2026
- 2026Where Should Physics Enter a Molecular Crystal Generator?28 Sep 2026
- 2026QAMM: Adjoint MeanFlow Matching for Few-Step Offline Reinforcement Learning28 Sep 2026