mlsanityData to 14 Oct 2026

Flow-Factory: A Unified Framework for Reinforcement Learning in Flow-Matching Models

arXiv 2602.12529 ↗First posted 13 Feb 2026cs.LG cs.CVcited by 12

On the map: Diffusion models → Diffusion and flow policies for robotics

also in 1 more
Abstract (arXiv)

Reinforcement learning has emerged as a promising paradigm for aligning diffusion and flow-matching models with human preferences, yet practitioners face fragmented codebases, model-specific implementations, and engineering complexity. We introduce Flow-Factory, a unified framework that decouples algorithms, models, and rewards through through a modular, registry-based architecture. This design enables seamless integration of new algorithms and architectures, as demonstrated by our support for GRPO, DiffusionNFT, and AWM across Flux, Qwen-Image, and WAN video models. By minimizing implementation overhead, Flow-Factory empowers researchers to rapidly prototype and scale future innovations with ease. Flow-Factory provides production-ready memory optimization, flexible multi-reward training, and seamless distributed training support. The codebase is available at https://github.com/X-GenGroup/Flow-Factory.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 15 of its 16 references that are in the map. First posted on arXiv 13 Feb 2026.

Builds on

15 of 16 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clipping25 Oct
  2. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Process19 Sep
  3. 2025Coefficients-Preserving Sampling for Reinforcement Learning with Flow Matching7 Sep
  4. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Models6 Aug
  5. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
  6. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  7. 2025Flow-GRPO: Training Flow Matching Models via Online RL8 May
  8. 2023Training Diffusion Models with Reinforcement Learning22 May

Other references · 7

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  5. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  6. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
  7. 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 67

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Flow Matching Policy Gradients
  2. 2026A Survey of Flow Matching in Reinforcement Learning
  3. 2026FlowRL: A Taxonomy and Modular Framework for Reinforcement Learning with Diffusion Policies
  4. 2025Reinforcement Learning for Flow-Matching Policies
  5. 2026Flow Matching for Offline Reinforcement Learning with Discrete Actions
  6. 2026Faster and Better Alignment for Flow Matching Models via Step-aware Advantages
  7. 2026FlowCPO: A Unified Divergence View of Preference Alignment for Flow Models
  8. 2026MEND: RL For Flow Models via Proximal Velocity Matching