FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Training
Not on the map. Why?
Abstract (arXiv)
Prompt optimization and generator post-training are two complementary ways to improve text-to-video (T2V) generation, and recent systems increasingly train both modules jointly. However, optimizing a prompt policy and a video generator from the same terminal reward creates two ambiguities: prompt quality is confounded with stochastic generation, and the two modules may realize overlapping local improvements. We introduce FlowCred, a two-level framework for joint T2V post-training. First, hierarchical credit assignment uses matched prompt-seed rollout grids to separate prompt-level credit from prompt-conditioned generator residuals under shared randomness. Second, functional coordination probes alternative current-policy prompts at states from actual generation trajectories, providing generator-aware evidence for prompt optimization while selectively attenuating generator updates already supported by conditioning changes. Across multiple T2V benchmarks, FlowCred consistently improves matched joint-training baselines. On LTX-2.5, FlowCred improves a strictly matched joint-training control from 61.47 to 64.46 on T2V-CompBench and from 55.58 to 58.08 on StoryEval, without increasing decoded-video or reward-model-call budgets. Factorial and realized-update analyses show complementary contributions from prompt shaping and generator routing, while human evaluation and transfer across backbones and updater families provide further supporting evidence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 48 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
46 of 48 references.
References · 46
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
34 more
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 450
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2024Video Diffusion Alignment via Reward Gradientscited by 107
- 2024Aligning Diffusion Models by Optimizing Human Utilitycited by 101
- 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 67
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
- 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLMcited by 25
- 2013PEGASUS: A Policy Search Method for Large MDPs and POMDPscited by 22
- 2023BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesiscited by 18
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimizationcited by 14
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generationcited by 13
- 2026PromptRL: Prompt Matters in RL for Flow-Based Image Generationcited by 12
- 2026Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuningcited by 10
- 2026Stepwise Credit Assignment for GRPO on Flow-Matching Modelscited by 10
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPOcited by 9
- 2026Diffusion-State Policy Optimization for Masked Diffusion Language Modelscited by 4
- 2026SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuningcited by 3
- 2026Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformerscited by 3
- 2026CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generationcited by 3
- 2026Scaling Reinforcement Learning for Diffusion Models via Velocity Matchingcited by 3
- 2026STAR: SpatioTemporal Adaptive Reward Allocation for Text-to-Image RL Post-Trainingcited by 2
- 2026Latent Reward Registers for Diffusion Preference Alignmentcited by 1
- 2026NoisEasier: Test-Time Noise Optimization for Text-to-Video Generationcited by 1
Built on by
Not cited yet.