mlsanityData to 14 Oct 2026

AgenticGen: Reward-Guided Agentic Video Generation for Advertising

arXiv 2609.09187 ↗First posted 31 Aug 2026cs.CV cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

Advertising video generation is not only a video synthesis task, but also a product-conditioned reasoning problem whose success is measured by online business metrics. Recent video foundation models can generate realistic clips from multimodal conditions, yet they do not optimize how a product should be transformed into an effective advertisement or how future generation should be improved from online business feedback. To close this loop, we propose AgenticGen, a reward-guided agentic framework that decomposes advertising video generation into two trainable reasoning stages, strategy selection and draft generation, thereby exposing optimization targets that online business feedback can supervise. AgenticGen learns a performance-based reward from accumulated online feedback and a complementary rubric-based reward aligned with human quality standards, then uses them to supervise policy optimization. DPO first moves the agentic policies toward online preferences, and GRPO further refines both stages with process and outcome rewards. Offline experiments validate the reward models and successive policy optimization. Online A/B experiments in the TikTok advertising system show that AgenticGen after DPO and GRPO improves CTR by 2.72%, CVR by 2.63%, and Advv by 9.61% over the SFT baseline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 49 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

43 of 49 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation6 Jun
  2. 2026ViMax: Agentic Video Generation2 Jun
  3. 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesis31 Mar
  4. 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvement12 Mar
  5. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan

Other references · 38

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  9. 2025Qwen2.5-Omni Technical Reportcited by 736
  10. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 499
  11. 2025Qwen3-Omni Technical Reportcited by 497
  12. 2025Improving Video Generation with Human Feedbackcited by 284
26 more
  1. 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
  2. 2024Iterative Reasoning Preference Optimizationcited by 246
  3. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  4. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  5. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  6. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
  7. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 90
  8. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
  9. 2024Bootstrapping Language Models with DPO Implicit Rewardscited by 53
  10. 2025Writing-Zero: Bridge the Gap Between Non-verifiable Tasks and Verifiable Rewardscited by 50
  11. 2020Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issuecited by 48
  12. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
  13. 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 31
  14. 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 29
  15. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 19
  16. 2022CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuningcited by 17
  17. 2025CTR-Driven Advertising Image Generation with Multimodal Large Language Modelscited by 14
  18. 2024Clickbait vs. Quality: How Engagement-Based Optimization Shapes the Content Landscape in Online Platformscited by 13
  19. 2026CDRRM: Contrast-Driven Rubric Generation for Reliable and Interpretable Reward Modelingcited by 12
  20. 2025Improving Generative Ad Text on Facebook using Reinforcement Learningcited by 9
  21. 2025CTR-Driven Ad Text Generation via Online Feedback Preference Optimizationcited by 8
  22. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generationcited by 4
  23. 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RLcited by 4
  24. 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generationcited by 2
  25. 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modelingcited by 2
  26. 2025Generative Modeling with Multi-Instance Reward Learning for E-commerce Creative Optimizationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoGen-Agent: Reinforcing Video Generation Agents
  2. 2026Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search
  3. 2026Generative Optimization for Incentivized Advertising with Global Level Constraints
  4. 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation
  5. 2026AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution
  6. 2026Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation
  7. 2026RewardHarness: Self-Evolving Agentic Post-Training
  8. 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence