AgenticGen: Reward-Guided Agentic Video Generation for Advertising
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
Advertising video generation is not only a video synthesis task, but also a product-conditioned reasoning problem whose success is measured by online business metrics. Recent video foundation models can generate realistic clips from multimodal conditions, yet they do not optimize how a product should be transformed into an effective advertisement or how future generation should be improved from online business feedback. To close this loop, we propose AgenticGen, a reward-guided agentic framework that decomposes advertising video generation into two trainable reasoning stages, strategy selection and draft generation, thereby exposing optimization targets that online business feedback can supervise. AgenticGen learns a performance-based reward from accumulated online feedback and a complementary rubric-based reward aligned with human quality standards, then uses them to supervise policy optimization. DPO first moves the agentic policies toward online preferences, and GRPO further refines both stages with process and outcome rewards. Offline experiments validate the reward models and successive policy optimization. Online A/B experiments in the TikTok advertising system show that AgenticGen after DPO and GRPO improves CTR by 2.72%, CVR by 2.63%, and Advv by 9.61% over the SFT baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 49 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
43 of 49 references.
Closest ancestors · 5
Same direction, newest first
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation6 Jun
- 2026ViMax: Agentic Video Generation2 Jun
- 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesis31 Mar
- 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvement12 Mar
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan
Other references · 38
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 499
- 2025Qwen3-Omni Technical Reportcited by 497
- 2025Improving Video Generation with Human Feedbackcited by 284
26 more
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
- 2024Iterative Reasoning Preference Optimizationcited by 246
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 90
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
- 2024Bootstrapping Language Models with DPO Implicit Rewardscited by 53
- 2025Writing-Zero: Bridge the Gap Between Non-verifiable Tasks and Verifiable Rewardscited by 50
- 2020Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issuecited by 48
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
- 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 31
- 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 29
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 19
- 2022CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuningcited by 17
- 2025CTR-Driven Advertising Image Generation with Multimodal Large Language Modelscited by 14
- 2024Clickbait vs. Quality: How Engagement-Based Optimization Shapes the Content Landscape in Online Platformscited by 13
- 2026CDRRM: Contrast-Driven Rubric Generation for Reliable and Interpretable Reward Modelingcited by 12
- 2025Improving Generative Ad Text on Facebook using Reinforcement Learningcited by 9
- 2025CTR-Driven Ad Text Generation via Online Feedback Preference Optimizationcited by 8
- 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generationcited by 4
- 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RLcited by 4
- 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generationcited by 2
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modelingcited by 2
- 2025Generative Modeling with Multi-Instance Reward Learning for E-commerce Creative Optimizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VideoGen-Agent: Reinforcing Video Generation Agents
- 2026Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraints
- 2026DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation
- 2026AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution
- 2026Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation
- 2026RewardHarness: Self-Evolving Agentic Post-Training
- 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence