RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Advertising (Ad) is a cornerstone of the digital economy, yet the moderation of video advertisements remains a significant challenge due to their complexity and the need for precise violation localization. While recent advancements, such as the RAVEN model, have improved coarse-grained violation detection, critical gaps persist in fine-grained understanding, explainability, and generalization. To address these limitations, we propose RAVEN++, a novel framework that introduces three key innovations: 1) Active Reinforcement Learning (RL), which dynamically adapts training to samples of varying difficulty; 2) Fine-Grained Violation Understanding, achieved through hierarchical reward functions and reasoning distillation; and 3) Progressive Multi-Stage Training, which systematically combines knowledge injection, curriculum-based passive RL, and active RL. Extensive experiments on both public and proprietary datasets, on both offline scenarios and online deployed A/B Testing, demonstrate that RAVEN++ outperforms general-purpose LLMs and specialized models like RAVEN in terms of fine-grained violation understanding, reasoning capabilities, and generalization ability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 58 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
41 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2025RAVEN: Robust Advertisement Video Violation Temporal Grounding via Reinforcement Reasoning18 Oct
- 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation1 Apr
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Qwen Technical Reportcited by 3,344
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Large Language Modelscited by 780
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
26 more
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
- 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 323
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
- 2023Preference Ranking Optimization for Human Alignmentcited by 285
- 2021Curriculum Learning: A Surveycited by 259
- 2017Automated Curriculum Learning for Neural Networkscited by 257
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
- 2024Direct Preference Optimization with an Offsetcited by 122
- 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
- 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 97
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 70
- 2014Curriculum Learning of Multiple Taskscited by 66
- 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
- 2024Context-Guided Spatio-Temporal Video Groundingcited by 46
- 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
- 2024MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibilicited by 25
- 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
- 2024Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understandingcited by 20
- 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
- 2024Scaling Up LLM Reviews for Google Ads Content Moderationcited by 12
- 2024ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videoscited by 10
- 2024PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentationcited by 10
- 2025Structural and Statistical Texture Knowledge Distillation and Learning for Segmentationcited by 9
- 2025Multi-Agent VLMs Guided Self-Training with PNU Loss for Low-Resource Offensive Content Detectioncited by 2
- 2025Content Moderation Futurescited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026StreamSense: Streaming Social Task Detection with Selective Vision-Language Model Routingcited by 2
- 2026ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiringcited by 0
- 2026Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videoscited by 0
- 2026R^3: Advertisement Compliance Rectification via Group-Relative Experience Extractor and Curriculum Reinforcementcited by 0
- 2026R^3: Advertisement Compliance Rectification via Group-Relative Experience Extractor and Curriculum Reinforcement8 Jul 2026
- 2026Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos10 Jun 2026
- 2026ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring4 May 2026
- 2026StreamSense: Streaming Social Task Detection with Selective Vision-Language Model Routing30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026BLM-Guard: Explainable Multimodal Ad Moderation with Chain-of-Thought and Policy-Aligned Rewards
- 2025AdsQA: Towards Advertisement Video Understanding
- 2026AgenticGen: Reward-Guided Agentic Video Generation for Advertising
- 2026Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning
- 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generation
- 2025Improving Generative Ad Text on Facebook using Reinforcement Learning
- 2026Test-time Reinforcement Learning for Anomalous Video Understanding
- 2026OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training