mlsanityData to 14 Oct 2026

RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoning

arXiv 2511.19168 ↗First posted 24 Nov 2025cs.LG cs.CLcited by 4

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Advertising (Ad) is a cornerstone of the digital economy, yet the moderation of video advertisements remains a significant challenge due to their complexity and the need for precise violation localization. While recent advancements, such as the RAVEN model, have improved coarse-grained violation detection, critical gaps persist in fine-grained understanding, explainability, and generalization. To address these limitations, we propose RAVEN++, a novel framework that introduces three key innovations: 1) Active Reinforcement Learning (RL), which dynamically adapts training to samples of varying difficulty; 2) Fine-Grained Violation Understanding, achieved through hierarchical reward functions and reasoning distillation; and 3) Progressive Multi-Stage Training, which systematically combines knowledge injection, curriculum-based passive RL, and active RL. Extensive experiments on both public and proprietary datasets, on both offline scenarios and online deployed A/B Testing, demonstrate that RAVEN++ outperforms general-purpose LLMs and specialized models like RAVEN in terms of fine-grained violation understanding, reasoning capabilities, and generalization ability.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 58 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

41 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025RAVEN: Robust Advertisement Video Violation Temporal Grounding via Reinforcement Reasoning18 Oct
  2. 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation1 Apr
  3. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2017Deep reinforcement learning from human preferencescited by 3,912
  8. 2023Qwen Technical Reportcited by 3,344
  9. 2023A Survey on Multimodal Large Language Modelscited by 909
  10. 2023Large Language Modelscited by 780
  11. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  12. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
26 more
  1. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
  2. 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 323
  3. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
  4. 2023Preference Ranking Optimization for Human Alignmentcited by 285
  5. 2021Curriculum Learning: A Surveycited by 259
  6. 2017Automated Curriculum Learning for Neural Networkscited by 257
  7. 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
  8. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
  9. 2024Direct Preference Optimization with an Offsetcited by 122
  10. 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
  11. 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 97
  12. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 70
  13. 2014Curriculum Learning of Multiple Taskscited by 66
  14. 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
  15. 2024Context-Guided Spatio-Temporal Video Groundingcited by 46
  16. 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
  17. 2024MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibilicited by 25
  18. 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
  19. 2024Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understandingcited by 20
  20. 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
  21. 2024Scaling Up LLM Reviews for Google Ads Content Moderationcited by 12
  22. 2024ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videoscited by 10
  23. 2024PPTFormer: Pseudo Multi-Perspective Transformer for UAV Segmentationcited by 10
  24. 2025Structural and Statistical Texture Knowledge Distillation and Learning for Segmentationcited by 9
  25. 2025Multi-Agent VLMs Guided Self-Training with PNU Loss for Low-Resource Offensive Content Detectioncited by 2
  26. 2025Content Moderation Futurescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026BLM-Guard: Explainable Multimodal Ad Moderation with Chain-of-Thought and Policy-Aligned Rewards
  2. 2025AdsQA: Towards Advertisement Video Understanding
  3. 2026AgenticGen: Reward-Guided Agentic Video Generation for Advertising
  4. 2026Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning
  5. 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generation
  6. 2025Improving Generative Ad Text on Facebook using Reinforcement Learning
  7. 2026Test-time Reinforcement Learning for Anomalous Video Understanding
  8. 2026OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training