mlsanityData to 14 Oct 2026

ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring

arXiv 2605.02200 ↗First posted 4 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Online advertising governance faces significant challenges due to the non-stationary nature of regulatory policies, where emerging mandates (e.g., restrictions on education or aesthetic anxiety) create severe label inconsistencies and reasoning ambiguities in historical datasets. In this paper, we propose ARGUS, a policy-adaptive governance system that enables evolving reinforcement through multi-agent adversarial umpiring. ARGUS addresses the sparsity of new policy data by employing a three-stage framework: (1) Policy Seeding for initial perception; (2) Adversarial Label Rectification, which utilizes a ``Prosecutor-Defender-Umpire'' architecture to resolve conflicts between stale labels and new mandates; and (3) Latent Knowledge Discovery, which employs a tripartite dialectical discussion to unearth sophisticated, ``gray-area'' violations. By leveraging RAG-enhanced policy knowledge and Chain-of-Thought synthesis as dynamic rewards for reinforcement learning, ARGUS synchronizes its reasoning pathways with evolving regulations. Extensive experiments on both industrial and public datasets demonstrate that ARGUS significantly outperforms traditional fine-tuning baselines, achieving superior policy-adaptive learning with minimal gold data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

33 of 48 references.

References · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  6. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
  7. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 373
  8. 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 323
  9. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
  10. 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 272
  11. 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 232
  12. 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
21 more
  1. 2024Direct Preference Optimization with an Offsetcited by 122
  2. 2024IBD: Alleviating Hallucinations in Large Vision-Language Models via Image-Biased Decodingcited by 118
  3. 2014Curriculum Learning of Multiple Taskscited by 66
  4. 2025Overcoming catastrophic forgetting in neural networkscited by 55
  5. 2021Learning Statistical Texture for Semantic Segmentationcited by 51
  6. 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
  7. 2023Structural and Statistical Texture Knowledge Distillation for Semantic Segmentationcited by 36
  8. 2024ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbationscited by 31
  9. 2024MLLM-as-a-Judge for Image Safety without Human Labelingcited by 23
  10. 2023Ultra-High Resolution Segmentation with Ultra-Rich Context: A Novel Benchmarkcited by 22
  11. 2024Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understandingcited by 20
  12. 2023Guided Patch-Grouping Wavelet Transformer with Spatial Congruence for Ultra-High Resolution Segmentationcited by 16
  13. 2024Discrete Latent Perspective Learning for Segmentation and Detectioncited by 16
  14. 2025Retrv-R1: A Reasoning-Driven MLLM Framework for Universal and Efficient Multimodal Retrievalcited by 12
  15. 2024ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videoscited by 10
  16. 2025Structural and Statistical Texture Knowledge Distillation and Learning for Segmentationcited by 9
  17. 2025RAVEN: Robust Advertisement Video Violation Temporal Grounding via Reinforcement Reasoningcited by 5
  18. 2025Towards Trustworthy Multimodal Moderation via Policy-Aligned Reasoning and Hierarchical Labelingcited by 4
  19. 2025RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoningcited by 4
  20. 2026BLM-Guard: Explainable Multimodal Ad Moderation with Chain-of-Thought and Policy-Aligned Rewardscited by 3
  21. 2026StreamSense: Streaming Social Task Detection with Selective Vision-Language Model Routingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Improving Generative Ad Text on Facebook using Reinforcement Learning
  2. 2026DARA: Few-shot Budget Allocation in Online Advertising via In-Context Decision Making with RL-Finetuned LLMs
  3. 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generation
  4. 2026HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
  5. 2026Towards Faithful Industrial RAG: A Reinforced Co-adaptation Framework for Advertising QA
  6. 2026Generative Auto-Bidding with Unified Modeling and Exploration
  7. 2026AdsWorldEngine: A Self-Evolving Conversational Advertising Agent through Orchestrator and Tool Coevolution
  8. 2026PAWS: Policy-driven Agentic World Simulation