Generative Optimization for Incentivized Advertising with Global Level Constraints
Not on the map. Why?
Abstract (arXiv)
Incentivized advertising allocates monetary or virtual rewards to drive user engagement, where a key challenge is optimizing continuous incentive magnitudes under strict global constraints. This problem is complicated by high-frequency interactions, delayed feedback, and non-Markovian user dynamics such as fatigue, which limit the effectiveness of existing uplift modeling and constrained reinforcement learning approaches. To address these challenges, we propose GOAL, a constraint-aware generative framework that formulates incentive allocation as a conditional sequence generation problem. GOAL directly generates incentive magnitudes conditioned on user histories and system-level global pressure, and integrates a hierarchical causal state encoder to capture both local behavioral dynamics and long-range dependencies. To enable flexible constraint control, we introduce Safe Constrained Policy Optimization (SCPO), which learns a single generative policy that generalizes across a spectrum of ROI constraints without retraining. Experiments on large-scale real-world data and a synthetic fatigue-aware environment show that GOAL improves long-term revenue and user retention while substantially reducing ROI violation rates compared to strong baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 48 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
35 of 48 references.
References · 35
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 465
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2021Early Convolutions Help Transformers See Bettercited by 396
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
23 more
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2019Do NLP Models Know Numbers? Probing Numeracy in Embeddingscited by 159
- 2018Deep Reinforcement Learning for Page-wise Recommendationscited by 100
- 2020TUTA: Tree-based Transformers for Generally Structured Table Pre-trainingcited by 100
- 2019Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systemscited by 90
- 2018Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertisingcited by 61
- 2023A Survey on Transformers in Reinforcement Learningcited by 50
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2019A Unified Framework for Marketing Budget Allocationcited by 33
- 2023Safe Offline Reinforcement Learning with Real-Time Budget Constraintscited by 28
- 2021E-Commerce Promotions Personalization via Online Multiple-Choice Knapsack with Uplift Modelingcited by 21
- 2020Free Lunch! Retrospective Uplift Modeling for Dynamic Promotions Recommendation within ROI Constraintscited by 20
- 2022LBCF: A Large-Scale Budget-Constrained Causal Forest Algorithmcited by 17
- 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
- 2023Model-based Constrained MDP for Budget Allocation in Sequential Incentive Marketingcited by 15
- 2024Generative Regression Based Watch Time Prediction for Short-Video Recommendationcited by 13
- 2024Decision Focused Causal Learning for Direct Counterfactual Marketing Optimizationcited by 9
- 2023Offline Reinforcement Learning for Optimizing Production Bidding Policiescited by 8
- 2022BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotioncited by 3
- 2025Pantheon: Personalized Multi-objective Ensemble Sort via Iterative Pareto Policy Optimizationcited by 3
- 2025Session-Level Dynamic Ad Load Optimization using Offline Robust Reinforcement Learningcited by 2
- 2024Modeling User Fatigue for Sequential Recommendationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Allocate Incentives for Incentivized Advertising via Offline Model-Based Reinforcement Learning
- 2025Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
- 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising
- 2025Enhancing Generative Auto-bidding with Offline Reward Evaluation and Policy Search
- 2025Generative Modeling with Multi-Instance Reward Learning for E-commerce Creative Optimization
- 2026DARA: Few-shot Budget Allocation in Online Advertising via In-Context Decision Making with RL-Finetuned LLMs
- 2026Generative Auto-Bidding with Unified Modeling and Exploration
- 2026PRO-Bid: Pareto-Prioritized Regret Optimization for Constraint-Aware Generative Auto-Bidding