PRO-Bid: Pareto-Prioritized Regret Optimization for Constraint-Aware Generative Auto-Bidding
Not on the map. Why?
Abstract (arXiv)
Auto-bidding systems strive to maximize marketing value while maintaining high compliance with efficiency constraints, such as Target Cost-Per-Action (CPA). While Decision Transformers offer powerful sequence modeling capabilities, their application to this setting faces two challenges: 1) standard Return-to-Go conditioning causes state aliasing by ignoring the cost dimension, preventing precise resource pacing; and 2) standard regression constrains the policy to mimic historical averages, limiting its capacity to optimize performance near the high-efficiency boundary. To tackle these challenges, we propose PRO-Bid, a constraint-aware generative auto-bidding framework featuring systematic redesigns across data, architecture, and training via two synergistic mechanisms: 1) Constraint-Decoupled Pareto Representation (CDPR) separates global constraints into recursive cost and value contexts to restore resource perception, while reweighting trajectories based on the empirical Pareto frontier to prioritize high-efficiency data; and 2) Counterfactual Regret Optimization (CRO) employs a global predictor to evaluate alternative actions and identify promising local adjustments. By utilizing these high-utility outcomes as weighted regression targets, the model overcomes mean regression and approaches the empirical high-efficiency boundary. Extensive experiments on two public benchmarks and online A/B tests show that PRO-Bid achieves better constraint satisfaction and value acquisition than state-of-the-art baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
20 of 43 references.
References · 20
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,245
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,227
- 2023IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policiescited by 307
- 2017Online Convex Optimization with Stochastic Constraintscited by 94
- 2017Real-Time Bidding by Reinforcement Learning in Display Advertisingcited by 90
- 2017Optimized Cost per Click in Taobao Display Advertisingcited by 57
- 2018Deep Reinforcement Learning for Sponsored Search Real-time Biddingcited by 34
- 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 28
- 2024AuctionNet: A Novel Benchmark for Decision-Making in Large-Scale Gamescited by 26
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
8 more
- 2021Robust Auction Design in the Auto-bidding Worldcited by 21
- 2021Towards Efficient Auctions in an Auto-bidding Worldcited by 19
- 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
- 2023Multi-channel Autobidding with Budget and ROI Constraintscited by 14
- 2024Trajectory-wise Iterative Reinforcement Learning Framework for Auto-biddingcited by 9
- 2023Offline Reinforcement Learning for Optimizing Production Bidding Policiescited by 8
- 2025An Adaptable Budget Planner for Enhancing Budget-Constrained Auto-Bidding in Online Advertisingcited by 5
- 2025Optimal Return-to-Go Guided Decision Transformer for Auto-Bidding in Advertisementcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing
- 2026C2:Cross learning module enhanced decision transformer with Constraint-aware loss for auto-bidding
- 2025Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
- 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
- 2026AIGB-R1: Self-Evolving Generative Auto-Bidding via Hierarchical Planner-Executor Optimization
- 2026Generative Auto-Bidding with Unified Modeling and Exploration
- 2025Expert-Guided Diffusion Planner for Auto-Bidding
- 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising