mlsanityData to 7 Oct 2026

PRO-Bid: Pareto-Prioritized Regret Optimization for Constraint-Aware Generative Auto-Bidding

arXiv 2602.08261 ↗First posted 9 Feb 2026cs.LG cs.GTcited by 1

Not on the map. Why?

Abstract (arXiv)

Auto-bidding systems strive to maximize marketing value while maintaining high compliance with efficiency constraints, such as Target Cost-Per-Action (CPA). While Decision Transformers offer powerful sequence modeling capabilities, their application to this setting faces two challenges: 1) standard Return-to-Go conditioning causes state aliasing by ignoring the cost dimension, preventing precise resource pacing; and 2) standard regression constrains the policy to mimic historical averages, limiting its capacity to optimize performance near the high-efficiency boundary. To tackle these challenges, we propose PRO-Bid, a constraint-aware generative auto-bidding framework featuring systematic redesigns across data, architecture, and training via two synergistic mechanisms: 1) Constraint-Decoupled Pareto Representation (CDPR) separates global constraints into recursive cost and value contexts to restore resource perception, while reweighting trajectories based on the empirical Pareto frontier to prioritize high-efficiency data; and 2) Counterfactual Regret Optimization (CRO) employs a global predictor to evaluate alternative actions and identify promising local adjustments. By utilizing these high-utility outcomes as weighted regression targets, the model overcomes mean regression and approaches the empirical high-efficiency boundary. Extensive experiments on two public benchmarks and online A/B tests show that PRO-Bid achieves better constraint satisfaction and value acquisition than state-of-the-art baselines.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

20 of 43 references.

References · 20

  1. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  2. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  3. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,245
  4. 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,227
  5. 2023IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policiescited by 307
  6. 2017Online Convex Optimization with Stochastic Constraintscited by 94
  7. 2017Real-Time Bidding by Reinforcement Learning in Display Advertisingcited by 90
  8. 2017Optimized Cost per Click in Taobao Display Advertisingcited by 57
  9. 2018Deep Reinforcement Learning for Sponsored Search Real-time Biddingcited by 34
  10. 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 28
  11. 2024AuctionNet: A Novel Benchmark for Decision-Making in Large-Scale Gamescited by 26
  12. 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
8 more
  1. 2021Robust Auction Design in the Auto-bidding Worldcited by 21
  2. 2021Towards Efficient Auctions in an Auto-bidding Worldcited by 19
  3. 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
  4. 2023Multi-channel Autobidding with Budget and ROI Constraintscited by 14
  5. 2024Trajectory-wise Iterative Reinforcement Learning Framework for Auto-biddingcited by 9
  6. 2023Offline Reinforcement Learning for Optimizing Production Bidding Policiescited by 8
  7. 2025An Adaptable Budget Planner for Enhancing Budget-Constrained Auto-Bidding in Online Advertisingcited by 5
  8. 2025Optimal Return-to-Go Guided Decision Transformer for Auto-Bidding in Advertisementcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing
  2. 2026C2:Cross learning module enhanced decision transformer with Constraint-aware loss for auto-bidding
  3. 2025Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
  4. 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
  5. 2026AIGB-R1: Self-Evolving Generative Auto-Bidding via Hierarchical Planner-Executor Optimization
  6. 2026Generative Auto-Bidding with Unified Modeling and Exploration
  7. 2025Expert-Guided Diffusion Planner for Auto-Bidding
  8. 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising