mlsanityData to 14 Oct 2026

Constrained Auto-Bidding via Generative Response Modeling

arXiv 2605.27811 ↗First posted 27 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Auto-bidding systems aim to maximize advertiser value over long horizons under budget constraints and ratio targets such as cost-per-acquisition, yet future traffic and auction dynamics are non-stationary and uncertain. Existing approaches face distinct limitations: control-based pacing reacts to deviations but cannot anticipate future conditions, while RL and generative methods fold constraints into reward signals, obscuring violations and degrading under distribution shift. We shift the learning target from actions to responses with the Generative Response Model (GRM), a history-conditioned sequence model that jointly predicts future traffic volume and horizon-aggregate cost/value curves as functions of a single bid multiplier. We show that under mild monotonicity conditions, the optimality gap relative to full per-tick control is bounded by the dispersion of per-tick marginal value-per-cost. Given predicted responses, a lightweight analytic controller enforces each active constraint via a 1D root-finding step. We prove this controller is exact for the single-multiplier problem and bound constraint violations under receding-horizon replanning in terms of prediction error. Experiments on AuctionNet show that GRM improves constraint stability and overall score compared to existing baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

19 of 36 references.

References · 19

  1. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  2. 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
  3. 2018Behavioral Cloning from Observationcited by 492
  4. 2017Online Convex Optimization with Stochastic Constraintscited by 95
  5. 2017Real-Time Bidding by Reinforcement Learning in Display Advertisingcited by 91
  6. 2018Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertisingcited by 61
  7. 2018Deep Reinforcement Learning for Sponsored Search Real-time Biddingcited by 34
  8. 2013Real-time Bidding for Online Advertising: Measurement and Analysiscited by 32
  9. 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 29
  10. 2024AuctionNet: A Novel Benchmark for Decision-Making in Large-Scale Gamescited by 28
  11. 2024Auto-bidding and Auctions in Online Advertising: A Surveycited by 26
  12. 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
7 more
  1. 2016Feedback Control of Real-Time Display Advertisingcited by 22
  2. 2021A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertisingcited by 22
  3. 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
  4. 2018Pacing Equilibrium in First-Price Auction Marketscited by 14
  5. 2024Trajectory-wise Iterative Reinforcement Learning Framework for Auto-biddingcited by 9
  6. 2023A Field Guide for Pacing Budget and ROS Constraintscited by 7
  7. 2020Scalable Bid Landscape Forecasting in Real-time Biddingcited by 6

Built on by

Not cited yet.