No-Regret Algorithms in non-Truthful Auctions with Budget and ROI Constraints
Not on the map. Why?
Abstract (arXiv)
Advertisers increasingly use automated bidding to optimize their ad campaigns on online advertising platforms. Autobidding optimizes an advertiser's objective subject to various constraints, e.g. average ROI and budget constraints. In this paper, we study the problem of designing online autobidding algorithms to optimize value subject to ROI and budget constraints when the platform is running any mixture of first and second price auction. We consider the following stochastic setting: There is an item for sale in each of T rounds. In each round, buyers submit bids and an auction is run to sell the item. We focus on one buyer, possibly with budget and ROI constraints. We assume that the buyer's value and the highest competing bid are drawn i.i.d. from some unknown (joint) distribution in each round. We design a low-regret bidding algorithm that satisfies the buyer's constraints. Our benchmark is the objective value achievable by the best possible Lipschitz function that maps values to bids, which is rich enough to best respond to many different correlation structures between value and highest competing bid. Our main result is an algorithm with full information feedback that guarantees a near-optimal tilde O(√ T) regret with respect to the best Lipschitz function. Our result applies to a wide range of auctions, most notably any mixture of first and second price auctions (price is a convex combination of the first and second price). In addition, our result holds for both value-maximizing buyers and quasi-linear utility-maximizing buyers. We also study the bandit setting, where we show an Omega(T2/3) lower bound on the regret for first-price auctions, showing a large disparity between the full information and bandit settings. We also design an algorithm with tilde O(T3/4) regret, when the value distribution is known and is independent of the highest competing bid.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
20 of 37 references.
References · 20
- 2019Introduction to Online Convex Optimizationcited by 793
- 2013Bandits with Knapsackscited by 163
- 2015Explore no more: Improved high-probability regret bounds for non-stochastic banditscited by 120
- 2014Bandits with concave rewards and convex knapsackscited by 83
- 2015Linear Contextual Bandits with Knapsackscited by 82
- 2018Adversarial Bandits with Knapsackscited by 73
- 2020Dual Mirror Descent for Online Allocation Problemscited by 51
- 2020Learning to Bid Optimally and Efficiently in Adversarial First-price Auctionscited by 33
- 2018Contextual Bandits with Cross-learningcited by 31
- 2022Contextual Bandits with Packing and Covering Constraints: A Modular Lagrangian Approach via Regressioncited by 30
- 2020Online Learning with Vector Costs and Bandits with Knapsackscited by 20
- 2023Autobidders with Budget and ROI Constraints: Efficiency, Regret, and Pacing Dynamicscited by 20
8 more
- 2022Budget Pacing in Repeated Auctions: Regret and Efficiency without Convergencecited by 18
- 2022Online Bidding Algorithms for Return-on-Spend Constrained Advertiserscited by 17
- 2023Learning to Bid in Repeated First-Price Auctions with Budgetscited by 14
- 2022Non-monotonic Resource Utilization in the Bandits with Knapsacks Problemcited by 12
- 2023Approximately Stationary Bandits with Knapsackscited by 6
- 2023Bandits with Replenishable Knapsacks: the Best of both Worldscited by 6
- 2022Liquid Welfare Guarantees for No-Regret Learning in Sequential Budgeted Auctionscited by 5
- 2023Online Learning under Budget and ROI Constraints via Weak Adaptivitycited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 2.
9 papers.
- 2024Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial Constraintscited by 10
- 2025Joint Value Estimation and Bidding in Repeated First-Price Auctionscited by 6
- 2025Learning to Bid in Non-Stationary Repeated First-Price Auctionscited by 5
- 2024Games with Payments between Learning Agentscited by 3
- 2025Nearly Tight Bounds for Cross-Learning Contextual Bandits with Graphical Feedbackcited by 1
- 2026From No-Regret to Strategically Robust Learning in Repeated Auctionscited by 1
- 2026Learning to Bid with Unknown Private Values in Budget-Constrained First-Price Auctionscited by 1
- 2025Plan-Driven Adaptive Bidding for First-Price Auctions with Budget Constraints under Nonstationaritycited by 0
- 2025Auto-bidding under Return-on-Spend Constraints with Uncertainty Quantificationcited by 0
- 2026Learning to Bid with Unknown Private Values in Budget-Constrained First-Price Auctions10 May 2026
- 2026From No-Regret to Strategically Robust Learning in Repeated Auctions7 Jan 2026
- 2025Auto-bidding under Return-on-Spend Constraints with Uncertainty Quantification19 Sep 2025
- 2025Plan-Driven Adaptive Bidding for First-Price Auctions with Budget Constraints under Nonstationarity5 May 2025
- 2025Joint Value Estimation and Bidding in Repeated First-Price Auctions24 Feb 2025
- 2025Nearly Tight Bounds for Cross-Learning Contextual Bandits with Graphical Feedback7 Feb 2025
- 2025Learning to Bid in Non-Stationary Repeated First-Price Auctions23 Jan 2025
- 2024Games with Payments between Learning Agents31 May 2024
- 2024Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial Constraints25 May 2024