Learning to Bid with Unknown Private Values in Budget-Constrained First-Price Auctions
Not on the map. Why?
Abstract (arXiv)
We study the operational problem of automated bidding in repeated first-price auctions under budget and return-on-spend (RoS) constraints. In this setting, an auto-bidder must translate advertiser goals and constraints into real-time bids while learning two latent objects: the causal uplift value of each ad impression and the highest competing bid (HoB) needed to win it. We model uplift values and HoBs through a shared-context Linear Treatment Effect (LTE) structure and analyze both full-information and binary HoB feedback. We develop Dual-LTE, a dual-aware online learning framework that coordinates value estimation, HoB estimation, and budget/RoS control through confidence-guided exploration. We prove regret and constraint-violation guarantees that scale as widetildeO(√T) under full-information HoB feedback and widetildeO(T2/3) under binary win/loss feedback, where widetildeO(·) hides problem-dependent and logarithmic factors. Semi-synthetic experiments using real auction covariates show that Dual-LTE achieves lower regret than the baselines across budget and RoS settings, while illustrating the tradeoff between regret and constraint violation. Our results provide operational guidance for DSPs and platform auto-bidders that manage advertiser budgets or seek to meet ROAS targets. When impression values must be learned, value estimation should be coordinated with budget or ROAS control: the auto-bidder should follow the Lagrangian bidding rule only when value estimates are sufficiently accurate given the current constraint pressure and should otherwise use controlled exploration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 52 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
29 of 52 references.
References · 29
- 2014Convex Optimization: Algorithms and Complexitycited by 569
- 2020Nearly Minimax Optimal Reinforcement Learning for Linear Mixture Markov Decision Processescited by 199
- 2013Bandits with Knapsackscited by 163
- 2020Improved Optimistic Algorithms for Logistic Banditscited by 117
- 2015Linear Contextual Bandits with Knapsackscited by 82
- 2018Adversarial Bandits with Knapsackscited by 73
- 2022A Unifying Framework for Online Optimization with Long-Term Constraintscited by 41
- 2020Optimal No-regret Learning in Repeated First-price Auctionscited by 33
- 2020Learning to Bid Optimally and Efficiently in Adversarial First-price Auctionscited by 33
- 2024Auto-bidding and Auctions in Online Advertising: A Surveycited by 26
- 2023Autobidders with Budget and ROI Constraints: Efficiency, Regret, and Pacing Dynamicscited by 20
- 2014Real-Time Bidding Benchmarking with iPinYou Datasetcited by 19
17 more
- 2021Learning to Bid in Contextual First Price Auctionscited by 19
- 2022Budget Pacing in Repeated Auctions: Regret and Efficiency without Convergencecited by 18
- 2022Online Bidding Algorithms for Return-on-Spend Constrained Advertiserscited by 17
- 2018Pacing Equilibrium in First-Price Auction Marketscited by 14
- 2023Learning to Bid in Repeated First-Price Auctions with Budgetscited by 14
- 2022Leveraging the Hints: Adaptive Bidding in Repeated First-Price Auctionscited by 11
- 2024No-Regret Algorithms in non-Truthful Auctions with Budget and ROI Constraintscited by 9
- 2023A Field Guide for Pacing Budget and ROS Constraintscited by 7
- 2019Online Causal Inference for Advertising in Real-Time Bidding Auctionscited by 6
- 2021On the Complexity of Equilibrium Computation in First-Price Auctionscited by 6
- 2025Joint Value Estimation and Bidding in Repeated First-Price Auctionscited by 6
- 2023Complexity of Equilibria in First-Price Auctions under General Tie-Breaking Rulescited by 5
- 2025Learning to Bid in Non-Stationary Repeated First-Price Auctionscited by 5
- 2023Online Learning in Contextual Second-Price Pay-Per-Click Auctionscited by 4
- 2025Online Bidding under RoS Constraints without Knowing the Valuecited by 2
- 2025No-Regret Online Autobidding Algorithms in First-price Auctionscited by 2
- 2026The (Marginal) Value of a Search Ad: An Online Causal Framework for Repeated Second-price Auctionscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.