Incentive-Aware Multi-Fidelity Optimization for Generative Advertising in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Generative advertising in large language model (LLM) responses requires optimizing sponsorship configurations under two strict constraints: the strategic behavior of advertisers and the high cost of stochastic generations. To address this, we propose the Incentive-Aware Multi-Fidelity Mechanism (IAMFM), a unified framework coupling Vickrey-Clarke-Groves (VCG) incentives with Multi-Fidelity Optimization to maximize expected social welfare. We compare two algorithmic instantiations (elimination-based and model-based), revealing their budget-dependent performance trade-offs. Crucially, to make VCG computationally feasible, we introduce Active Counterfactual Optimization, a "warm-start" approach that reuses optimization data for efficient payment calculation. We provide formal guarantees for approximate strategy-proofness and individual rationality, establishing a general approach for incentive-aligned, budget-constrained generative processes. Experiments demonstrate that IAMFM outperforms single-fidelity baselines across diverse budgets.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
31 of 51 references.
References · 31
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 381
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 377
19 more
- 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
- 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 171
- 2017Multi-fidelity Bayesian Optimisation with Continuous Approximationscited by 120
- 2019Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuningcited by 91
- 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
- 2023Word Embeddings Are Steers for Language Modelscited by 70
- 2017Optimal Auctions through Deep Learning: Advances in Differentiable Economicscited by 38
- 2014Complexity of Mechanism Designcited by 33
- 2016Multi-fidelity Gaussian Process Bandit Optimisationcited by 31
- 2018Automated Mechanism Design via Neural Networkscited by 31
- 2020A Permutation-Equivariant Neural Network Architecture For Auction Designcited by 31
- 2020Bridging Machine Learning and Mechanism Design towards Algorithmic Fairnesscited by 30
- 2024Truthful Aggregation of LLMs with an Application to Online Advertisingcited by 29
- 2024Auctions with LLM Summariescited by 24
- 2022Differentiable Economics for Randomized Affine Maximizer Auctionscited by 21
- 2024GemNet: Menu-Based, Strategy-Proof Multi-Bidder Auctions Through Deep Learningcited by 14
- 2024Embedding-Aligned Language Modelscited by 9
- 2025Teach Old SAEs New Domain Tricks with Boostingcited by 5
- 2025An Interpretable Automated Mechanism Design Framework with Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LLM Advertisement based on Neuron Auctionscited by 2
- 2026LLM Advertisement based on Neuron Auctions8 May 2026