Ad Insertion in LLM-Generated Responses
Not on the map. Why?
Abstract (arXiv)
Sustainable monetization of large language models (LLMs) remains a critical open challenge. Traditional search advertising, which relies on static keywords, fails to capture the fleeting, context-dependent user intent---the specific information, goods, or services a user seeks---embedded in conversational flows. Beyond the standard goal of social welfare maximization effective LLM advertising requires contextual coherence (aligning ads semantically with transient user intent), computational efficiency (avoiding user-facing latency), and adherence to ethical and regulatory standards, including privacy preservation and explicit ad disclosure. Although recent solutions have explored bidding at the token and query levels, neither category holistically satisfies these constraints. We propose a framework that resolves these tensions through two decoupling strategies. First, we decouple ad insertion from response generation to facilitate pre-screening and explicit disclosure. Second, we decouple bidding from specific user queries by using ``genres'' (high-level semantic clusters) as a proxy. This allows advertisers to bid on stable categories rather than sensitive real-time responses, reducing computational burden and privacy risks. Applying the VCG auction mechanism to this genre-based framework provides approximate guarantees for dominant-strategy incentive compatibility (DSIC), individual rationality (IR), and social welfare. In synthetic experiments with 105 advertisers and 100 candidate slots, VCG clears in approximately 1.25 seconds on a consumer-grade laptop. Finally, we introduce an ``LLM-as-a-Judge'' metric for estimating contextual coherence. Its predictions correlate with mean human ratings at Spearman's ρ≈ 0.66 and have a higher correlation with the leave-one-out group mean than 29 of 36 individual raters (80.6%).
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
29 of 60 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2024GPT-4o System Cardcited by 4,588
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
17 more
- 2023GPTScore: Evaluate as You Desirecited by 361
- 2023Benchmarking Foundation Models with Language-Model-as-an-Examinercited by 172
- 2023CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generationcited by 66
- 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 30
- 2022The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimizationcited by 29
- 2024Truthful Aggregation of LLMs with an Application to Online Advertisingcited by 29
- 2024Auctions with LLM Summariescited by 24
- 2024Benchmarking LLMs' Judgments with No Gold Standardcited by 19
- 2024Ad Auctions for LLMs via Retrieval Augmented Generationcited by 18
- 2023Online Advertisements with LLMs: Opportunities and Challengescited by 17
- 2024Eliciting Informative Text Evaluations with Large Language Modelscited by 15
- 2016Scalable Semantic Matching of Queries to Ads in Sponsored Search Advertisingcited by 12
- 2025LLM-Auction: Generative Auction towards LLM-Native Advertisingcited by 12
- 2024Sponsored Question Answeringcited by 7
- 2024Data-Driven Mechanism Design: Jointly Eliciting Preferences and Informationcited by 7
- 2024Ads in Conversationscited by 4
- 2024Recommendation and Temptationcited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026LLM Advertisement based on Neuron Auctionscited by 2
- 2026NaiAD: Initiate Data-Driven Research for LLM Advertisingcited by 2
- 2026LERA: LLM-Enhanced RAG for Ad Auction in Generative Chatbotscited by 2
- 2026PILA: Plug-and-Play Insertion for LLM-native Advertisingcited by 2
- 2026Generative AI Advertising as a Problem of Trustworthy Commercial Interventioncited by 1
- 2026Evaluating and Pricing Advertisements in AI-Generated Responsescited by 1
- 2026Token-Level Advertisingcited by 0
- 2026LLMAdBench: A Human Preference Benchmark for Advertising in LLM Responsescited by 0
- 2026LLMAdBench: A Human Preference Benchmark for Advertising in LLM Responses26 Sep 2026
- 2026Token-Level Advertising27 Aug 2026
- 2026Evaluating and Pricing Advertisements in AI-Generated Responses30 Jul 2026
- 2026PILA: Plug-and-Play Insertion for LLM-native Advertising28 Jul 2026
- 2026Generative AI Advertising as a Problem of Trustworthy Commercial Intervention18 May 2026
- 2026LERA: LLM-Enhanced RAG for Ad Auction in Generative Chatbots15 May 2026
- 2026NaiAD: Initiate Data-Driven Research for LLM Advertising11 May 2026
- 2026LLM Advertisement based on Neuron Auctions8 May 2026