mlsanityData to 14 Oct 2026

Ad Insertion in LLM-Generated Responses

arXiv 2601.19435 ↗First posted 27 Jan 2026cs.GT cs.AI cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Sustainable monetization of large language models (LLMs) remains a critical open challenge. Traditional search advertising, which relies on static keywords, fails to capture the fleeting, context-dependent user intent---the specific information, goods, or services a user seeks---embedded in conversational flows. Beyond the standard goal of social welfare maximization effective LLM advertising requires contextual coherence (aligning ads semantically with transient user intent), computational efficiency (avoiding user-facing latency), and adherence to ethical and regulatory standards, including privacy preservation and explicit ad disclosure. Although recent solutions have explored bidding at the token and query levels, neither category holistically satisfies these constraints. We propose a framework that resolves these tensions through two decoupling strategies. First, we decouple ad insertion from response generation to facilitate pre-screening and explicit disclosure. Second, we decouple bidding from specific user queries by using ``genres'' (high-level semantic clusters) as a proxy. This allows advertisers to bid on stable categories rather than sensitive real-time responses, reducing computational burden and privacy risks. Applying the VCG auction mechanism to this genre-based framework provides approximate guarantees for dominant-strategy incentive compatibility (DSIC), individual rationality (IR), and social welfare. In synthetic experiments with 105 advertisers and 100 candidate slots, VCG clears in approximately 1.25 seconds on a consumer-grade laptop. Finally, we introduce an ``LLM-as-a-Judge'' metric for estimating contextual coherence. Its predictions correlate with mean human ratings at Spearman's ρ≈ 0.66 and have a higher correlation with the leave-one-out group mean than 29 of 36 individual raters (80.6%).

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

29 of 60 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  8. 2017On Calibration of Modern Neural Networkscited by 4,960
  9. 2024GPT-4o System Cardcited by 4,588
  10. 2017Deep reinforcement learning from human preferencescited by 3,912
  11. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  12. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
17 more
  1. 2023GPTScore: Evaluate as You Desirecited by 361
  2. 2023Benchmarking Foundation Models with Language-Model-as-an-Examinercited by 172
  3. 2023CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generationcited by 66
  4. 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 30
  5. 2022The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimizationcited by 29
  6. 2024Truthful Aggregation of LLMs with an Application to Online Advertisingcited by 29
  7. 2024Auctions with LLM Summariescited by 24
  8. 2024Benchmarking LLMs' Judgments with No Gold Standardcited by 19
  9. 2024Ad Auctions for LLMs via Retrieval Augmented Generationcited by 18
  10. 2023Online Advertisements with LLMs: Opportunities and Challengescited by 17
  11. 2024Eliciting Informative Text Evaluations with Large Language Modelscited by 15
  12. 2016Scalable Semantic Matching of Queries to Ads in Sponsored Search Advertisingcited by 12
  13. 2025LLM-Auction: Generative Auction towards LLM-Native Advertisingcited by 12
  14. 2024Sponsored Question Answeringcited by 7
  15. 2024Data-Driven Mechanism Design: Jointly Eliciting Preferences and Informationcited by 7
  16. 2024Ads in Conversationscited by 4
  17. 2024Recommendation and Temptationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.