mlsanityData to 7 Oct 2026

Selective Elicitation as a Commercial Influence Channel: A Reproducible Synthetic Shopping-Agent Stress Test

arXiv 2609.36614 ↗First posted 29 Sep 2026cs.LG cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

A commercial incentive need not enter the final ranking algorithm to affect a shopping assistant's recommendation: it may instead influence which preference question the assistant asks. We make this distinction experimentally observable in a deliberately small, synthetic setting. Each task has two products, three verified numerical attributes, a price limit, and a private fixed preference vector. An honest simulated user answers one pairwise question. A separate recommender receives the products and this answer but not the sponsorship assignment. We contrast a neutral question, a soft commercial instruction, and an explicitly adversarial instruction to ask about the sponsor's advantage while omitting the rival's advantage. Across 40 held-out sponsorship-assignment cases (20 distinct catalog-preference contexts), the soft instruction changes no selections. The targeted instruction raises sponsored selection by 0.30 and reduces mean synthetic utility by 0.0547 relative to neutral questioning (95% context-bootstrap interval [-0.0828, -0.0291]) for one language-model recommender. A fixed Bayesian recommender shows a similar effect; a second model makes the same choices on all 120 frozen question-answer inputs. A terminal-answer consistency judge rates all 20 sampled targeted answers consistent, although five have synthetic regret above 0.05; a separate question-coverage dimension flags their one-sided elicitation. A robust partial-preference certificate remains valid under the stipulated synthetic utility but certifies only 16 of 40 targeted cases and is not better than asking a neutral question directly. These results establish neither typical behavior under advertising incentives nor effects on actual consumers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 13 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

13 of 13 references.

References · 13

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2017Safe Policy Improvement with Baseline Bootstrappingcited by 141
  3. 2026Mind the Sim2Real Gap in User Simulation for Agentic Taskscited by 44
  4. 2026Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluationscited by 36
  5. 2025What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commercecited by 18
  6. 2026Commercial Persuasion in AI-Mediated Conversationscited by 5
  7. 2026A Solicit-Then-Suggest Model of Agentic Purchasingcited by 4
  8. 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
  9. 2026Counterfactual Tool Ranking under Utility, Cost, and Privilege Constraintscited by 3
  10. 2026Mechanism Design for Quality-Preserving LLM Advertisingcited by 2
  11. 2026Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenderscited by 2
  12. 2025Sponsored Questions and How to Auction Themcited by 1
1 more
  1. 2026Generative AI Advertising as a Problem of Trustworthy Commercial Interventioncited by 1

Built on by

Not cited yet.