Divergent Recommendations, Convergent Diagnoses: Cross-Provider Failure-Mode Convergence in AI Commercial Recommendation
Not on the map. Why?
Abstract (arXiv)
A brand whose customers use both ChatGPT and Claude for product recommendations faces a strategic choice: a single optimization playbook, or one per provider? Across 215 commercially-framed prompts in four measurement batches, the two providers disagree on which brands they recommend roughly two-thirds of the time (cross-provider recommendation Jaccard 0.35, below the 0.50-0.61 same-prompt rerun baseline). The picks diverge. But when neither provider recommends a brand, we classify the failure into one of three modes -- discoverability (the brand never reaches the model), compellingness (it reaches the model but isn't mentioned), or positioning (it's mentioned but not recommended) -- and on 7,763 such joint failures, both providers diagnose the same failure mode 95.1% of the time (clustered 95% CI [94.3%, 95.7%]). Agreement rises monotonically with falling brand prominence, from 81% [78.2%, 84.0%] on category leaders to 99.6% [99.3%, 99.9%] on long-tail regional brands. The two providers reach their picks by measurably different generative routes -- Anthropic recommends from priors 43-52% of the time, OpenAI 8-29% -- but they converge on the failure diagnosis where it matters most for the long tail. Work that addresses the diagnosed failure mode lifts visibility on both providers; positioning - and content-level work for category leaders is more provider-specific.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
9 of 15 references.
References · 9
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2024Knowledge Conflicts for LLMs: A Surveycited by 283
- 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 91
- 2023GEO: Generative Engine Optimizationcited by 56
- 2024LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversitycited by 42
- 2025A comprehensive taxonomy of hallucinations in Large Language Modelscited by 18
- 2024Context-Parametric Inversion: Why Instruction Finetuning Can Worsen Context Reliancecited by 10
- 2025News Source Citing Patterns in AI Search Systemscited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.