mlsanityData to 14 Oct 2026

The Language of the Question Selects the Market: Query Language and Exit IP as Separable Factors in Commercial Recommendations from a Generative Search Interface

arXiv 2608.30052 ↗First posted 30 Aug 2026cs.IR cs.CL cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

When a generative search interface answers a commercial question, which market's products it names is decided before the model reasons about the products. We report a controlled probe of 234 runs against the logged-out ChatGPT web interface and the OpenAI API, collected on 29 and 30 August 2026 across four exit countries and six query languages, with six identical runs per cell. Three results. First, the top recommendation is unstable: it changed across six identical runs on four of six prompts, and that rate was identical in the browser interface and in the API with web search both enabled and disabled, so instability is a property of the system and not of the surface. Second, query language, and not location, decides whether local suppliers appear at all. Where the query language matched the country, a global brand won 1 of 24 runs; asked in English on the same connections, local brands took 0 of 6 runs in Estonia and Turkiye. Third, language and location are separable and act on different things: holding the query language fixed and moving only the exit IP moves the market whose brands are named while the answer stays in the query language. We show this on two unrelated pairs, Turkish asked from Berlin and Russian asked from Tallinn, and in both the answer names the resident country's suppliers. A minority language occupies a middle tier: Russian asked from Estonia names an Estonian supplier in 4 of 6 runs and a global one in all six, where Estonian names a local supplier in every run and English names none. A negative control in a second category, coded with the same instrument, shows no language effect at all, and disconfirms our own expectation: that category does have domestic suppliers and none was named in any language, which points the explanation at whether a category is nationally regulated rather than at whether it is nationally supplied.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

18 of 21 references.

References · 18

  1. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  2. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 310
  3. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
  4. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  5. 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
  6. 2024Non-Determinism of "Deterministic" LLM Settingscited by 92
  7. 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 79
  8. 2023GEO: Generative Engine Optimizationcited by 56
  9. 2023Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Modelscited by 43
  10. 2024Retrieval-augmented generation in multilingual settingscited by 27
  11. 2024Large Language Models as Recommender Systems: A Study of Popularity Biascited by 26
  12. 2017Measuring Personalization of Web Searchcited by 20
6 more
  1. 2024"Global is Good, Local is Bad?": Understanding Brand Bias in LLMscited by 15
  2. 2024Multilingual Retrieval Augmented Generation for Culturally-Sensitive Tasks: A Benchmark for Cross-lingual Robustnesscited by 14
  3. 2024Not All Languages are Equal: Insights into Multilingual Retrieval-Augmented Generationcited by 6
  4. 2026The Language Blind Spot: How Query Language and Brand Recognition Tier Shape AI-Constructed Brand Reputation Across Twelve European Languagescited by 4
  5. 2026Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answerscited by 4
  6. 2026How Large Language Models Source Brand Reputation Across Languages and Marketscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.