CHASE: How Content Ecosystems Are Reshaped When Ranking Is the Only Target
Not on the map. Why?
Abstract (arXiv)
Generative Engine Optimization (GEO) is increasingly used to improve content visibility in LLM-based retrieval systems, yet its population-level effects under repeated optimization remain poorly understood. We introduce Content Homogenization under rAnking Signal Exploitation (CHASE), a controlled simulation framework for studying how content ecosystems are reshaped when creators repeatedly adapt documents to an LLM ranking signal. We use ranking as a proxy for source visibility and validate this abstraction against citations in grounded generated responses, obtaining a rank-citation AUC of 0.853 ± 0.093 across six domains. CHASE then iterates ranking, feature discrimination, rewriting, and evaluation over 20 rounds across different domains. Quality-ranking alignment decreases in all six domains: from R0 to R20, the change in Spearman's rho ranges from -0.107 to -0.018, with a mean change of -0.068, which means documents closer to the ranking feature profile become less aligned with independently judged document quality over the simulation horizon. A random-target control has shown that it is associated with adaptation toward ranking-derived incentives rather than iterative rewriting alone. The resulting ecosystem dynamics are strongly domain-dependent. Together, these findings show how repeated optimization against a fixed LLM ranking signal can reshape both content populations and the incentives faced by content creators.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
15 of 25 references.
References · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2020Performative Predictioncited by 327
- 2015Strategic Classificationcited by 257
- 2022Defining and Characterizing Reward Hackingcited by 203
- 2018Categorizing Variants of Goodhart's Lawcited by 149
- 2023GEO: Generative Engine Optimizationcited by 56
- 2023Goodhart's Law in Reinforcement Learningcited by 41
- 2024Manipulating Large Language Models to Increase Product Visibilitycited by 28
- 2024Catastrophic Goodhart: regularizing RLHF with KL divergence does not mitigate heavy-tailed reward misspecificationcited by 23
- 2025What Generative Search Engines Like and How to Optimize Web Content Cooperativelycited by 13
3 more
- 2023The Search for Stability: Learning Dynamics of Strategic Publishers with Initial Documentscited by 4
- 2026Controlling Output Rankings in Generative Engines for LLM-based Searchcited by 3
- 2026Think Before Writing: Feature-Level Multi-Objective Optimization for Generative Citation Visibilitycited by 3
Built on by
Not cited yet.