mlsanityData to 14 Oct 2026

Scoring Without the Engine: Validating a Deterministic, Manipulation-Resistant Content Score for Generative Engines, End to End

arXiv 2609.07559 ↗First posted 7 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

How do you validate a cheap, deterministic proxy for an oracle that is expensive, rate-limited, and non-stationary? We present a protocol built on adversarial falsification gates (negative control, dose response, bounded amplification, duplication penalty, length neutrality) that define and select the proxy, fitted on a training split and confirmed held-out; around them it bounds what the proxy can never resolve, and re-measures external causal evidence on the current oracle rather than assuming it. We demonstrate it end to end on Generative Engine Optimization, where the proxy is a deterministic content score, and one step fails on that domain exactly as the protocol is built to detect: re-measuring the only published causal anchors (2023 effect sizes) on ten modern engine families shows their levers move citation on none, so the anchors are an expired external check; recalibrating to the near-zero modern vector strips the score of its lever-responsive components. What survives is the gate-enforced response surface. The gates buy a measured property: on a 500-source benchmark of adversarial edits, amplifying the score's calibrated levers gains an attacker at most 6 points, and decreases with dose; single-lever amplification is provably bounded, while the cap and cross-lever sub-additivity are empirical findings consistent with it. On detection, web-spam baselines dominate and out-of-distribution attacks evade the score, so the deployable filter layers it over them. A query-conditioned skyline bounds the score's citation signal (within-query Spearman 0.11), repositioning query-agnostic scores as quality filters rather than citation predictors. A query-leakage bug in our first ranking evaluation and a failed confidence flag are disclosed and corrected; every number reproduces offline from released artifacts at zero marginal API cost.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

15 of 29 references.

References · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  3. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 548
  4. 2019Measurement and Fairnesscited by 308
  5. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  6. 2018Categorizing Variants of Goodhart's Lawcited by 149
  7. 2021Revisiting the Uniform Information Density Hypothesiscited by 68
  8. 2023GEO: Generative Engine Optimizationcited by 56
  9. 2024Ranking Manipulation for Conversational Search Enginescited by 26
  10. 2025C-SEO Bench: Does Conversational SEO Work?cited by 11
  11. 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimizationcited by 6
  12. 2026Structural Feature Engineering for Generative Engine Optimization: How Content Structure Shapes Citation Behaviorcited by 5
3 more
  1. 2026Impact of AI Search Summaries on Website Traffic: Evidence from Google AI Overviews and Wikipediacited by 4
  2. 2026From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learningcited by 4
  3. 2026Generative Engine Optimization: A VLM and Agent Framework for Pinterest Acquisition Growthcited by 1

Built on by

Not cited yet.