GEO-Flag: Detecting and Measuring GEO-Optimized Web Content
Not on the map. Why?
Abstract (arXiv)
Generative Engine Optimization (GEO) modifies web content to increase its likelihood of being selected and cited by generative search engines. This can give strategically optimized pages visibility disproportionate to their authority or relevance and even make weak or false information appear well supported. Unlike conventional search, generative search synthesizes information into direct answers rather than presenting competing sources, which can further amplify these risks, as assessing source provenance and authority requires additional user interaction. Despite these concerns, systematic methods for detecting GEO-optimized webpages remain underexplored. We introduce textttGEOFlagBench, a benchmark of 3,200 web content instances spanning 400 queries, four domains, and eight GEO optimizer families, and use it to systematically evaluate existing GEO detection methods. Although the strongest baseline achieves an aggregate F1 of 0.880, method-level and authorship-conditioned evaluations reveal substantial weaknesses and potential reliance on authorship-related shortcuts. We therefore propose Intervention-Paired Training (IPT), which supervises detector responses to GEO interventions and non-GEO AI polishing; on ModernBERT, IPT improves F1 from 0.862 to 0.944 and worst-group accuracy from 0.725 to 0.883. We develop a GEO-gated Agent system for auditing the Source Tier and verifiability of Citation URLs in detected GEO pages. Finally, we deploy the complete pipeline on released Google Search and Gemini-grounded retrieval results for 1,000 real-user queries. Across 10,095 available pages, we estimate an overall GEO prevalence of 8.90%, reaching 16.36% among pages modified in 2026. Our results establish a foundation for systematically detecting, auditing, and measuring GEO in real-world search ecosystems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
25 of 45 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2023Evaluating Verifiability in Generative Search Enginescited by 303
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
13 more
- 2023GEO: Generative Engine Optimizationcited by 56
- 2024Adversarial Search Engine Optimization for Large Language Modelscited by 40
- 2020ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Searchcited by 34
- 2025IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrievalcited by 16
- 2025What Generative Search Engines Like and How to Optimize Web Content Cooperativelycited by 13
- 2025C-SEO Bench: Does Conversational SEO Work?cited by 11
- 2025FinSight: Towards Real-World Financial Deep Researchcited by 9
- 2025E-GEO: A Testbed for Generative Engine Optimization in E-Commercecited by 8
- 2025Role-Augmented Intent-Driven Generative Search Engine Optimizationcited by 5
- 2025Characterizing Web Search in The Age of Generative AIcited by 5
- 2026SafeGEO: Understanding Generative Engine Optimization Risks in Recommendation Agentscited by 4
- 2026How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviewscited by 2
- 2026GEO-Bench: Benchmarking Ranking Manipulation in Generative Engine Optimizationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.