Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact
Not on the map. Why?
Abstract (arXiv)
Google AI Overviews (AIOs) are arguably the most widely encountered deployment of generative AI, reaching over 2 billion users who may not realize the answers they see are AI-generated. Where search engines have traditionally surfaced ranked sources and left users to evaluate them, AIOs synthesize and deliver a single answer - giving Google unprecedented editorial control over what users read and know. We present a large-scale longitudinal measurement study, issuing 55,393 trending queries across 19 topical categories over a 40-day window (March 13 - April 21, 2026). We report four main findings. First, overall AIO activation is 13.7%, rising to 64.7% for question-form queries, while politically sensitive topics see markedly lower rates. Second, AIO-cited domains are more credible than co-displayed first-page results, yet nearly 30% do not appear in those results at all, indicating a source selection mechanism distinct from Google's ranking algorithm. Third, decomposing responses into 98,020 atomic claims, 11.0% are unsupported by the cited pages - with omission the dominant failure mode - and source quality and claim fidelity are largely independent. Fourth, well over half of AIO-cited pages carry display advertising, meaning publishers lose revenue when AIOs suppress the click-through, even as Google's own sponsored ads continue to appear on the same page. Together, these findings document a rapid transformation of the online information ecosystem whose consequences for epistemic security remain poorly understood.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
25 of 74 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2023Evaluating Verifiability in Generative Search Enginescited by 297
- 2025Why Language Models Hallucinatecited by 205
- 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 170
- 2018Predicting Factuality of Reporting and Bias of News Media Sourcescited by 71
- 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoningcited by 69
- 2023GEO: Generative Engine Optimizationcited by 53
13 more
- 2018Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learningcited by 50
- 2017Measuring Personalization of Web Searchcited by 20
- 2025CiteEval: Principle-Driven Citation Evaluation for Source Attributioncited by 19
- 2025Towards Effective Extraction and Evaluation of Factual Claimscited by 18
- 2024Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responsescited by 15
- 2024An In-Depth Investigation of Data Collection in LLM App Ecosystemscited by 14
- 2024Reliability Estimation of News Media Sources: Birds of a Feather Flock Togethercited by 7
- 2025Auditing Google's AI Overviews and Featured Snippets: A Case Study on Baby Care and Pregnancycited by 7
- 2021OVRseen: Auditing Network Traffic and Privacy Policies in Oculus VRcited by 4
- 2026The Rise of AI Search: Implications for Information Markets and Human Judgement at Scalecited by 4
- 2026Impact of AI Search Summaries on Website Traffic: Evidence from Google AI Overviews and Wikipediacited by 4
- 2025What does the public want their local government to hear? A data-driven case study of public comments across the state of Michigancited by 1
- 2025AI summaries in online search influence users' attitudescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.