mlsanityData to 7 Oct 2026

Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact

arXiv 2605.14021 ↗First posted 13 May 2026cs.CY cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Google AI Overviews (AIOs) are arguably the most widely encountered deployment of generative AI, reaching over 2 billion users who may not realize the answers they see are AI-generated. Where search engines have traditionally surfaced ranked sources and left users to evaluate them, AIOs synthesize and deliver a single answer - giving Google unprecedented editorial control over what users read and know. We present a large-scale longitudinal measurement study, issuing 55,393 trending queries across 19 topical categories over a 40-day window (March 13 - April 21, 2026). We report four main findings. First, overall AIO activation is 13.7%, rising to 64.7% for question-form queries, while politically sensitive topics see markedly lower rates. Second, AIO-cited domains are more credible than co-displayed first-page results, yet nearly 30% do not appear in those results at all, indicating a source selection mechanism distinct from Google's ranking algorithm. Third, decomposing responses into 98,020 atomic claims, 11.0% are unsupported by the cited pages - with omission the dominant failure mode - and source quality and claim fidelity are largely independent. Fourth, well over half of AIO-cited pages carry display advertising, meaning publishers lose revenue when AIOs suppress the click-through, even as Google's own sponsored ads continue to appear on the same page. Together, these findings document a rapid transformation of the online information ecosystem whose consequences for epistemic security remain poorly understood.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

25 of 74 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  5. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  6. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  7. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  8. 2025Why Language Models Hallucinatecited by 205
  9. 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 170
  10. 2018Predicting Factuality of Reporting and Bias of News Media Sourcescited by 71
  11. 2024Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoningcited by 69
  12. 2023GEO: Generative Engine Optimizationcited by 53
13 more
  1. 2018Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learningcited by 50
  2. 2017Measuring Personalization of Web Searchcited by 20
  3. 2025CiteEval: Principle-Driven Citation Evaluation for Source Attributioncited by 19
  4. 2025Towards Effective Extraction and Evaluation of Factual Claimscited by 18
  5. 2024Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responsescited by 15
  6. 2024An In-Depth Investigation of Data Collection in LLM App Ecosystemscited by 14
  7. 2024Reliability Estimation of News Media Sources: Birds of a Feather Flock Togethercited by 7
  8. 2025Auditing Google's AI Overviews and Featured Snippets: A Case Study on Baby Care and Pregnancycited by 7
  9. 2021OVRseen: Auditing Network Traffic and Privacy Policies in Oculus VRcited by 4
  10. 2026The Rise of AI Search: Implications for Information Markets and Human Judgement at Scalecited by 4
  11. 2026Impact of AI Search Summaries on Website Traffic: Evidence from Google AI Overviews and Wikipediacited by 4
  12. 2025What does the public want their local government to hear? A data-driven case study of public comments across the state of Michigancited by 1
  13. 2025AI summaries in online search influence users' attitudescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.