Source Coverage and Citation Bias in LLM-based vs. Traditional Search Engines
Not on the map. Why?
Abstract (arXiv)
LLM-based Search Engines (LLM-SEs) introduces a new paradigm for information seeking. Unlike Traditional Search Engines (TSEs) (e.g., Google), these systems summarize results, often providing limited citation transparency. The implications of this shift remain largely unexplored, yet raises key questions regarding trust and transparency. In this paper, we present a large-scale empirical study of LLM-SEs, analyzing 55,936 queries and the corresponding search results across six LLM-SEs and two TSEs. We confirm that LLM-SEs cites domain resources with greater diversity than TSEs. Indeed, 37% of domains are unique to LLM-SEs. However, certain risks still persist: LLM-SEs do not outperform TSEs in credibility, political neutrality and safety metrics. Finally, to understand the selection criteria of LLM-SEs, we perform a feature-based analysis to identify key factors influencing source choice. Our findings provide actionable insights for end users, website owners, and developers.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 78 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
30 of 78 references.
References · 30
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023A Comprehensive Overview of Large Language Modelscited by 648
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
- 2022Teaching language models to support answers with verified quotescited by 292
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 98
18 more
- 2018Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulationcited by 63
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systemscited by 37
- 2024Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targetscited by 31
- 2023Accuracy and Political Bias of News Source Credibility Ratings by Large Language Modelscited by 25
- 2024CrAM: Credibility-Aware Attention Modification in LLMs for Combating Misinformation in RAGcited by 22
- 2017Measuring Personalization of Web Searchcited by 20
- 2025Citations and Trust in LLM Generated Responsescited by 18
- 2025Unsafe LLM-Based Search: Quantitative Analysis and Mitigation of Safety Risks in AI Web Searchcited by 16
- 2024Large Language Models vs. Search Engines: Evaluating User Preferences Across Varied Information Retrieval Scenarioscited by 14
- 2022Evaluation Metrics for Measuring Bias in Search Engine Resultscited by 12
- 2023DELPHI: Data for Evaluating LLMs' Performance in Handling Controversial Issuescited by 11
- 2024Comparing Traditional and LLM-based Search for Image Geolocationcited by 10
- 2022Design and Evaluation of IPFS: A Storage Layer for the Decentralized Webcited by 6
- 2024Navigating the Post-API Dilemma | Search Engine Results Pages Present a Biased View of Social Media Datacited by 3
- 2019A Comprehensive Analysis of Twitter Trending Topicscited by 2
- 2022A Large Scale Study and Classification of VirusTotal Reports on Phishing and Malware URLscited by 2
- 2025Decoding News Bias: Multi Bias Detection in News Articlescited by 1
- 2025Social and Political Framing in Search Engine Resultscited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026EcoGEO: Trajectory-Aware Evidence Ecosystems for Web-Enabled LLM Search Agentscited by 3
- 2026Can AI Agents Synthesize Scientific Conclusions?cited by 1
- 2026Verified Misguidance: Measuring Structural Citation Failures in Search-Augmented LLMscited by 0
- 2026Position: Generative Engine Optimization Creates Underexamined Risks, Governance Must Target Concentration, Disclosure, and Academic Blind Spotscited by 0
- 2026From Stochastic to Stable: Rank Stability and Structural Sufficiency in AI Visibility Measurementcited by 0
- 2026What Drives Citations in Production Large Language Models? An Observational Multi-Method Study of Two Million AI Citations Across Ten Thousand Web Pagescited by 0
- 2026What Drives Citations in Production Large Language Models? An Observational Multi-Method Study of Two Million AI Citations Across Ten Thousand Web Pages28 Sep 2026
- 2026From Stochastic to Stable: Rank Stability and Structural Sufficiency in AI Visibility Measurement11 Jul 2026
- 2026Can AI Agents Synthesize Scientific Conclusions?9 Jun 2026
- 2026Verified Misguidance: Measuring Structural Citation Failures in Search-Augmented LLMs27 May 2026
- 2026Position: Generative Engine Optimization Creates Underexamined Risks, Governance Must Target Concentration, Disclosure, and Academic Blind Spots18 May 2026
- 2026EcoGEO: Trajectory-Aware Evidence Ecosystems for Web-Enabled LLM Search Agents13 May 2026