Remembering Unequally: Global and Disciplinary Bias in LLM Reconstruction of Scholarly Coauthor Lists
Not on the map. Why?
Abstract (arXiv)
Ongoing breakthroughs in large language models (LLMs) are reshaping scholarly search and discovery interfaces. While these systems offer new possibilities for navigating scientific knowledge, they also raise concerns about fairness and representational bias rooted in the models' memorized training data. As LLMs are increasingly used to answer queries about researchers and research communities, their ability to accurately reconstruct scholarly coauthor lists becomes an important but underexamined issue. In this study, we investigate how memorization in LLMs affects the reconstruction of coauthor lists and whether this process reflects existing inequalities across academic disciplines and world regions. We evaluate three prominent models, DeepSeek R1, Llama 4 Scout, and Mixtral 8x7B, by comparing their generated coauthor lists against bibliographic reference data. Our analysis reveals a systematic advantage for highly cited researchers, indicating that LLM memorization disproportionately favors already visible scholars. However, this pattern is not uniform: certain disciplines, such as Clinical Medicine, and some regions, including parts of Africa, exhibit more balanced reconstruction outcomes. These findings highlight both the risks and limitations of relying on LLM-generated relational knowledge in scholarly discovery contexts and emphasize the need for careful auditing of memorization-driven biases in LLM-based systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 1 Nov 2025.
Builds on
18 of 33 references.
References · 18
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 434
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
- 2022Data Contamination: From Memorization to Exploitationcited by 236
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
- 2024Large Language Models are Geographically Biasedcited by 93
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Datacited by 85
- 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 63
- 2024Measuring memorization in language models via probabilistic extractioncited by 41
- 2024ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summarycited by 30
- 2024Realistic Evaluation of Toxicity in Large Language Modelscited by 15
- 2023Fine-Tuning Llama 2 Large Language Models for Detecting Online Sexual Predatory Chats and Abusive Textscited by 13
6 more
- 2024Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopuscited by 10
- 2020Gender and collaboration patterns in a temporal scientific authorship networkcited by 3
- 2024Do LLMs Dream of Ontologies?cited by 3
- 2024An analysis of the suitability of OpenAlex for bibliometric analysescited by 3
- 2024LLMs Prompted for Graphs: Hallucinations and Generative Capabilitiescited by 3
- 2025Protoknowledge Shapes Behaviour of LLMs in Downstream Tasks: Memorization and Generalization with Knowledge Graphscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Large Language Models Reflect Human Citation Patterns with a Heightened Citation Bias
- 2024ResearchArena: Benchmarking Large Language Models' Ability to Collect and Organize Information as Research Agents
- 2024A Comparative Analysis of Faithfulness Metrics and Humans in Citation Evaluation
- 2026Need or Reputation? Region, National Income, and Academic Status in LLM Gatekeeping Decisions
- 2026Large language models for post-publication research evaluation: Evidence from expert recommendations and citation indicators
- 2024Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics
- 2025From Replication to Redesign: Exploring Pairwise Comparisons for LLM-Based Peer Review
- 2024Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Scientific Citations