Mapping Scientific Literature with Large Language Models and Topic Modeling
Not on the map. Why?
Abstract (arXiv)
Scientific literature is increasingly fragmented by disciplinary boundaries, specialized terminology, and potentially sparse keyword systems, making it difficult to capture the evolving structure of modern science. This study introduces a large language model (LLM)-driven framework for mapping scientific literature from a topic modeling perspective. The approach is demonstrated on a 20-year corpus of more than 1,500 engineering-related articles published in the Proceedings of the National Academy of Sciences (PNAS). A two-stage classification pipeline first assigns a primary thematic category to each article based on its abstract, followed by full-text analysis to identify secondary classifications that reveal latent cross-topic connections within the corpus. Unlike conventional topic models, the LLM-based framework produces semantically interpretable topics while maintaining strong quantitative performance. Comparative evaluation against established topic modeling methods shows higher topic diversity and lower overlap with competitive coherence metrics. Manual validation on a randomly sampled subset of abstracts yields an accuracy of 75.9%. Additional traditional natural language processing analyses confirm that the generated topics correspond to meaningful linguistic patterns in the corpus. A bipartite network linking primary and secondary classifications further reveals implicit thematic relationships that are not readily observable through abstracts or keyword systems alone. The findings indicate that the framework independently recovers much of the journal's editorial dual-classification structure without prior knowledge of its schema. Overall, the proposed approach offers a powerful tool for mapping science and identifying emerging cross-topic connections in research.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 88 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
20 of 88 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 361
- 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 163
- 2024Scientific Large Language Models: A Survey on Biological & Chemical Domainscited by 80
- 2020Automated Lay Language Summarization of Biomedical Scientific Reviewscited by 46
- 2023Explaining How Transformers Use Context to Build Predictionscited by 43
- 2022Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processingcited by 23
8 more
- 2024A Survey on Neural Topic Models: Methods, Applications, and Challengescited by 18
- 2023Personalized Jargon Identification for Enhanced Interdisciplinary Communicationcited by 12
- 2023On the rise of fear speech in online social mediacited by 5
- 2024From Complexity to Clarity: How AI Enhances Perceptions of Scientists and the Public's Understanding of Sciencecited by 3
- 2017Feature analysis of multidisciplinary scientific collaboration patterns based on PNAScited by 1
- 2020Nature, Science, and PNAS -- Disciplinary profiles and impactcited by 1
- 2024Moving Beyond LDA: A Comparison of Unsupervised Topic Modelling Techniques for Qualitative Data Analysis of Online Communitiescited by 1
- 2025SciTopic: Enhancing Topic Discovery in Scientific Literature through Advanced LLMcited by 1
Built on by
Not cited yet.