Deep literature reviews: an application of fine-tuned language models to migration research
Not on the map. Why?
Abstract (arXiv)
This paper presents a hybrid framework for literature reviews that augments traditional bibliometric methods with large language models (LLMs). By fine-tuning open-source LLMs, our approach enables scalable extraction of qualitative insights from large volumes of research content, enhancing both the breadth and depth of knowledge synthesis. To improve annotation efficiency and consistency, we introduce an error-focused validation process in which LLMs generate initial labels and human reviewers correct misclassifications. Applying this framework to over 20000 scientific articles about human migration, we demonstrate that a domain-adapted LLM can serve as a "specialist" model - capable of accurately selecting relevant studies, detecting emerging trends, and identifying critical research gaps. Notably, the LLM-assisted review reveals a growing scholarly interest in climate-induced migration. However, existing literature disproportionately centers on a narrow set of environmental hazards (e.g., floods, droughts, sea-level rise, and land degradation), while overlooking others that more directly affect human health and well-being, such as air and water pollution or infectious diseases. This imbalance highlights the need for more comprehensive research that goes beyond physical environmental changes to examine their ecological and societal consequences, particularly in shaping migration as an adaptive response. Overall, our proposed framework demonstrates the potential of fine-tuned LLMs to conduct more efficient, consistent, and insightful literature reviews across disciplines, ultimately accelerating knowledge synthesis and scientific discovery.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 8 of its 28 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
8 of 28 references.
References · 8
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 857
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 668
- 2022Thinking Fast and Slow in Large Language Modelscited by 136
- 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 67
- 2023Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuningcited by 31
- 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendationscited by 28
- 2024Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Researchcited by 6
- 2020Forecasting asylum-related migration flows with machine learning and data at scalecited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.