LLMs in Qualitative Research: Opportunities, Limitations, and Practical Considerations
Not on the map. Why?
Abstract (arXiv)
This paper examines the opportunities, limitations, and practical considerations associated with the use of large language models (LLMs) in qualitative research. Drawing on a multidisciplinary perspective that combines expertise in qualitative methods and explainable AI, the paper argues that responsible integration of LLMs into qualitative workflows requires researchers to engage critically with a curated set of technical parameters, that is, context window constraints, temperature and top-p sampling settings, user and system prompt design, and model documentation in the form of system cards. The paper situates these considerations within the epistemological commitments of qualitative research, including reflexivity, positionality, and interpretive judgment, and discusses how the opacity of contemporary LLMs differs from earlier natural language processing tools such as topic models and lexicon-based sentiment analyzers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
23 of 58 references.
References · 23
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2021Carbon Emissions and Large Neural Network Trainingcited by 567
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
- 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 214
- 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 191
- 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 170
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
11 more
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 121
- 2023Generative Language Models Exhibit Social Identity Biasescited by 111
- 2023Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Codingcited by 82
- 2023Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generatorscited by 56
- 2023CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Modelscited by 34
- 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
- 2025Control the Temperature: Selective Sampling for Diverse and High-Quality LLM Outputscited by 15
- 2024Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Developmentcited by 6
- 2024Inference to the Best Explanation in Large Language Modelscited by 5
- 2026Causal Discovery for Explainable AI: A Dual-Encoding Approachcited by 2
Built on by
Not cited yet.