Bridging Human Interpretation and Machine Representation: A Landscape of Qualitative Data Analysis in the LLM Era
Not on the map. Why?
Abstract (arXiv)
LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we introduce a 4×4 landscape crossing four levels of meaning-making (descriptive, categorical, interpretive, theoretical) with four levels of modeling (static structure, stages/timelines, causal pathways, feedback dynamics). Applying the landscape to prior LLM-based automation highlights a strong skew toward low-level meaning and low-commitment representations, with few reliable attempts at interpretive/theoretical inference or dynamical modeling. Based on the revealed gap, we outline an agenda for applying and building LLM-systems that make their interpretive and modeling commitments explicit, selectable, and governable.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 166 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
28 of 166 references.
References · 28
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
- 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 77
- 2023LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysiscited by 70
- 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
- 2020A Review on Fact Extraction and Verificationcited by 29
- 2023CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysiscited by 25
- 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verificationcited by 19
16 more
- 2024Large Language Models in Qualitative Research: Uses, Tensions, and Intentionscited by 19
- 2025Professional Software Developers Don't Vibe, They Control: AI Agent Use for Coding in 2025cited by 17
- 2025HICode: Hierarchical Inductive Coding with LLMscited by 12
- 2024Automating Thematic Analysis: How LLMs Analyse Controversial Topicscited by 10
- 2017Identifying civilians killed by police with distantly supervised entity-event extractioncited by 9
- 2025Auto-TA: Towards Scalable Automated Thematic Analysis (TA) via Multi-Agent Large Language Models with Reinforcement Learningcited by 9
- 2024QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forumscited by 8
- 2025LOGOS: LLM-driven End-to-End Grounded Theory Development and Schema Induction for Qualitative Researchcited by 6
- 2025Intent-Aware Schema Generation And Refinement For Literature Review Tablescited by 5
- 2025DeTAILS: Deep Thematic Analysis with Iterative LLM Supportcited by 5
- 2025Large Language Models in Thematic Analysis: Prompt Engineering, Evaluation, and Guidelines for Qualitative Software Engineering Researchcited by 5
- 2025PolicyPulse: LLM-Synthesis Tool for Policy Researcherscited by 4
- 2025Text Annotation via Inductive Coding: Comparing Human Experts to LLMs in Qualitative Data Analysiscited by 4
- 2025Optimizing Generative AI's Accuracy and Transparency in Inductive Thematic Analysis: A Human-AI Comparisoncited by 3
- 2025SFT-TA: Supervised Fine-Tuned Agents in Multi-Agent LLMs for Automated Inductive Thematic Analysiscited by 3
- 2024Qualitative Data Analysis in Software Engineering: Techniques and Teaching Insightscited by 2
Built on by
Not cited yet.