mlsanityData to 7 Oct 2026

Bridging Human Interpretation and Machine Representation: A Landscape of Qualitative Data Analysis in the LLM Era

arXiv 2601.11739 ↗First posted 16 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

LLMs are increasingly used to support qualitative research, yet existing systems produce outputs that vary widely--from trace-faithful summaries to theory-mediated explanations and system models. To make these differences explicit, we introduce a 4×4 landscape crossing four levels of meaning-making (descriptive, categorical, interpretive, theoretical) with four levels of modeling (static structure, stages/timelines, causal pathways, feedback dynamics). Applying the landscape to prior LLM-based automation highlights a strong skew toward low-level meaning and low-commitment representations, with few reliable attempts at interpretive/theoretical inference or dynamical modeling. Based on the revealed gap, we outline an agenda for applying and building LLM-systems that make their interpretive and modeling commitments explicit, selectable, and governable.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 166 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

28 of 166 references.

References · 28

  1. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  2. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  3. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  4. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  5. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
  6. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  7. 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 77
  8. 2023LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysiscited by 70
  9. 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
  10. 2020A Review on Fact Extraction and Verificationcited by 29
  11. 2023CoAIcoder: Examining the Effectiveness of AI-assisted Human-to-Human Collaboration in Qualitative Analysiscited by 25
  12. 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verificationcited by 19
16 more
  1. 2024Large Language Models in Qualitative Research: Uses, Tensions, and Intentionscited by 19
  2. 2025Professional Software Developers Don't Vibe, They Control: AI Agent Use for Coding in 2025cited by 17
  3. 2025HICode: Hierarchical Inductive Coding with LLMscited by 12
  4. 2024Automating Thematic Analysis: How LLMs Analyse Controversial Topicscited by 10
  5. 2017Identifying civilians killed by police with distantly supervised entity-event extractioncited by 9
  6. 2025Auto-TA: Towards Scalable Automated Thematic Analysis (TA) via Multi-Agent Large Language Models with Reinforcement Learningcited by 9
  7. 2024QuaLLM: An LLM-based Framework to Extract Quantitative Insights from Online Forumscited by 8
  8. 2025LOGOS: LLM-driven End-to-End Grounded Theory Development and Schema Induction for Qualitative Researchcited by 6
  9. 2025Intent-Aware Schema Generation And Refinement For Literature Review Tablescited by 5
  10. 2025DeTAILS: Deep Thematic Analysis with Iterative LLM Supportcited by 5
  11. 2025Large Language Models in Thematic Analysis: Prompt Engineering, Evaluation, and Guidelines for Qualitative Software Engineering Researchcited by 5
  12. 2025PolicyPulse: LLM-Synthesis Tool for Policy Researcherscited by 4
  13. 2025Text Annotation via Inductive Coding: Comparing Human Experts to LLMs in Qualitative Data Analysiscited by 4
  14. 2025Optimizing Generative AI's Accuracy and Transparency in Inductive Thematic Analysis: A Human-AI Comparisoncited by 3
  15. 2025SFT-TA: Supervised Fine-Tuned Agents in Multi-Agent LLMs for Automated Inductive Thematic Analysiscited by 3
  16. 2024Qualitative Data Analysis in Software Engineering: Techniques and Teaching Insightscited by 2

Built on by

Not cited yet.