Computational KJ-Ho: An Analyst-Bias-Free Insight Extraction Framework from Large-Scale Qualitative Data Using Domain-Specialized LLMs
Not on the map. Why?
Abstract (arXiv)
The qualitative research methodologies that underpin consumer-insight generation - the KJ method, Grounded Theory, and Thematic Analysis - share a structural constraint: the cognitive processing capacity of the human analyst. Replication research further shows that conclusions vary substantially across analysts analyzing identical data (analyst bias). This paper proposes Computational KJ-Ho (the Kawakita Jiro method), a theoretical framework that computationally realizes the KJ method's epistemology - letting structure emerge from the data itself without imposing the analyst's preconceptions - an orientation we term "analyst-bias-free." The framework employs a domain-specialized LLM built through continued pre-training (CPT) on a marketing-research corpus and supervised fine-tuning (SFT) on expert-curated insight pairs, organized as a three-layer architecture: data structuring, insight extraction, and strategy generation. Two preliminary studies in the Japanese marketing context support the necessity of CPT-based domain specialization. The paper makes five contributions: (1) a theoretical integration of the KJ method, Grounded Theory, and Peircean abduction into a single epistemological commitment of data-driven explanation generation; (2) a three-layer architecture leveraging domain-specialized embeddings for cross-interview analysis; (3) two novel evaluation metrics, InsightExtraction-F1 and MarketingQA; (4) explicit engagement with the WEIRD problem, centering a non-Western methodology; and (5) five practice-derived problem formulations from nearly three decades of marketing-research practice, translated into design requirements. The human analyst retains a supervisory role. This is a concept paper presented ahead of empirical validation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 73 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
21 of 73 references.
References · 21
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 326
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 135
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 78
- 2023Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinationscited by 63
- 2023CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Modelscited by 34
- 2025OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulationcited by 28
- 2024BASES: Large-scale Web Search User Simulation with Large Language Model based Agentscited by 25
- 2025HICode: Hierarchical Inductive Coding with LLMscited by 12
9 more
- 2024A Computational Method for Measuring "Open Codes" in Qualitative Analysiscited by 6
- 2025LOGOS: LLM-driven End-to-End Grounded Theory Development and Schema Induction for Qualitative Researchcited by 6
- 2025DeTAILS: Deep Thematic Analysis with Iterative LLM Supportcited by 5
- 2025Stabilizing Reasoning in Medical LLMs with Continued Pretraining and Reasoning Preference Optimizationcited by 4
- 2025Efficiency with Rigor! A Trustworthy LLM-powered Workflow for Qualitative Data Analysiscited by 3
- 2025Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needscited by 3
- 2025SFT-TA: Supervised Fine-Tuned Agents in Multi-Agent LLMs for Automated Inductive Thematic Analysiscited by 3
- 2024A Framework For Discussing LLMs as Tools for Qualitative Analysiscited by 2
- 2025Neo-Grounded Theory: A Methodological Innovation Integrating High-Dimensional Vector Clustering and Multi-Agent Collaboration for Qualitative Researchcited by 1
Built on by
Not cited yet.