MimiTalk: Revolutionizing Qualitative Research with Dual-Agent AI
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
We present MimiTalk, a dual-agent constitutional AI framework designed for scalable and ethical conversational data collection in social science research. The framework integrates a supervisor model for strategic oversight and a conversational model for question generation. We conducted three studies: Study 1 evaluated usability with 20 participants; Study 2 compared 121 AI interviews to 1,271 human interviews from the MediaSum dataset using NLP metrics and propensity score matching; Study 3 involved 10 interdisciplinary researchers conducting both human and AI interviews, followed by blind thematic analysis. Results across studies indicate that MimiTalk reduces interview anxiety, maintains conversational coherence, and outperforms human interviews in information richness, coherence, and stability. AI interviews elicit technical insights and candid views on sensitive topics, while human interviews better capture cultural and emotional nuances. These findings suggest that dual-agent constitutional AI supports effective human-AI collaboration, enabling replicable, scalable and quality-controlled qualitative research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 11 of its 53 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
11 of 53 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2022Evaluating the Construct Validity of Text Embeddings with Application to Survey Questionscited by 7
- 2021Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysiscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AgentPanel: Toward a New Paradigm for Human--AI Collaboration in Exploring Scientific Questions
- 2025Designing Synthetic Discussion Generation Systems: A Case Study for Online Facilitation
- 2026HumanStudy-Bench: Towards AI Agent Design for Participant Simulation
- 2026FARS: A Fully Automated Research System Deployed at Scale
- 2026How AI Coders Discuss, Disagree, and Reach Consensus: Challenges and Opportunities for LLM-Based Qualitative Coding
- 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
- 2026TAMUSA-Chat: A Domain-Adapted Large Language Model Conversational System for Research and Responsible Deployment
- 2026Preregistration for Experiments with AI Agents