# Gricea: An Open Science Platform for Conversational AI Research

arXiv: https://arxiv.org/abs/2609.22039 · HTML: https://mlsanity.com/paper/2609.22039/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 26 of its 97 references that are in the map.
- First posted on arXiv 18 Sep 2026.

## Builds on (most cited first, 26 of 26)

- [Generative Agents: Interactive Simulacra of Human Behavior](https://mlsanity.com/paper/2304.03442/) (2023)
- [Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Models](https://mlsanity.com/paper/2504.04717/) (2025)
- [Rethinking Model Evaluation as Narrowing the Socio-Technical Gap](https://mlsanity.com/paper/2306.03100/) (2023)
- [Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models](https://mlsanity.com/paper/2402.11723/) (2024)
- [The Value, Benefits, and Concerns of Generative AI-Powered Assistance in Writing](https://mlsanity.com/paper/2403.12004/) (2024)
- [Proactive Conversational Agents with Inner Thoughts](https://mlsanity.com/paper/2501.00383/) (2024)
- [How Culture Shapes What People Want From AI](https://mlsanity.com/paper/2403.05104/) (2024)
- [Empirica: a virtual lab for high-throughput macro-level experiments](https://mlsanity.com/paper/2006.11398/) (2020)
- [The Last Human-Written Paper: Agent-Native Research Artifacts](https://mlsanity.com/paper/2604.24658/) (2026)
- [Low-code LLM: Graphical User Interface over Large Language Models](https://mlsanity.com/paper/2304.08103/) (2023)
- [BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebooks](https://mlsanity.com/paper/2404.07387/) (2024)
- [Mitigating Response Delays in Free-Form Conversations with LLM-powered Intelligent Virtual Agents](https://mlsanity.com/paper/2507.22352/) (2025)
- [CREW: Facilitating Human-AI Teaming Research](https://mlsanity.com/paper/2408.00170/) (2024)
- [NeuroChat: A Neuroadaptive AI Chatbot for Customizing Learning Experiences](https://mlsanity.com/paper/2503.07599/) (2025)
- [Canvil: Designerly Adaptation for LLM-Powered User Experiences](https://mlsanity.com/paper/2401.09051/) (2024)
- [Tea: A High-level Language and Runtime System for Automating Statistical Analysis](https://mlsanity.com/paper/1904.05387/) (2019)
- [Agentic Workflows for Conversational Human-AI Interaction Design](https://mlsanity.com/paper/2501.18002/) (2025)
- [The Impact of Generative AI Coding Assistants on Developers Who Are Visually Impaired](https://mlsanity.com/paper/2503.16491/) (2025)
- [The Impact of a Chatbot's Ephemerality-Framing on Self-Disclosure Perceptions](https://mlsanity.com/paper/2505.20464/) (2025)
- [Toward Metaphor-Fluid Conversation Design for Voice User Interfaces](https://mlsanity.com/paper/2502.11554/) (2025)
- [Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration](https://mlsanity.com/paper/2509.18008/) (2025)
- [Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents](https://mlsanity.com/paper/2602.01405/) (2026)
- [ReVISit 2: A Full Experiment Life Cycle User Study Framework](https://mlsanity.com/paper/2508.03876/) (2025)
- [Conversation Progress Guide : UI System for Enhancing Self-Efficacy in Conversational AI](https://mlsanity.com/paper/2501.12001/) (2025)
- [Feedstack: Layering Structured Representations over Unstructured Feedback to Scaffold Human AI Conversation](https://mlsanity.com/paper/2506.03052/) (2025)
- [Beliefs and Misconceptions around Integrated Conversational AI](https://mlsanity.com/paper/2605.14849/) (2026)

## Abstract (arXiv)

We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing various open-ended research questions. Together, these findings demonstrate Gricea's support for constructing, reproducing, and extending CAI studies through shared research artifacts, enabling cumulative knowledge building through open science.
