# Convo: What does conversational programming need? An exploration of machine learning interface design

arXiv: https://arxiv.org/abs/2003.01318 · HTML: https://mlsanity.com/paper/2003.01318/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Mar 2020.

## Built on by (most cited first, 4 of 4)

- [With One Voice: Composing a Travel Voice Assistant from Re-purposed Models](https://mlsanity.com/paper/2108.11463/) (2021)
- [Towards No-Code Programming of Cobots: Experiments with Code Synthesis by Large Code Models for Conversational Programming](https://mlsanity.com/paper/2409.11041/) (2024)
- [ChatLogo: A Large Language Model-Driven Hybrid Natural-Programming Language Interface for Agent-based Modeling and Programming](https://mlsanity.com/paper/2308.08102/) (2023)
- [Vibe Coding, Interface Flattening](https://mlsanity.com/paper/2512.24939/) (2025)

## Abstract (arXiv)

Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little about agents for developing computer programs. To explore the utility of natural language for programming, we conducted a study (n=45) comparing different input methods to a conversational programming system we developed. Participants completed novice and advanced tasks using voice-based, text-based, and voice-or-text-based systems. We found that users appreciated aspects of each system (e.g., voice-input efficiency, text-input precision) and that novice users were more optimistic about programming using voice-input than advanced users. Our results show that future conversational programming tools should be tailored to users' programming experience and allow users to choose their preferred input mode. To reduce cognitive load, future interfaces can incorporate visualizations and possess custom natural language understanding and speech recognition models for programming.