Naturalizing a Programming Language via Interactive Learning
Not on the map. Why?
Abstract (arXiv)
Our goal is to create a convenient natural language interface for performing well-specified but complex actions such as analyzing data, manipulating text, and querying databases. However, existing natural language interfaces for such tasks are quite primitive compared to the power one wields with a programming language. To bridge this gap, we start with a core programming language and allow users to "naturalize" the core language incrementally by defining alternative, more natural syntax and increasingly complex concepts in terms of compositions of simpler ones. In a voxel world, we show that a community of users can simultaneously teach a common system a diverse language and use it to build hundreds of complex voxel structures. Over the course of three days, these users went from using only the core language to using the naturalized language in 85.9% of the last 10K utterances.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 3; 2024: 3; 2025: 1.
20 papers.
Sort:
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2021ELLA: Exploration through Learned Language Abstractioncited by 42
- 2021LILA: Language-Informed Latent Actionscited by 27
- 2021Learning to communicate about shared procedural abstractionscited by 15
- 2021Reference-Centric Models for Grounded Collaborative Dialoguecited by 15
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Languagecited by 14
- 2021On The Ingredients of an Effective Zero-shot Semantic Parsercited by 13
- 2023ANPL: Towards Natural Programming with Interactive Decompositioncited by 13
- 2024Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Searchcited by 13
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
- 2021Analysis of Language Change in Collaborative Instruction Followingcited by 9
- 2024Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaborationcited by 4
8 more
- 2021droidlet: modular, heterogenous, multi-modal agentscited by 2
- 2025ProVox: Personalization and Proactive Planning for Situated Human-Robot Collaborationcited by 2
- 2022Many Episode Learning in a Modular Embodied Agent via End-to-End Interactioncited by 1
- 2022Counterfactual Explanations for Natural Language Interfacescited by 1
- 2023Learning a Hierarchical Planner from Humans in Multiple Generationscited by 1
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agentscited by 1
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learningcited by 0
- 2023Exploring Automatically Perturbed Natural Language Explanations in Relation Extractioncited by 0
- 2025ProVox: Personalization and Proactive Planning for Situated Human-Robot Collaboration13 Jun 2025
- 2024Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration4 Nov 2024
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents12 Jul 2024
- 2024Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search26 May 2024
- 2023Learning a Hierarchical Planner from Humans in Multiple Generations17 Oct 2023
- 2023ANPL: Towards Natural Programming with Interactive Decomposition29 May 2023
- 2023Exploring Automatically Perturbed Natural Language Explanations in Relation Extraction24 May 2023
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches15 Nov 2022
- 2022Counterfactual Explanations for Natural Language Interfaces27 Apr 2022
- 2022Many Episode Learning in a Modular Embodied Agent via End-to-End Interaction19 Apr 2022
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities18 Jan 2022
- 2021LILA: Language-Informed Latent Actions5 Nov 2021
8 more
- 2021On The Ingredients of an Effective Zero-shot Semantic Parser15 Oct 2021
- 2021Reference-Centric Models for Grounded Collaborative Dialogue10 Sep 2021
- 2021Analysis of Language Change in Collaborative Instruction Following9 Sep 2021
- 2021Neural Abstructions: Abstractions that Support Construction for Grounded Language Learning20 Jul 2021
- 2021Learning to communicate about shared procedural abstractions30 Jun 2021
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Language27 Jun 2021
- 2021ELLA: Exploration through Learned Language Abstraction10 Mar 2021
- 2021droidlet: modular, heterogenous, multi-modal agents25 Jan 2021
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2021ELLA: Exploration through Learned Language Abstractioncited by 42
- 2021LILA: Language-Informed Latent Actionscited by 27
- 2021Learning to communicate about shared procedural abstractionscited by 15
- 2021Reference-Centric Models for Grounded Collaborative Dialoguecited by 15
- 2021Draw Me a Flower: Processing and Grounding Abstraction in Natural Languagecited by 14
- 2021On The Ingredients of an Effective Zero-shot Semantic Parsercited by 13
- 2023ANPL: Towards Natural Programming with Interactive Decompositioncited by 13
- 2024Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Searchcited by 13
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
- 2021Analysis of Language Change in Collaborative Instruction Followingcited by 9
- 2024Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaborationcited by 4
12 most cited of 20 All 20 (JSON)
- 2025ProVox: Personalization and Proactive Planning for Situated Human-Robot Collaboration13 Jun 2025
- 2024Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration4 Nov 2024
- 2024IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents12 Jul 2024
- 2024Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search26 May 2024
- 2023Learning a Hierarchical Planner from Humans in Multiple Generations17 Oct 2023
- 2023ANPL: Towards Natural Programming with Interactive Decomposition29 May 2023
- 2023Exploring Automatically Perturbed Natural Language Explanations in Relation Extraction24 May 2023
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches15 Nov 2022
- 2022Counterfactual Explanations for Natural Language Interfaces27 Apr 2022
- 2022Many Episode Learning in a Modular Embodied Agent via End-to-End Interaction19 Apr 2022
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities18 Jan 2022
- 2021LILA: Language-Informed Latent Actions5 Nov 2021
12 newest of 20 All 20 (JSON)