Natural Language Decomposition and Interpretation of Complex Utterances
Not on the map. Why?
Abstract (arXiv)
Designing natural language interfaces has historically required collecting supervised data to translate user requests into carefully designed intent representations. This requires enumerating and labeling a long tail of user requests, which is challenging. At the same time, large language models (LLMs) encode knowledge about goals and plans that can help conversational assistants interpret user requests requiring numerous steps to complete. We introduce an approach to handle complex-intent-bearing utterances from a user via a process of hierarchical natural language decomposition and interpretation. Our approach uses a pre-trained language model to decompose a complex utterance into a sequence of simpler natural language steps and interprets each step using the language-to-program model designed for the interface. To test our approach, we collect and release DeCU -- a new NL-to-program benchmark to evaluate Decomposition of Complex Utterances. Experiments show that the proposed approach enables the interpretation of complex utterances with almost no complex training data, while outperforming standard few-shot prompting approaches.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 15 May 2023.
Builds on
23 of 29 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
11 more
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 175
- 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
- 2020Break It Down: A Question Understanding Benchmarkcited by 131
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2022Compositional Semantic Parsing with Large Language Modelscited by 95
- 2020Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Modelscited by 65
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 4; 2026: 1.
10 papers.
- 2023Decomposing Complex Queries for Tip-of-the-tongue Retrievalcited by 24
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2023SCREWS: A Modular Framework for Reasoning with Revisionscited by 16
- 2024MARS: Benchmarking the Metaphysical Reasoning Abilities of Language Models with a Multi-task Evaluation Datasetcited by 11
- 2023Leveraging Code to Improve In-context Learning for Semantic Parsingcited by 10
- 2025Can we Retrieve Everything All at Once? ARM: An Alignment-Oriented LLM-based Retrieval Methodcited by 10
- 2025LM Agents for Coordinating Multi-User Information Gatheringcited by 4
- 2025ASPERA: A Simulated Environment to Evaluate Planning for Complex Action Executioncited by 1
- 2024NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classificationcited by 0
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queriescited by 0
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queries20 May 2026
- 2025ASPERA: A Simulated Environment to Evaluate Planning for Complex Action Execution21 Jul 2025
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2025LM Agents for Coordinating Multi-User Information Gathering17 Feb 2025
- 2025Can we Retrieve Everything All at Once? ARM: An Alignment-Oriented LLM-based Retrieval Method30 Jan 2025
- 2024MARS: Benchmarking the Metaphysical Reasoning Abilities of Language Models with a Multi-task Evaluation Dataset4 Jun 2024
- 2024NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classification25 Feb 2024
- 2023Leveraging Code to Improve In-context Learning for Semantic Parsing16 Nov 2023
- 2023SCREWS: A Modular Framework for Reasoning with Revisions20 Sep 2023
- 2023Decomposing Complex Queries for Tip-of-the-tongue Retrieval24 May 2023