mlsanityData to 7 Oct 2026

Natural Language Decomposition and Interpretation of Complex Utterances

arXiv 2305.08677 ↗First posted 15 May 2023cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Designing natural language interfaces has historically required collecting supervised data to translate user requests into carefully designed intent representations. This requires enumerating and labeling a long tail of user requests, which is challenging. At the same time, large language models (LLMs) encode knowledge about goals and plans that can help conversational assistants interpret user requests requiring numerous steps to complete. We introduce an approach to handle complex-intent-bearing utterances from a user via a process of hierarchical natural language decomposition and interpretation. Our approach uses a pre-trained language model to decompose a complex utterance into a sequence of simpler natural language steps and interprets each step using the language-to-program model designed for the interface. To test our approach, we collect and release DeCU -- a new NL-to-program benchmark to evaluate Decomposition of Complex Utterances. Experiments show that the proposed approach enables the interpretation of complex utterances with almost no complex training data, while outperforming standard few-shot prompting approaches.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 15 May 2023.

Builds on

23 of 29 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  7. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  8. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  9. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  10. 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
  11. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  12. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
11 more
  1. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  2. 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
  3. 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
  4. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 175
  5. 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
  6. 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
  7. 2020Break It Down: A Question Understanding Benchmarkcited by 131
  8. 2023Self-planning Code Generation with Large Language Modelscited by 121
  9. 2021Skill Induction and Planning with Latent Languagecited by 99
  10. 2022Compositional Semantic Parsing with Large Language Modelscited by 95
  11. 2020Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Modelscited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 2; 2025: 4; 2026: 1.

10 papers.