Don't Parse, Generate! A Sequence to Sequence Architecture for Task-Oriented Semantic Parsing
Not on the map. Why?
Abstract (arXiv)
Virtual assistants such as Amazon Alexa, Apple Siri, and Google Assistant often rely on a semantic parsing component to understand which action(s) to execute for an utterance spoken by its users. Traditionally, rule-based or statistical slot-filling systems have been used to parse "simple" queries; that is, queries that contain a single action and can be decomposed into a set of non-overlapping entities. More recently, shift-reduce parsers have been proposed to process more complex utterances. These methods, while powerful, impose specific limitations on the type of queries that can be parsed; namely, they require a query to be representable as a parse tree. In this work, we propose a unified architecture based on Sequence to Sequence models and Pointer Generator Network to handle both simple and complex queries. Unlike other works, our approach does not impose any restriction on the semantic parse schema. Furthermore, experiments show that it achieves state of the art performance on three publicly available datasets (ATIS, SNIPS, Facebook TOP), relatively improving between 3.3% and 7.7% in exact match accuracy over previous systems. Finally, we show the effectiveness of our approach on two internal datasets.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 25; 2023: 9; 2024: 2.
59 papers.
Sort:
By area:
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 142
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
- 2021SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoisingcited by 27
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsingcited by 25
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
- 2021How much pretraining data do language models need to learn syntax?cited by 21
- 2022CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsingcited by 21
- 2021Effective Sequence-to-Sequence Dialogue State Trackingcited by 20
38 more
- 2021Intent Classification and Slot Filling for Privacy Policiescited by 18
- 2021Span Pointer Networks for Non-Autoregressive Task-Oriented Semantic Parsingcited by 18
- 2022Label Semantic Aware Pre-training for Few-shot Text Classificationcited by 18
- 2021Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialogcited by 17
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
- 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understandingcited by 14
- 2021Answer Generation for Retrieval-based Question Answering Systemscited by 13
- 2022KnowGL: Knowledge Generation and Linking from Textcited by 13
- 2022Measuring and Reducing Model Update Regression in Structured Prediction for NLPcited by 11
- 2022Compositional Task-Oriented Parsing as Abstractive Question Answeringcited by 10
- 2021Total Recall: a Customized Continual Learning Method for Neural Semantic Parserscited by 9
- 2022Dialog2API: Task-Oriented Dialogue with API Description and Example Programscited by 9
- 2021El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsingcited by 8
- 2021Semantic Parsing in Task-Oriented Dialog with Recursive Insertion-based Encodercited by 8
- 2022Deliberation Model for On-Device Spoken Language Understandingcited by 8
- 2023LeafAI: query generator for clinical cohort discovery rivaling a human programmercited by 8
- 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Taskscited by 8
- 2021Multilingual Neural Semantic Parsing for Low-Resourced Languagescited by 7
- 2022Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsingcited by 7
- 2022Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environmentscited by 6
- 2022Training Naturalized Semantic Parsers with Very Little Datacited by 6
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queriescited by 6
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsingcited by 6
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsingcited by 5
- 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representationscited by 5
- 2021X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsingcited by 4
- 2022Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Modelscited by 4
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reorderingcited by 4
- 2021One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasetscited by 3
- 2022Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via Intent Conditioningcited by 3
- 2022Dialogue Meaning Representation for Task-Oriented Dialogue Systemscited by 3
- 2022DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learningcited by 3
- 2022Cross-TOP: Zero-Shot Cross-Schema Task-Oriented Parsingcited by 3
- 2021Graph-Based Decoding for Task Oriented Semantic Parsingcited by 2
- 2022Lexicon-injected Semantic Parsing for Task-Oriented Dialogcited by 2
- 2022PIZZA: A new benchmark for complex end-to-end task-oriented parsingcited by 2
50 most cited of 59 All 59 (JSON)
- 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Tasks29 Oct 2024
- 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding10 May 2024
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering20 Oct 2023
- 2023I2KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding4 Oct 2023
- 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions24 Aug 2023
- 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representations7 Jun 2023
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing24 May 2023
- 2023LeafAI: query generator for clinical cohort discovery rivaling a human programmer13 Apr 2023
- 2023TreePiece: Faster Semantic Parsing via Tree Tokenization30 Mar 2023
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries13 Mar 2023
- 2023Low-Resource Compositional Semantic Parsing with Concept Pretraining24 Jan 2023
- 2022Dialog2API: Task-Oriented Dialogue with API Description and Example Programs20 Dec 2022
38 more
- 2022DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue15 Dec 2022
- 2022PIZZA: A new benchmark for complex end-to-end task-oriented parsing1 Dec 2022
- 2022Lexicon-injected Semantic Parsing for Task-Oriented Dialog26 Nov 2022
- 2022CST5: Data Augmentation for Code-Switched Semantic Parsing14 Nov 2022
- 2022KnowGL: Knowledge Generation and Linking from Text25 Oct 2022
- 2022Generative Knowledge Graph Construction: A Review23 Oct 2022
- 2022Shift-Reduce Task-Oriented Semantic Parsing with Stack-Transformers21 Oct 2022
- 2022CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsing13 Oct 2022
- 2022Cross-TOP: Zero-Shot Cross-Schema Task-Oriented Parsing10 Jun 2022
- 2022DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning25 May 2022
- 2022Compositional Task-Oriented Parsing as Abstractive Question Answering4 May 2022
- 2022Training Naturalized Semantic Parsers with Very Little Data29 Apr 2022
- 2022Modern Baselines for SPARQL Semantic Parsing27 Apr 2022
- 2022Dialogue Meaning Representation for Task-Oriented Dialogue Systems23 Apr 2022
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages18 Apr 2022
- 2022GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding18 Apr 2022
- 2022Label Semantic Aware Pre-training for Few-shot Text Classification14 Apr 2022
- 2022Improving Top-K Decoding for Non-Autoregressive Semantic Parsing via Intent Conditioning14 Apr 2022
- 2022Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments10 Apr 2022
- 2022Deliberation Model for On-Device Spoken Language Understanding4 Apr 2022
- 2022Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting29 Mar 2022
- 2022Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Models5 Mar 2022
- 2022Measuring and Reducing Model Update Regression in Structured Prediction for NLP7 Feb 2022
- 2022Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing2 Feb 2022
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey1 Nov 2021
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing29 Oct 2021
- 2021An Open Natural Language Processing Development Framework for EHR-based Clinical Research: A case demonstration using the National COVID Cohort Collaborative (N3C)20 Oct 2021
- 2021Paradigm Shift in Natural Language Processing26 Sep 2021
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
- 2021Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers11 Sep 2021
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervision10 Sep 2021
- 2021Graph-Based Decoding for Task Oriented Semantic Parsing9 Sep 2021
- 2021Semantic Parsing in Task-Oriented Dialog with Recursive Insertion-based Encoder9 Sep 2021
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data9 Sep 2021
- 2021How much pretraining data do language models need to learn syntax?7 Sep 2021
- 2021Effective Sequence-to-Sequence Dialogue State Tracking31 Aug 2021
- 2021Tiny Neural Models for Seq2Seq7 Aug 2021
- 2021One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets8 Jun 2021
50 newest of 59 All 59 (JSON)
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 142
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2022Modern Baselines for SPARQL Semantic Parsingcited by 34
- 2021SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoisingcited by 27
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsingcited by 25
- 2021ReasonBERT: Pre-trained to Reason with Distant Supervisioncited by 22
- 2021How much pretraining data do language models need to learn syntax?cited by 21
- 2022CLASP: Few-Shot Cross-Lingual Data Augmentation for Semantic Parsingcited by 21
- 2021Effective Sequence-to-Sequence Dialogue State Trackingcited by 20
12 most cited of 57 All 57 (JSON)
- 2024Generalists vs. Specialists: Evaluating LLMs on Highly-Constrained Biophysical Sequence Optimization Tasks29 Oct 2024
- 2024HC2L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding10 May 2024
- 2023Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering20 Oct 2023
- 2023I2KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language Understanding4 Oct 2023
- 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions24 Aug 2023
- 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representations7 Jun 2023
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing24 May 2023
- 2023LeafAI: query generator for clinical cohort discovery rivaling a human programmer13 Apr 2023
- 2023TreePiece: Faster Semantic Parsing via Tree Tokenization30 Mar 2023
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries13 Mar 2023
- 2023Low-Resource Compositional Semantic Parsing with Concept Pretraining24 Jan 2023
- 2022Dialog2API: Task-Oriented Dialogue with API Description and Example Programs20 Dec 2022
12 newest of 57 All 57 (JSON)