Transition-based Parsing with Stack-Transformers
Not on the map. Why?
Abstract (arXiv)
Modeling the parser state is key to good performance in transition-based parsing. Recurrent Neural Networks considerably improved the performance of transition-based systems by modelling the global state, e.g. stack-LSTM parsers, or local state modeling of contextualized features, e.g. Bi-LSTM parsers. Given the success of Transformer architectures in recent parsing systems, this work explores modifications of the sequence-to-sequence Transformer architecture to model either global or local parser states in transition-based parsing. We show that modifications of the cross attention mechanism of the Transformer considerably strengthen performance both on dependency and Abstract Meaning Representation (AMR) parsing tasks, particularly for smaller models or limited training data.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 9; 2023: 9; 2024: 5; 2025: 2; 2026: 2.
38 papers.
Sort:
- 2022Graph Pre-training for AMR Parsing and Generationcited by 55
- 2022Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scalecited by 41
- 2021Maximum Bayes Smatch Ensemble Distillation for AMR Parsingcited by 29
- 2021AMR Parsing with Action-Pointer Transformercited by 25
- 2021Structural Guidance for Transformer Language Modelscited by 25
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsingcited by 25
- 2022A Two-Stream AMR-enhanced Model for Document-level Event Argument Extractioncited by 16
- 2021Cost-effective End-to-end Information Extraction for Semi-structured Document Imagescited by 14
- 2022Inducing and Using Alignments for Transition-based AMR Parsingcited by 12
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphscited by 11
- 2021Hierarchical Curriculum Learning for AMR Parsingcited by 10
- 2023Enhancing Document-level Event Argument Extraction with Contextual Clues and Role Relevancecited by 10
26 more
- 2021Probabilistic, Structure-Aware Algorithms for Improved Variety, Accuracy, and Coverage of AMR Alignmentscited by 9
- 2021Bootstrapping Multilingual AMR with Contextual Word Alignmentscited by 8
- 2023An AMR-based Link Prediction Approach for Document-level Event Argument Extractioncited by 8
- 2024Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Modelscited by 8
- 2023Incorporating Graph Information in Transformer-based AMR Parsingcited by 7
- 2024Text2MDT: Extracting Medical Decision Trees from Medical Textscited by 6
- 2022ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRscited by 5
- 2021Discontinuous Grammar as a Foreign Languagecited by 4
- 2021Learning to Transpile AMR into SPARQLcited by 4
- 2022Improve Event Extraction via Self-Training with Gradient Guidancecited by 3
- 2023Approximating CKY with Transformerscited by 3
- 2021Levi Graph AMR Parser using Heterogeneous Attentioncited by 2
- 2022Cross-domain Generalization for AMR Parsingcited by 2
- 2023On the Challenges of Fully Incremental Neural Dependency Parsingcited by 2
- 2024CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentationcited by 2
- 2025Emergent Stack Representations in Modeling Counter Languages Using Transformerscited by 2
- 2025SoilNet: A Multimodal Multitask Model for Hierarchical Classification of Soil Horizonscited by 2
- 2023Structured Sentiment Analysis as Transition-based Dependency Graph Parsingcited by 1
- 2023AMR Parsing with Causal Hierarchical Attention and Pointerscited by 1
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstructioncited by 1
- 2024Adapting Abstract Meaning Representation Parsing to the Clinical Narrative -- the SPRING THYME parsercited by 1
- 2022Shift-Reduce Task-Oriented Semantic Parsing with Stack-Transformerscited by 0
- 2023Slide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document AMR Parsingcited by 0
- 2023Guiding AMR Parsing with Reverse Graph Linearizationcited by 0
- 2026Exploiting Pre-trained Encoder-Decoder Transformers for Sequence-to-Sequence Constituent Parsingcited by 0
- 2026How Reliable are AMR Parser Outputs? Uncertainty Estimation for AMR Parsingcited by 0
- 2026How Reliable are AMR Parser Outputs? Uncertainty Estimation for AMR Parsing9 Oct 2026
- 2026Exploiting Pre-trained Encoder-Decoder Transformers for Sequence-to-Sequence Constituent Parsing13 May 2026
- 2025SoilNet: A Multimodal Multitask Model for Hierarchical Classification of Soil Horizons5 Aug 2025
- 2025Emergent Stack Representations in Modeling Counter Languages Using Transformers3 Feb 2025
- 2024Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models24 Jul 2024
- 2024CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentation16 Jul 2024
- 2024Adapting Abstract Meaning Representation Parsing to the Clinical Narrative -- the SPRING THYME parser15 May 2024
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstruction18 Jan 2024
- 2024Text2MDT: Extracting Medical Decision Trees from Medical Texts4 Jan 2024
- 2023AMR Parsing with Causal Hierarchical Attention and Pointers18 Oct 2023
- 2023Guiding AMR Parsing with Reverse Graph Linearization13 Oct 2023
- 2023Enhancing Document-level Event Argument Extraction with Contextual Clues and Role Relevance8 Oct 2023
26 more
- 2023On the Challenges of Fully Incremental Neural Dependency Parsing28 Sep 2023
- 2023Incorporating Graph Information in Transformer-based AMR Parsing23 Jun 2023
- 2023An AMR-based Link Prediction Approach for Document-level Event Argument Extraction30 May 2023
- 2023Slide, Constrain, Parse, Repeat: Synchronous SlidingWindows for Document AMR Parsing26 May 2023
- 2023Structured Sentiment Analysis as Transition-based Dependency Graph Parsing9 May 2023
- 2023Approximating CKY with Transformers3 May 2023
- 2022Cross-domain Generalization for AMR Parsing22 Oct 2022
- 2022Shift-Reduce Task-Oriented Semantic Parsing with Stack-Transformers21 Oct 2022
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs15 Jun 2022
- 2022Improve Event Extraction via Self-Training with Gradient Guidance25 May 2022
- 2022Inducing and Using Alignments for Transition-based AMR Parsing3 May 2022
- 2022A Two-Stream AMR-enhanced Model for Document-level Event Argument Extraction30 Apr 2022
- 2022ATP: AMRize Then Parse! Enhancing AMR Parsing with PseudoAMRs19 Apr 2022
- 2022Graph Pre-training for AMR Parsing and Generation15 Mar 2022
- 2022Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale1 Mar 2022
- 2021Learning to Transpile AMR into SPARQL15 Dec 2021
- 2021Maximum Bayes Smatch Ensemble Distillation for AMR Parsing14 Dec 2021
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing29 Oct 2021
- 2021Discontinuous Grammar as a Foreign Language20 Oct 2021
- 2021Hierarchical Curriculum Learning for AMR Parsing15 Oct 2021
- 2021Structural Guidance for Transformer Language Models30 Jul 2021
- 2021Levi Graph AMR Parser using Heterogeneous Attention9 Jul 2021
- 2021Probabilistic, Structure-Aware Algorithms for Improved Variety, Accuracy, and Coverage of AMR Alignments10 Jun 2021
- 2021AMR Parsing with Action-Pointer Transformer29 Apr 2021
- 2021Cost-effective End-to-end Information Extraction for Semi-structured Document Images16 Apr 2021
- 2021Bootstrapping Multilingual AMR with Contextual Word Alignments3 Feb 2021
- 2022Graph Pre-training for AMR Parsing and Generationcited by 55
- 2022Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scalecited by 41
- 2021Maximum Bayes Smatch Ensemble Distillation for AMR Parsingcited by 29
- 2021AMR Parsing with Action-Pointer Transformercited by 25
- 2021Structural Guidance for Transformer Language Modelscited by 25
- 2021Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsingcited by 25
- 2022A Two-Stream AMR-enhanced Model for Document-level Event Argument Extractioncited by 16
- 2021Cost-effective End-to-end Information Extraction for Semi-structured Document Imagescited by 14
- 2022Inducing and Using Alignments for Transition-based AMR Parsingcited by 12
- 2022Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphscited by 11
- 2021Hierarchical Curriculum Learning for AMR Parsingcited by 10
- 2023Enhancing Document-level Event Argument Extraction with Contextual Clues and Role Relevancecited by 10
12 most cited of 38 All 38 (JSON)
- 2026How Reliable are AMR Parser Outputs? Uncertainty Estimation for AMR Parsing9 Oct 2026
- 2026Exploiting Pre-trained Encoder-Decoder Transformers for Sequence-to-Sequence Constituent Parsing13 May 2026
- 2025SoilNet: A Multimodal Multitask Model for Hierarchical Classification of Soil Horizons5 Aug 2025
- 2025Emergent Stack Representations in Modeling Counter Languages Using Transformers3 Feb 2025
- 2024Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models24 Jul 2024
- 2024CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentation16 Jul 2024
- 2024Adapting Abstract Meaning Representation Parsing to the Clinical Narrative -- the SPRING THYME parser15 May 2024
- 2024Chem-FINESE: Validating Fine-Grained Few-shot Entity Extraction through Text Reconstruction18 Jan 2024
- 2024Text2MDT: Extracting Medical Decision Trees from Medical Texts4 Jan 2024
- 2023AMR Parsing with Causal Hierarchical Attention and Pointers18 Oct 2023
- 2023Guiding AMR Parsing with Reverse Graph Linearization13 Oct 2023
- 2023Enhancing Document-level Event Argument Extraction with Contextual Clues and Role Relevance8 Oct 2023
12 newest of 38 All 38 (JSON)