# Transition-based Semantic Dependency Parsing with Pointer Networks

arXiv: https://arxiv.org/abs/2005.13344 · HTML: https://mlsanity.com/paper/2005.13344/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 May 2020.

## Built on by (most cited first, 16 of 16)

- [AMR Parsing with Action-Pointer Transformer](https://mlsanity.com/paper/2104.14674/) (2021)
- [Mastering the Explicit Opinion-role Interaction: Syntax-aided Neural Transition System for Unified Opinion Role Labeling](https://mlsanity.com/paper/2110.02001/) (2021)
- [Bottom-Up Constituency Parsing and Nested Named Entity Recognition with Pointer Networks](https://mlsanity.com/paper/2110.05419/) (2021)
- [A Conditional Splitting Framework for Efficient Constituency Parsing](https://mlsanity.com/paper/2106.15760/) (2021)
- [On the Capabilities of Pointer Networks for Deep Deductive Reasoning](https://mlsanity.com/paper/2106.09225/) (2021)
- [Learning compositional structures for semantic graph parsing](https://mlsanity.com/paper/2106.04398/) (2021)
- [A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective](https://mlsanity.com/paper/2202.04847/) (2022)
- [Transition-based Semantic Role Labeling with Pointer Networks](https://mlsanity.com/paper/2205.10023/) (2022)
- [Predicting Music Hierarchies with a Graph-Based Neural Decoder](https://mlsanity.com/paper/2306.16955/) (2023)
- [Modeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field Inference](https://mlsanity.com/paper/2204.03619/) (2022)
- [Structured Sentiment Analysis as Transition-based Dependency Graph Parsing](https://mlsanity.com/paper/2305.05311/) (2023)
- [LLMs Can Also Do Well! Breaking Barriers in Semantic Role Labeling via Large Language Models](https://mlsanity.com/paper/2506.05385/) (2025)
- [A Higher-Order Semantic Dependency Parser](https://mlsanity.com/paper/2201.11312/) (2022)
- [Schema-Free Dependency Parsing via Sequence Generation](https://mlsanity.com/paper/2201.12407/) (2022)
- [Auxiliary Tasks to Boost Biaffine Semantic Dependency Parsing](https://mlsanity.com/paper/2402.07682/) (2024)
- [Hierarchical Bracketing Encodings Work for Dependency Graphs](https://mlsanity.com/paper/2509.09388/) (2025)

## Abstract (arXiv)

Transition-based parsers implemented with Pointer Networks have become the new state of the art in dependency parsing, excelling in producing labelled syntactic trees and outperforming graph-based models in this task. In order to further test the capabilities of these powerful neural networks on a harder NLP problem, we propose a transition system that, thanks to Pointer Networks, can straightforwardly produce labelled directed acyclic graphs and perform semantic dependency parsing. In addition, we enhance our approach with deep contextualized word embeddings extracted from BERT. The resulting system not only outperforms all existing transition-based models, but also matches the best fully-supervised accuracy to date on the SemEval 2015 Task 18 English datasets among previous state-of-the-art graph-based parsers.
