# Second-Order Semantic Dependency Parsing with End-to-End Neural Networks

arXiv: https://arxiv.org/abs/1906.07880 · HTML: https://mlsanity.com/paper/1906.07880/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jun 2019.

## Built on by (most cited first, 21 of 21)

- [Learn from Syntax: Improving Pair-wise Aspect and Opinion Terms Extractionwith Rich Syntactic Knowledge](https://mlsanity.com/paper/2105.02520/) (2021)
- [Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination](https://mlsanity.com/paper/2305.12256/) (2023)
- [Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition](https://mlsanity.com/paper/2110.07480/) (2021)
- [Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments](https://mlsanity.com/paper/2110.06865/) (2021)
- [Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks](https://mlsanity.com/paper/2310.17238/) (2023)
- [Sparse Fuzzy Attention for Structured Sentiment Analysis](https://mlsanity.com/paper/2109.06719/) (2021)
- [Developmental Negation Processing in Transformer Language Models](https://mlsanity.com/paper/2204.14114/) (2022)
- [Transition-based Semantic Role Labeling with Pointer Networks](https://mlsanity.com/paper/2205.10023/) (2022)
- [Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings](https://mlsanity.com/paper/2107.02416/) (2021)
- [Predicting Music Hierarchies with a Graph-Based Neural Decoder](https://mlsanity.com/paper/2306.16955/) (2023)
- [Fast and Accurate End-to-End Span-based Semantic Role Labeling as Word-based Graph Parsing](https://mlsanity.com/paper/2112.02970/) (2021)
- [Modeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field Inference](https://mlsanity.com/paper/2204.03619/) (2022)
- [Modeling Instance Interactions for Joint Information Extraction with Neural High-Order Conditional Random Field](https://mlsanity.com/paper/2212.08929/) (2022)
- [Structured Sentiment Analysis as Transition-based Dependency Graph Parsing](https://mlsanity.com/paper/2305.05311/) (2023)
- [On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models](https://mlsanity.com/paper/2310.07818/) (2023)
- [Self-Attentive Constituency Parsing for UCCA-based Semantic Parsing](https://mlsanity.com/paper/2110.00621/) (2021)
- [A Higher-Order Semantic Dependency Parser](https://mlsanity.com/paper/2201.11312/) (2022)
- [Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals](https://mlsanity.com/paper/2306.04187/) (2023)
- [A Semi-Autoregressive Graph Generative Model for Dependency Graph Parsing](https://mlsanity.com/paper/2306.12018/) (2023)
- [Auxiliary Tasks to Boost Biaffine Semantic Dependency Parsing](https://mlsanity.com/paper/2402.07682/) (2024)
- [Hierarchical Bracketing Encodings Work for Dependency Graphs](https://mlsanity.com/paper/2509.09388/) (2025)

## Abstract (arXiv)

Semantic dependency parsing aims to identify semantic relationships between words in a sentence that form a graph. In this paper, we propose a second-order semantic dependency parser, which takes into consideration not only individual dependency edges but also interactions between pairs of edges. We show that second-order parsing can be approximated using mean field (MF) variational inference or loopy belief propagation (LBP). We can unfold both algorithms as recurrent layers of a neural network and therefore can train the parser in an end-to-end manner. Our experiments show that our approach achieves state-of-the-art performance.