Hexatagging: Projective Dependency Parsing as Tagging
Not on the map. Why?
Abstract (arXiv)
We introduce a novel dependency parser, the hexatagger, that constructs dependency trees by tagging the words in a sentence with elements from a finite set of possible tags. In contrast to many approaches to dependency parsing, our approach is fully parallelizable at training time, i.e., the structure-building actions needed to build a dependency parse can be predicted in parallel to each other. Additionally, exact decoding is linear in time and space complexity. Furthermore, we derive a probabilistic dependency parser that predicts hexatags using no more than a linear model with features from a pretrained language model, i.e., we forsake a bespoke architecture explicitly designed for the task. Despite the generality and simplicity of our approach, we achieve state-of-the-art performance of 96.4 LAS and 97.4 UAS on the Penn Treebank test set. Additionally, our parser's linear time complexity and parallelism significantly improve computational efficiency, with a roughly 10-times speed-up over previous state-of-the-art models during decoding.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 8 Jun 2023.
Builds on
16 of 44 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
- 2016Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representationscited by 55
- 2020Efficient Second-Order TreeCRF for Neural Dependency Parsingcited by 48
- 2019Head-Driven Phrase Structure Grammar Parsing on Penn Treebankcited by 43
- 2019Viable Dependency Parsing as Sequence Labelingcited by 34
- 2018Scheduled Multi-Task Learning: From Syntax to Translationcited by 18
- 2019Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inferencecited by 17
- 2020Second-Order Neural Dependency Parsing with Message Passing and End-to-End Trainingcited by 17
4 more
- 2020Please Mind the Root: Decoding Arborescences for Dependency Parsingcited by 11
- 2021Headed-Span-Based Projective Dependency Parsingcited by 11
- 2016Global Neural CCG Parsing with Optimality Guaranteescited by 6
- 2015Parsing Linear Context-Free Rewriting Systems with Fast Matrix Multiplicationcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.