Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement
Not on the map. Why?
Abstract (arXiv)
We propose the Recursive Non-autoregressive Graph-to-Graph Transformer architecture (RNGTr) for the iterative refinement of arbitrary graphs through the recursive application of a non-autoregressive Graph-to-Graph Transformer and apply it to syntactic dependency parsing. We demonstrate the power and effectiveness of RNGTr on several dependency corpora, using a refinement model pre-trained with BERT. We also introduce Syntactic Transformer (SynTr), a non-recursive parser similar to our refinement model. RNGTr can improve the accuracy of a variety of initial parsers on 13 languages from the Universal Dependencies Treebanks, English and Chinese Penn Treebanks, and the German CoNLL2009 corpus, even improving over the new state-of-the-art results achieved by SynTr, significantly improving the state-of-the-art for all corpora tested.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 3; 2024: 3; 2025: 3.
20 papers.
Sort:
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
- 2021Dependency Parsing as MRC-based Span-Span Predictioncited by 13
- 2022BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsingcited by 13
- 2021Headed-Span-Based Projective Dependency Parsingcited by 11
- 2021Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labellingcited by 8
- 2022Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive Learningcited by 8
- 2022Graph Refinement for Coreference Resolutioncited by 7
- 2021Dependency Parsing with Bottom-up Hierarchical Pointer Networkscited by 5
- 2021Combining (second-order) graph-based and headed-span-based projective dependency parsingcited by 5
- 2023Transformers as Graph-to-Graph Modelscited by 5
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformerscited by 2
8 more
- 2025Toward a Graph Foundation Model: Pre-Training Transformers With Random Walkscited by 2
- 2025Order-Level Attention Similarity Across Language Models: A Latent Commonalitycited by 2
- 2023GADePo: Graph-Assisted Declarative Pooling Transformers for Document-Level Relation Extractioncited by 1
- 2023High-order Joint Constituency and Dependency Parsingcited by 0
- 2024Thai Universal Dependency Treebankcited by 0
- 2024Fast-and-Frugal Text-Graph Transformers are Effective Link Predictorscited by 0
- 2024CSSL: Contrastive Self-Supervised Learning for Dependency Parsing on Relatively Free Word Ordered and Morphologically Rich Low Resource Languagescited by 0
- 2025Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinementcited by 0
- 2025Order-Level Attention Similarity Across Language Models: A Latent Commonality7 Nov 2025
- 2025Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks17 Jun 2025
- 2025Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinement16 Jan 2025
- 2024CSSL: Contrastive Self-Supervised Learning for Dependency Parsing on Relatively Free Word Ordered and Morphologically Rich Low Resource Languages9 Oct 2024
- 2024Fast-and-Frugal Text-Graph Transformers are Effective Link Predictors13 Aug 2024
- 2024Thai Universal Dependency Treebank13 May 2024
- 2023Transformers as Graph-to-Graph Models27 Oct 2023
- 2023High-order Joint Constituency and Dependency Parsing21 Sep 2023
- 2023GADePo: Graph-Assisted Declarative Pooling Transformers for Document-Level Relation Extraction28 Aug 2023
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question2 Nov 2022
- 2022BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing21 Jun 2022
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers23 May 2022
8 more
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond20 Apr 2022
- 2022Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive Learning11 Apr 2022
- 2022Graph Refinement for Coreference Resolution30 Mar 2022
- 2021Combining (second-order) graph-based and headed-span-based projective dependency parsing12 Aug 2021
- 2021Headed-Span-Based Projective Dependency Parsing10 Aug 2021
- 2021Dependency Parsing with Bottom-up Hierarchical Pointer Networks20 May 2021
- 2021Dependency Parsing as MRC-based Span-Span Prediction17 May 2021
- 2021Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling15 Apr 2021
- 2022A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyondcited by 64
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
- 2021Dependency Parsing as MRC-based Span-Span Predictioncited by 13
- 2022BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsingcited by 13
- 2021Headed-Span-Based Projective Dependency Parsingcited by 11
- 2021Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labellingcited by 8
- 2022Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive Learningcited by 8
- 2022Graph Refinement for Coreference Resolutioncited by 7
- 2021Dependency Parsing with Bottom-up Hierarchical Pointer Networkscited by 5
- 2021Combining (second-order) graph-based and headed-span-based projective dependency parsingcited by 5
- 2023Transformers as Graph-to-Graph Modelscited by 5
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformerscited by 2
12 most cited of 20 All 20 (JSON)
- 2025Order-Level Attention Similarity Across Language Models: A Latent Commonality7 Nov 2025
- 2025Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks17 Jun 2025
- 2025Scaling Graph-Based Dependency Parsing with Arc Vectorization and Attention-Based Refinement16 Jan 2025
- 2024CSSL: Contrastive Self-Supervised Learning for Dependency Parsing on Relatively Free Word Ordered and Morphologically Rich Low Resource Languages9 Oct 2024
- 2024Fast-and-Frugal Text-Graph Transformers are Effective Link Predictors13 Aug 2024
- 2024Thai Universal Dependency Treebank13 May 2024
- 2023Transformers as Graph-to-Graph Models27 Oct 2023
- 2023High-order Joint Constituency and Dependency Parsing21 Sep 2023
- 2023GADePo: Graph-Assisted Declarative Pooling Transformers for Document-Level Relation Extraction28 Aug 2023
- 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question2 Nov 2022
- 2022BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing21 Jun 2022
- 2022Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers23 May 2022
12 newest of 20 All 20 (JSON)