mlsanityData to 14 Oct 2026

Deep Biaffine Attention for Neural Dependency Parsing

arXiv 1611.01734 ↗First posted 6 Nov 2016cs.CL cs.NEcited by 334

Not on the map. Why?

Abstract (arXiv)

This paper builds off recent work from Kiperwasser & Goldberg (2016) using neural attention in a simple graph-based dependency parser. We use a larger but more thoroughly regularized parser than other recent BiLSTM-based approaches, with biaffine classifiers to predict arcs and labels. Our parser gets state of the art or near state of the art performance on standard treebanks for six different languages, achieving 95.7% UAS and 94.1% LAS on the most popular English PTB dataset. This makes it the highest-performing graph-based parser on this benchmark---outperforming Kiperwasser Goldberg (2016) by 1.8% and 2.2%---and comparable to the highest performing transition-based parser (Kuncoro et al., 2016), which achieves 95.8% UAS and 94.6% LAS. We also show which hyperparameter choices had a significant effect on parsing accuracy, allowing us to achieve large gains over other graph-based approaches.

Key facts. Cited by 334 papers in the map (data through 14 Oct 2026). First posted on arXiv 6 Nov 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 114; 2022: 68; 2023: 60; 2024: 45; 2025: 20; 2026: 27.

334 papers.

Sort:

By area:

  1. 2023Explainability for Large Language Models: A Surveycited by 333
  2. 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 177
  3. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  4. 2021Composable Sparse Fine-Tuning for Cross-Lingual Transfercited by 144
  5. 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
  6. 2021KLUE: Korean Language Understanding Evaluationcited by 114
  7. 2021Context-aware Biaffine Localizing Network for Temporal Sentence Groundingcited by 107
  8. 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 90
  9. 2021Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processingcited by 68
  10. 2021Low-Complexity Probing via Finding Subnetworkscited by 64
  11. 2021Few-Shot Question Answering by Pretraining Span Selectioncited by 62
  12. 2022Language Modelling with Pixelscited by 55
38 more
  1. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
  2. 2021Probing BERT in Hyperbolic Spacescited by 50
  3. 2021Coreference Resolution without Span Representationscited by 45
  4. 2021Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTacited by 41
  5. 2021A Sequence-to-Set Network for Nested Named Entity Recognitioncited by 40
  6. 2021UniRE: A Unified Label Space for Entity Relation Extractioncited by 38
  7. 2021Systematic Generalization with Edge Transformerscited by 38
  8. 2021RobeCzech: Czech RoBERTa, a monolingual contextualized language representation modelcited by 33
  9. 2022Calibrated Interpretation: Confidence Estimation in Semantic Parsingcited by 33
  10. 2021The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoderscited by 32
  11. 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
  12. 2021Learn from Syntax: Improving Pair-wise Aspect and Opinion Terms Extractionwith Rich Syntactic Knowledgecited by 31
  13. 2021On the Sensitivity and Stability of Model Interpretations in NLPcited by 30
  14. 2021DMRST: A Joint Framework for Document-Level Multilingual RST Discourse Segmentation and Parsingcited by 28
  15. 2022Pretraining with Artificial Language: Studying Transferable Knowledge in Language Modelscited by 28
  16. 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
  17. 2021Substructure Substitution: Structured Data Augmentation for NLPcited by 25
  18. 2021Improving Text-to-SQL with Schema Dependency Learningcited by 25
  19. 2021Non-Autoregressive Translation by Learning Target Categorical Codescited by 25
  20. 2021Mastering the Explicit Opinion-role Interaction: Syntax-aided Neural Transition System for Unified Opinion Role Labelingcited by 25
  21. 2021Structural Information Preserving for Graph-to-Text Generationcited by 24
  22. 2022Phylogeny-Inspired Adaptation of Multilingual Models to New Languagescited by 24
  23. 2021Entity Relation Extraction as Dependency Parsing in Visually Rich Documentscited by 23
  24. 2023NorBench -- A Benchmark for Norwegian Language Modelscited by 23
  25. 2021Attention Can Reflect Syntactic Structure (If You Let It)cited by 22
  26. 2021Better Feature Integration for Named Entity Recognitioncited by 22
  27. 2021Specializing Multilingual Language Models: An Empirical Studycited by 21
  28. 2021How much pretraining data do language models need to learn syntax?cited by 21
  29. 2021Bottom-Up Constituency Parsing and Nested Named Entity Recognition with Pointer Networkscited by 21
  30. 2023Romanization-based Large-scale Adaptation of Multilingual Language Modelscited by 21
  31. 2023On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Trainingcited by 20
  32. 2023How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanesecited by 20
  33. 2023Enhancing Grammatical Error Correction Systems with Explanationscited by 19
  34. 2021Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognitioncited by 18
  35. 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
  36. 2021Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extractioncited by 16
  37. 2022Multi-task Active Learning for Pre-trained Transformer-based Modelscited by 16
  38. 2023Neighborhood Contrastive Transformer for Change Captioningcited by 16

50 most cited of 334 All 334 (JSON)