Globally Normalized Transition-Based Neural Networks
Not on the map. Why?
Abstract (arXiv)
We introduce a globally normalized transition-based neural network model that achieves state-of-the-art part-of-speech tagging, dependency parsing and sentence compression results. Our model is a simple feed-forward neural network that operates on a task-specific transition system, yet achieves comparable or better accuracies than recurrent models. We discuss the importance of global as opposed to local normalization: a key insight is that the label bias problem implies that globally normalized models can be strictly more expressive than locally normalized models.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 1; 2021: 10; 2022: 7; 2023: 4; 2024: 2; 2025: 0; 2026: 1.
26 papers.
Sort:
By area:
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2022On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgettingcited by 82
- 2020Text Generation by Learning from Demonstrationscited by 64
- 2021Identifying Morality Frames in Political Tweets using Relational Learningcited by 26
- 2022Evaluating Distributional Distortion in Neural Language Modelingcited by 19
- 2021Learning Logic Rules for Document-level Relation Extractioncited by 15
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attackcited by 13
- 2021Energy-Based Models for Code Generation under Compilability Constraintscited by 10
- 2022Global Normalization for Streaming Speech Recognition in a Modular Frameworkcited by 10
- 2018Learning Beam Search Policies via Imitation Learningcited by 9
- 2023Time-series Generation by Contrastive Imitationcited by 9
- 2023Transformers as Graph-to-Graph Modelscited by 5
14 more
- 2021Randomized Deep Structured Prediction for Discourse-Level Processingcited by 4
- 2021Detect and Defense Against Adversarial Examples in Deep Learning using Natural Scene Statistics and Adaptive Denoisingcited by 3
- 2021EG-Booster: Explanation-Guided Booster of ML Evasion Attackscited by 3
- 2021A Globally Normalized Neural Model for Semantic Parsingcited by 2
- 2021Mode recovery in neural autoregressive sequence modelingcited by 1
- 2022Efficient and Robust Classification for Sparse Attackscited by 1
- 2022Algorithms for Weighted Pushdown Automatacited by 1
- 2023Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognitioncited by 1
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectorscited by 1
- 2024Stealthy Multi-Task Adversarial Attackscited by 1
- 2026Beyond Attack Success Rate: A Multi-Metric Evaluation of Adversarial Transferability in Medical Imaging Modelscited by 1
- 2021Adversarial Stein Training for Graph Energy Modelscited by 0
- 2022Towards a neural architecture of language: Deep learning versus logistics of access in neural architectures for compositional processingcited by 0
- 2023Globally Normalising the Transducer for Streaming Speech Recognitioncited by 0
- 2026Beyond Attack Success Rate: A Multi-Metric Evaluation of Adversarial Transferability in Medical Imaging Models16 Apr 2026
- 2024Stealthy Multi-Task Adversarial Attacks26 Nov 2024
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectors30 May 2024
- 2023Time-series Generation by Contrastive Imitation2 Nov 2023
- 2023Transformers as Graph-to-Graph Models27 Oct 2023
- 2023Globally Normalising the Transducer for Streaming Speech Recognition20 Jul 2023
- 2023Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition22 May 2023
- 2022Towards a neural architecture of language: Deep learning versus logistics of access in neural architectures for compositional processing19 Oct 2022
- 2022Algorithms for Weighted Pushdown Automata13 Oct 2022
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack15 Jun 2022
- 2022On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting1 Jun 2022
- 2022Global Normalization for Streaming Speech Recognition in a Modular Framework26 May 2022
14 more
- 2022Evaluating Distributional Distortion in Neural Language Modeling24 Mar 2022
- 2022Efficient and Robust Classification for Sparse Attacks23 Jan 2022
- 2021Learning Logic Rules for Document-level Relation Extraction9 Nov 2021
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks25 Oct 2021
- 2021Identifying Morality Frames in Political Tweets using Relational Learning9 Sep 2021
- 2021EG-Booster: Explanation-Guided Booster of ML Evasion Attacks31 Aug 2021
- 2021Adversarial Stein Training for Graph Energy Models30 Aug 2021
- 2021Detect and Defense Against Adversarial Examples in Deep Learning using Natural Scene Statistics and Adaptive Denoising12 Jul 2021
- 2021Mode recovery in neural autoregressive sequence modeling10 Jun 2021
- 2021Energy-Based Models for Code Generation under Compilability Constraints9 Jun 2021
- 2021A Globally Normalized Neural Model for Semantic Parsing7 Jun 2021
- 2021Randomized Deep Structured Prediction for Discourse-Level Processing25 Jan 2021
- 2020Text Generation by Learning from Demonstrations16 Sep 2020
- 2018Learning Beam Search Policies via Imitation Learning1 Nov 2018
- 2020Text Generation by Learning from Demonstrationscited by 64
- 2018Learning Beam Search Policies via Imitation Learningcited by 9
- 2020Text Generation by Learning from Demonstrations16 Sep 2020
- 2018Learning Beam Search Policies via Imitation Learning1 Nov 2018
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2022On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgettingcited by 82
- 2021Identifying Morality Frames in Political Tweets using Relational Learningcited by 26
- 2022Evaluating Distributional Distortion in Neural Language Modelingcited by 19
- 2021Learning Logic Rules for Document-level Relation Extractioncited by 15
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attackcited by 13
- 2021Energy-Based Models for Code Generation under Compilability Constraintscited by 10
- 2022Global Normalization for Streaming Speech Recognition in a Modular Frameworkcited by 10
- 2023Time-series Generation by Contrastive Imitationcited by 9
- 2023Transformers as Graph-to-Graph Modelscited by 5
- 2021Randomized Deep Structured Prediction for Discourse-Level Processingcited by 4
- 2021Detect and Defense Against Adversarial Examples in Deep Learning using Natural Scene Statistics and Adaptive Denoisingcited by 3
12 most cited of 24 All 24 (JSON)
- 2026Beyond Attack Success Rate: A Multi-Metric Evaluation of Adversarial Transferability in Medical Imaging Models16 Apr 2026
- 2024Stealthy Multi-Task Adversarial Attacks26 Nov 2024
- 2024HOLMES: to Detect Adversarial Examples with Multiple Detectors30 May 2024
- 2023Time-series Generation by Contrastive Imitation2 Nov 2023
- 2023Transformers as Graph-to-Graph Models27 Oct 2023
- 2023Globally Normalising the Transducer for Streaming Speech Recognition20 Jul 2023
- 2023Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition22 May 2023
- 2022Towards a neural architecture of language: Deep learning versus logistics of access in neural architectures for compositional processing19 Oct 2022
- 2022Algorithms for Weighted Pushdown Automata13 Oct 2022
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack15 Jun 2022
- 2022On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting1 Jun 2022
- 2022Global Normalization for Streaming Speech Recognition in a Modular Framework26 May 2022
12 newest of 24 All 24 (JSON)