Rule Augmented Unsupervised Constituency Parsing
Not on the map. Why?
Abstract (arXiv)
Recently, unsupervised parsing of syntactic trees has gained considerable attention. A prototypical approach to such unsupervised parsing employs reinforcement learning and auto-encoders. However, no mechanism ensures that the learnt model leverages the well-understood language grammar. We propose an approach that utilizes very generic linguistic knowledge of the language present in the form of syntactic rules, thus inducing better syntactic structures. We introduce a novel formulation that takes advantage of the syntactic grammar rules and is independent of the base system. We achieve new state-of-the-art results on two benchmarks datasets, MNLI and WSJ. The source code of the paper is available at https://github.com/anshuln/Diora_with_rules.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 21 May 2021.
Builds on
13 of 26 references.
References · 13
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2018Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networkscited by 101
- 2019Compound Probabilistic Context-Free Grammars for Grammar Inductioncited by 76
- 2019Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoderscited by 60
- 2017Neural Language Modeling by Jointly Learning Syntax and Lexiconcited by 57
- 2017Learning to Compose Task-Specific Tree Structurescited by 48
- 2020Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Inductioncited by 47
- 2016Learning to Compose Words into Sentences with Reinforcement Learningcited by 30
- 2017Jointly Learning Sentence Embeddings and Syntax with Unsupervised Tree-LSTMscited by 23
- 2017Learning to Parse and Translate Improves Neural Machine Translationcited by 16
- 2017The Neural Network Pushdown Automaton: Model, Stack and Learning Simulationscited by 10
- 2017Incorporating Syntactic Uncertainty in Neural Machine Translation with Forest-to-Sequence Modelcited by 2
1 more
Built on by
Citing papers per year: 2021: 3; 2022: 0; 2023: 0; 2024: 1.
4 papers.
- 2021Neural Bi-Lexicalized PCFG Inductioncited by 18
- 2021SPEAR : Semi-supervised Data Programming in Pythoncited by 6
- 2024FAIR: Filtering of Automatically Induced Rulescited by 1
- 2021Unsupervised Full Constituency Parsing with Neighboring Distribution Divergencecited by 0
- 2024FAIR: Filtering of Automatically Induced Rules23 Feb 2024
- 2021Unsupervised Full Constituency Parsing with Neighboring Distribution Divergence29 Oct 2021
- 2021SPEAR : Semi-supervised Data Programming in Python1 Aug 2021
- 2021Neural Bi-Lexicalized PCFG Induction31 May 2021