Structural Ambiguity and its Disambiguation in Language Model Based Parsers: the Case of Dutch Clause Relativization
Not on the map. Why?
Abstract (arXiv)
This paper addresses structural ambiguity in Dutch relative clauses. By investigating the task of disambiguation by grounding, we study how the presence of a prior sentence can resolve relative clause ambiguities. We apply this method to two parsing architectures in an attempt to demystify the parsing and language model components of two present-day neural parsers. Results show that a neurosymbolic parser, based on proof nets, is more open to data bias correction than an approach based on universal dependencies, although both setups suffer from a comparable initial data bias.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 45 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
24 of 45 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Primer in BERTology: What we know about how BERT workscited by 807
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
- 2020A Systematic Assessment of Syntactic Generalization in Neural Language Modelscited by 163
- 2019Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic Statecited by 137
- 2019BERTje: A Dutch BERT Modelcited by 109
- 2020RobBERT: a Dutch RoBERTa-based Language Modelcited by 88
- 2021Structural Persistence in Language Models: Priming as a Window into Abstract Language Representationscited by 44
- 2019Viable Dependency Parsing as Sequence Labelingcited by 34
- 2022Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguitiescited by 30
- 2021SICKNL: A Dataset for Dutch Natural Language Inferencecited by 20
12 more
- 2020Parsing as Pretrainingcited by 19
- 2021The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generationcited by 15
- 2019SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisitioncited by 8
- 2020Neural Proof Netscited by 8
- 2021Something Old, Something New: Grammar-based CCG Parsing with Transformer Modelscited by 6
- 2021Improving BERT Pretraining with Syntactic Supervisioncited by 4
- 2020A Frobenius Algebraic Analysis for Parasitic Gapscited by 3
- 2022Discontinuous Constituency and BERT: A Case Study of Dutchcited by 3
- 2017Lexical and Derivational Meaning in Vector-Based Models of Relativisationcited by 2
- 2020Binary and Multitask Classification Model for Dutch Anaphora Resolution: Die/Dat Predictioncited by 2
- 2022Where's the Learning in Representation Learning for Compositional Semantics and the Case of Thematic Fitcited by 2
- 2023SPINDLE: Spinning Raw Text into Lambda Terms with Graph Attentioncited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.