mlsanityData to 7 Oct 2026

Does Character-level Information Always Improve DRS-based Semantic Parsing?

arXiv 2306.02302 ↗First posted 4 Jun 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Even in the era of massive language models, it has been suggested that character-level representations improve the performance of neural models. The state-of-the-art neural semantic parser for Discourse Representation Structures uses character-level representations, improving performance in the four languages (i.e., English, German, Dutch, and Italian) in the Parallel Meaning Bank dataset. However, how and why character-level information improves the parser's performance remains unclear. This study provides an in-depth analysis of performance changes by order of character sequences. In the experiments, we compare F1-scores by shuffling the order and randomizing character sequences after testing the performance of character-level information. Our results indicate that incorporating character-level information does not improve the performance in English and German. In addition, we find that the parser is not sensitive to correct character order in Dutch. Nevertheless, performance improvements are observed when using character-level information.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 4 Jun 2023.

Builds on

18 of 35 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  4. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  5. 2016Neural Architectures for Named Entity Recognitioncited by 548
  6. 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 176
  7. 2020Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks?cited by 72
  8. 2020UnNatural Language Inferencecited by 68
  9. 2017The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representationscited by 41
  10. 2021Examining the Inductive Bias of Neural Language Models with Artificial Languagescited by 40
  11. 2019Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languagescited by 37
  12. 2022Word Order Does Matter (And Shuffled Language Models Know It)cited by 32
6 more
  1. 2018Revisiting Character-Based Neural Machine Translation with Capacity and Compressioncited by 28
  2. 2018Exploring Neural Methods for Parsing Discourse Representation Structurescited by 14
  3. 2017Towards Universal Semantic Taggingcited by 12
  4. 2018Evaluating Scoped Meaning Representationscited by 10
  5. 2019Semantic Graph Parsing with Recurrent Neural Network DAG Grammarscited by 8
  6. 2018On the Strength of Character Language Models for Multilingual Named Entity Recognitioncited by 3

Built on by

Not cited yet.