mlsanityData to 14 Oct 2026

Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus

arXiv 2109.12053 ↗First posted 24 Sep 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

The development of automated approaches to linguistic acceptability has been greatly fostered by the availability of the English CoLA corpus, which has also been included in the widely used GLUE benchmark. However, this kind of research for languages other than English, as well as the analysis of cross-lingual approaches, has been hindered by the lack of resources with a comparable size in other languages. We have therefore developed the ItaCoLA corpus, containing almost 10,000 sentences with acceptability judgments, which has been created following the same approach and the same steps as the English one. In this paper we describe the corpus creation, we detail its content, and we present the first experiments on this new resource. We compare in-domain and out-of-domain classification, and perform a specific evaluation of nine linguistic phenomena. We also present the first cross-lingual experiments, aimed at assessing whether multilingual transformerbased approaches can benefit from using sentences in two languages during fine-tuning.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 23 of its 70 references that are in the map. First posted on arXiv 24 Sep 2021.

Builds on

23 of 70 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  7. 2018Deep contextualized word representationscited by 2,290
  8. 2018Neural Network Acceptability Judgmentscited by 958
  9. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  10. 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 354
  11. 2018Learning Word Vectors for 157 Languagescited by 280
  12. 2018Targeted Syntactic Evaluation of Language Modelscited by 242
11 more
  1. 2018Colorless green recurrent networks dream hierarchicallycited by 213
  2. 2019Assessing BERT's Syntactic Abilitiescited by 192
  3. 2021Entailment as Few-Shot Learnercited by 123
  4. 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 109
  5. 2020Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networkscited by 72
  6. 2020What the [MASK]? Making Sense of Language-Specific BERT Modelscited by 44
  7. 2020How Furiously Can Colourless Green Ideas Sleep? Sentence Acceptability in Contextcited by 26
  8. 2021DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharingcited by 16
  9. 2018What can linguistics and deep learning contribute to each other?cited by 10
  10. 2019Linguistic Analysis of Pretrained Sentence Encoders with Acceptability Judgmentscited by 4
  11. 2020UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 4; 2024: 6; 2025: 5; 2026: 1.

18 papers.

Sort:

By area:

  1. 2022RuCoLA: Russian Corpus of Linguistic Acceptabilitycited by 26
  2. 2022Acceptability Judgements via Examining the Topology of Attention Mapscited by 19
  3. 2023MELA: Multilingual Evaluation of Linguistic Acceptabilitycited by 14
  4. 2023JCoLA: Japanese Corpus of Linguistic Acceptabilitycited by 11
  5. 2023NoCoLA: The Norwegian Corpus of Linguistic Acceptabilitycited by 10
  6. 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
  7. 2024Controlled Evaluation of Syntactic Knowledge in Multilingual Language Modelscited by 10
  8. 2025Reference-free Evaluation Metrics for Text Generation: A Surveycited by 9
  9. 2024From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentencescited by 8
  10. 2024Automatic Annotation of Grammaticality in Child-Caregiver Conversationscited by 5
  11. 2025DaLA: Danish Linguistic Acceptability Evaluation Guided by Real World Errorscited by 3
  12. 2024Quantum Transfer Learning for Acceptability Judgementscited by 2
6 more
  1. 2024Is it the end of (generative) linguistics as we know it?cited by 2
  2. 2025QFrCoLA: a Quebec-French Corpus of Linguistic Acceptability Judgmentscited by 2
  3. 2025QFrBLiMP: a Quebec-French Benchmark of Linguistic Minimal Pairscited by 2
  4. 2026Implicit Representations of Grammaticality in Language Modelscited by 1
  5. 2023Revisiting Acceptability Judgementscited by 0
  6. 2025COLA-GEC: A Bidirectional Framework for Enhancing Grammatical Acceptability and Error Correctioncited by 0