mlsanityData to 14 Oct 2026

Neural Network Acceptability Judgments

arXiv 1805.12471 ↗First posted 31 May 2018cs.CLcited by 958

Not on the map. Why?

Cited by 30 in Knowledge distillation, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper investigates the ability of artificial neural networks to judge the grammatical acceptability of a sentence, with the goal of testing their linguistic competence. We introduce the Corpus of Linguistic Acceptability (CoLA), a set of 10,657 English sentences labeled as grammatical or ungrammatical from published linguistics literature. As baselines, we train several recurrent neural network models on acceptability classification, and find that our models outperform unsupervised models by Lau et al (2016) on CoLA. Error-analysis on specific grammatical phenomena reveals that both Lau et al.'s models and ours learn systematic generalizations like subject-verb-object order. However, all models we test perform far below human level on a wide range of grammatical constructions.

Key facts. Cited by 958 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 142; 2022: 186; 2023: 193; 2024: 189; 2025: 150; 2026: 98.

958 papers.

Sort:

By area:

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  3. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  4. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  5. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  6. 2022Editing Models with Task Arithmeticcited by 1,120
  7. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  8. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
  9. 2021Merging Models with Fisher-Weighted Averagingcited by 621
  10. 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 526
  11. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  12. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 467
38 more
  1. 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 460
  2. 2021MetaICL: Learning to Learn In Contextcited by 454
  3. 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
  4. 2022Dataless Knowledge Fusion by Merging Weights of Language Modelscited by 387
  5. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
  6. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
  7. 2021Understanding Dataset Difficulty with V-Usable Informationcited by 291
  8. 2021Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworkscited by 284
  9. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  10. 2021I-BERT: Integer-only BERT Quantizationcited by 255
  11. 2023Pretraining Language Models with Human Preferencescited by 247
  12. 2024SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressioncited by 243
  13. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 243
  14. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 236
  15. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  16. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  17. 2022LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learningcited by 230
  18. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
  19. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 224
  20. 2021WARP: Word-level Adversarial ReProgrammingcited by 221
  21. 2022Demystifying Prompts in Language Models via Perplexity Estimationcited by 216
  22. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 211
  23. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  24. 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
  25. 2023LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Modelscited by 196
  26. 2022Language model compression with weighted low-rank factorizationcited by 195
  27. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  28. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
  29. 2022Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Modelscited by 180
  30. 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 177
  31. 2022Structured Pruning Learns Compact and Accurate Modelscited by 170
  32. 2022A Fast Post-Training Pruning Framework for Transformerscited by 162
  33. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  34. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
  35. 2021MoEfication: Transformer Feed-forward Layers are Mixtures of Expertscited by 152
  36. 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
  37. 2023Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learningcited by 149
  38. 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142

50 most cited of 958 All 958 (JSON)