mlsanityData to 14 Oct 2026

Generative Linguistics, Large Language Models, and the Social Nature of Scientific Success

arXiv 2503.20088 ↗First posted 25 Mar 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Chesi's (forthcoming) target paper depicts a generative linguistics in crisis, foreboded by Piantadosi's (2023) declaration that "modern language models refute Chomsky's approach to language." In order to survive, Chesi warns, generativists must hold themselves to higher standards of formal and empirical rigor. This response argues that the crisis described by Chesi and Piantadosi actually has little to do with rigor, but is rather a reflection of generativists' limited social ambitions. Chesi ties the fate of generative linguistics to its intellectual merits, but the current success of language model research is social in nature as much as it is intellectual. In order to thrive, then, generativists must do more than heed Chesi's call for rigor; they must also expand their ambitions by giving outsiders a stake in their future success.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 129 references that are in the map. First posted on arXiv 25 Mar 2025.

Builds on

48 of 129 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2020Scaling Laws for Neural Language Modelscited by 6,586
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  10. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  12. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
36 more
  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  2. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  3. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  4. 2019Language Models as Knowledge Bases?cited by 1,936
  5. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  6. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  7. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  8. 2022Red Teaming Language Models with Language Modelscited by 1,026
  9. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  10. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
  11. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  12. 2018What you can cram into a single vector: Probing sentence embeddings for linguistic propertiescited by 457
  13. 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 354
  14. 2020The Lottery Ticket Hypothesis for Pre-trained BERT Networkscited by 275
  15. 2018Targeted Syntactic Evaluation of Language Modelscited by 242
  16. 2022Measuring Progress on Scalable Oversight for Large Language Modelscited by 225
  17. 2018A Simple Method for Commonsense Reasoningcited by 223
  18. 2018Colorless green recurrent networks dream hierarchicallycited by 213
  19. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
  20. 2021Saturated Transformers are Constant-Depth Threshold Circuitscited by 139
  21. 2020On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behaviorcited by 119
  22. 2020When BERT Plays the Lottery, All Tickets Are Winningcited by 114
  23. 2022Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?cited by 113
  24. 2020When Do You Need Billions of Words of Pretraining Data?cited by 104
  25. 2020Syntactic Structure from Deep Learningcited by 99
  26. 2024The rising costs of training frontier AI modelscited by 95
  27. 2019The emergence of number and syntax units in LSTM language modelscited by 94
  28. 2022Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexitycited by 93
  29. 2023Masked Hard-Attention Transformers Recognize Exactly the Star-Free Languagescited by 49
  30. 2021On the proper role of linguistically-oriented deep net analysis in linguistic theorizingcited by 43
  31. 2019Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluatorscited by 35
  32. 2018Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networkscited by 33
  33. 2020Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modelingcited by 22
  34. 2020What they do when in doubt: a study of inductive biases in seq2seq learnerscited by 20
  35. 2023Why Linguistics Will Thrive in the 21st Century: A Reply to Piantadosi (2023)cited by 9
  36. 2024Is it the end of (generative) linguistics as we know it?cited by 2

Built on by

Not cited yet.