{"list":"other","total":123,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"1905.07830","title":"HellaSwag: Can a Machine Really Finish Your Sentence?","created":"2019-05-19","cited_by_count":4100},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2004.05150","title":"Longformer: The Long-Document Transformer","created":"2020-04-10","cited_by_count":3413},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"2206.14858","title":"Solving Quantitative Reasoning Problems with Language Models","created":"2022-06-29","cited_by_count":1392},{"id":"1607.06520","title":"Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings","created":"2016-07-21","cited_by_count":1312},{"id":"2112.04426","title":"Improving language models by retrieving from trillions of tokens","created":"2021-12-08","cited_by_count":1293},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"1608.07187","title":"Semantics derived automatically from language corpora contain human-like biases","created":"2016-08-25","cited_by_count":901},{"id":"2103.07191","title":"Are NLP Models really able to Solve Simple Math Word Problems?","created":"2021-03-12","cited_by_count":878},{"id":"1902.01007","title":"Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference","created":"2019-02-04","cited_by_count":876},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"1908.07125","title":"Universal Adversarial Triggers for Attacking and Analyzing NLP","created":"2019-08-20","cited_by_count":722},{"id":"1906.01502","title":"How multilingual is Multilingual BERT?","created":"2019-06-04","cited_by_count":645},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"2202.09368","title":"Mixture-of-Experts with Expert Choice Routing","created":"2022-02-18","cited_by_count":623},{"id":"2009.02252","title":"KILT: a Benchmark for Knowledge Intensive Language Tasks","created":"2020-09-04","cited_by_count":573},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"1705.02364","title":"Supervised Learning of Universal Sentence Representations from Natural Language Inference Data","created":"2017-05-05","cited_by_count":432},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"1904.12584","title":"The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision","created":"2019-04-26","cited_by_count":372},{"id":"1911.03894","title":"CamemBERT: a Tasty French Language Model","created":"2019-11-10","cited_by_count":368},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"1808.05326","title":"SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference","created":"2018-08-16","cited_by_count":333},{"id":"1907.13528","title":"What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models","created":"2019-07-31","cited_by_count":320},{"id":"2106.15772","title":"A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers","created":"2021-06-30","cited_by_count":318},{"id":"1711.02173","title":"Synthetic and Natural Noise Both Break Neural Machine Translation","created":"2017-11-06","cited_by_count":306},{"id":"1810.02338","title":"Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding","created":"2018-10-04","cited_by_count":304},{"id":"1909.00277","title":"Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoning","created":"2019-08-31","cited_by_count":285},{"id":"1812.08951","title":"Analysis Methods in Neural Language Processing: A Survey","created":"2018-12-21","cited_by_count":277},{"id":"1906.07337","title":"Measuring Bias in Contextualized Word Representations","created":"2019-06-18","cited_by_count":276},{"id":"1908.08351","title":"Compositionality decomposed: how do neural networks generalise?","created":"2019-08-22","cited_by_count":265},{"id":"2204.02329","title":"Can language models learn from explanations in context?","created":"2022-04-05","cited_by_count":249},{"id":"1906.04284","title":"Analyzing the Structure of Attention in a Transformer Language Model","created":"2019-06-07","cited_by_count":243},{"id":"1911.03343","title":"Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly","created":"2019-11-08","cited_by_count":243},{"id":"1808.09031","title":"Targeted Syntactic Evaluation of Language Models","created":"2018-08-27","cited_by_count":242},{"id":"2003.12298","title":"Information-Theoretic Probing with Minimum Description Length","created":"2020-03-27","cited_by_count":232},{"id":"2112.07916","title":"LongT5: Efficient Text-To-Text Transformer for Long Sequences","created":"2021-12-15","cited_by_count":232},{"id":"2210.13312","title":"Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs","created":"2022-10-24","cited_by_count":220},{"id":"1803.11138","title":"Colorless green recurrent networks dream hierarchically","created":"2018-03-29","cited_by_count":213},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"2002.06177","title":"The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence","created":"2020-02-14","cited_by_count":195},{"id":"1906.01076","title":"Episodic Memory in Lifelong Language Learning","created":"2019-06-03","cited_by_count":188},{"id":"2212.03551","title":"Talking About Large Language Models","created":"2022-12-07","cited_by_count":175},{"id":"2005.03692","title":"A Systematic Assessment of Syntactic Generalization in Neural Language Models","created":"2020-05-07","cited_by_count":165},{"id":"1912.13283","title":"oLMpics -- On what Language Model Pre-training Captures","created":"2019-12-31","cited_by_count":161},{"id":"2212.01681","title":"Language Models as Agent Models","created":"2022-12-03","cited_by_count":132},{"id":"2106.06087","title":"Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models","created":"2021-06-10","cited_by_count":131},{"id":"1705.03633","title":"Inferring and Executing Programs for Visual Reasoning","created":"2017-05-10","cited_by_count":130},{"id":"2111.09509","title":"How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN","created":"2021-11-18","cited_by_count":124},{"id":"2110.06733","title":"Systematic Inequalities in Language Technology Performance across the World's Languages","created":"2021-10-13","cited_by_count":120},{"id":"2109.06129","title":"Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color","created":"2021-09-13","cited_by_count":119},{"id":"1907.03950","title":"Learning by Abstraction: The Neural State Machine","created":"2019-07-09","cited_by_count":113},{"id":"2011.04946","title":"When Do You Need Billions of Words of Pretraining Data?","created":"2020-11-10","cited_by_count":104},{"id":"2004.10827","title":"Syntactic Structure from Deep Learning","created":"2020-04-22","cited_by_count":99},{"id":"2208.07998","title":"What Artificial Neural Networks Can Tell Us About Human Language Acquisition","created":"2022-08-17","cited_by_count":99},{"id":"1808.08079","title":"Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information","created":"2018-08-24","cited_by_count":97},{"id":"2010.02695","title":"Analyzing Individual Neurons in Pre-trained Language Models","created":"2020-10-06","cited_by_count":97},{"id":"2110.03742","title":"Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference","created":"2021-09-24","cited_by_count":96},{"id":"1903.07435","title":"The emergence of number and syntax units in LSTM language models","created":"2019-03-18","cited_by_count":94},{"id":"2004.13640","title":"Extending Multilingual BERT to Low-Resource Languages","created":"2020-04-28","cited_by_count":88},{"id":"1809.00042","title":"What do RNN Language Models Learn about Filler-Gap Dependencies?","created":"2018-08-31","cited_by_count":86},{"id":"1601.01705","title":"Learning to Compose Neural Networks for Question Answering","created":"2016-01-07","cited_by_count":85},{"id":"2103.01197","title":"Coordination Among Neural Modules Through a Shared Global Workspace","created":"2021-03-01","cited_by_count":85},{"id":"1805.12282","title":"On the Impact of Various Types of Noise on Neural Machine Translation","created":"2018-05-31","cited_by_count":76},{"id":"2208.02957","title":"Meaning without reference in large language models","created":"2022-08-05","cited_by_count":76},{"id":"2001.03632","title":"Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networks","created":"2020-01-10","cited_by_count":72},{"id":"2212.06801","title":"A fine-grained comparison of pragmatic language understanding in humans and language models","created":"2022-12-13","cited_by_count":70},{"id":"2105.06965","title":"Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction","created":"2021-05-14","cited_by_count":59},{"id":"2109.07020","title":"Frequency Effects on Syntactic Rule Learning in Transformers","created":"2021-09-14","cited_by_count":59},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59},{"id":"1909.02597","title":"Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs","created":"2019-09-05","cited_by_count":58},{"id":"1806.03743","title":"Are All Languages Equally Hard to Language-Model?","created":"2018-06-10","cited_by_count":53},{"id":"1807.07545","title":"Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networks","created":"2018-07-19","cited_by_count":51},{"id":"1906.04726","title":"What Kind of Language Is Hard to Language-Model?","created":"2019-06-11","cited_by_count":50},{"id":"2210.02938","title":"Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Tasks","created":"2022-10-06","cited_by_count":48},{"id":"2106.08694","title":"On the proper role of linguistically-oriented deep net analysis in linguistic theorizing","created":"2021-06-16","cited_by_count":43},{"id":"2203.08075","title":"Things not Written in Text: Exploring Spatial Commonsense from Visual Signals","created":"2022-03-15","cited_by_count":41},{"id":"2110.08300","title":"The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail","created":"2021-10-15","cited_by_count":38},{"id":"1903.06400","title":"Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages","created":"2019-03-15","cited_by_count":37},{"id":"1802.09091","title":"Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks","created":"2018-02-25","cited_by_count":33},{"id":"2106.03232","title":"A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans","created":"2021-06-06","cited_by_count":32},{"id":"2210.12187","title":"Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities","created":"2022-10-21","cited_by_count":30},{"id":"2106.02559","title":"Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing","created":"2021-06-04","cited_by_count":28},{"id":"2212.10769","title":"Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models","created":"2022-12-21","cited_by_count":26},{"id":"1909.00111","title":"Quantity doesn't buy quality syntax with neural language models","created":"2019-08-31","cited_by_count":25}],"next_cursor":"100"}