{"list":"other","total":81,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2103.00020","title":"Learning Transferable Visual Models From Natural Language Supervision","created":"2021-02-26","cited_by_count":33744},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1602.07332","title":"Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations","created":"2016-02-23","cited_by_count":2656},{"id":"1412.3555","title":"Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling","created":"2014-12-11","cited_by_count":2367},{"id":"1802.05365","title":"Deep contextualized word representations","created":"2018-02-15","cited_by_count":2290},{"id":"1908.02265","title":"ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks","created":"2019-08-06","cited_by_count":2222},{"id":"2006.03654","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","created":"2020-06-05","cited_by_count":2181},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1908.07490","title":"LXMERT: Learning Cross-Modality Encoder Representations from Transformers","created":"2019-08-20","cited_by_count":1553},{"id":"1504.00325","title":"Microsoft COCO Captions: Data Collection and Evaluation Server","created":"2015-04-01","cited_by_count":1462},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"1805.12471","title":"Neural Network Acceptability Judgments","created":"2018-05-31","cited_by_count":958},{"id":"1908.08530","title":"VL-BERT: Pre-training of Generic Visual-Linguistic Representations","created":"2019-08-22","cited_by_count":954},{"id":"2104.12763","title":"MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding","created":"2021-04-26","cited_by_count":819},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"1904.01766","title":"VideoBERT: A Joint Model for Video and Language Representation Learning","created":"2019-04-03","cited_by_count":703},{"id":"2112.04482","title":"FLAVA: A Foundational Language And Vision Alignment Model","created":"2021-12-08","cited_by_count":649},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"2002.08791","title":"Bayesian Deep Learning and a Probabilistic Perspective of Generalization","created":"2020-02-20","cited_by_count":480},{"id":"2004.07667","title":"Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection","created":"2020-04-16","cited_by_count":455},{"id":"1905.06316","title":"What do you learn from context? Probing for sentence structure in contextualized word representations","created":"2019-05-15","cited_by_count":438},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"2102.01192","title":"Generative Spoken Language Modeling from Raw Audio","created":"2021-02-01","cited_by_count":340},{"id":"1808.05326","title":"SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference","created":"2018-08-16","cited_by_count":333},{"id":"1909.00277","title":"Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoning","created":"2019-08-31","cited_by_count":285},{"id":"1912.09713","title":"Measuring Compositional Generalization: A Comprehensive Method on Realistic Data","created":"2019-12-20","cited_by_count":284},{"id":"1812.08951","title":"Analysis Methods in Neural Language Processing: A Survey","created":"2018-12-21","cited_by_count":277},{"id":"2010.05465","title":"COGS: A Compositional Generalization Challenge Based on Semantic Interpretation","created":"2020-10-12","cited_by_count":263},{"id":"1808.09031","title":"Targeted Syntactic Evaluation of Language Models","created":"2018-08-27","cited_by_count":242},{"id":"2003.12298","title":"Information-Theoretic Probing with Minimum Description Length","created":"2020-03-27","cited_by_count":232},{"id":"1608.04207","title":"Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks","created":"2016-08-15","cited_by_count":216},{"id":"1803.11138","title":"Colorless green recurrent networks dream hierarchically","created":"2018-03-29","cited_by_count":213},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"1511.01432","title":"Semi-supervised Sequence Learning","created":"2015-11-04","cited_by_count":198},{"id":"1612.07182","title":"Multi-Agent Cooperation and the Emergence of (Natural) Language","created":"2016-12-21","cited_by_count":185},{"id":"1902.04094","title":"BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model","created":"2019-02-11","cited_by_count":185},{"id":"2006.02419","title":"Emergent Multi-Agent Communication in the Deep Learning Era","created":"2020-06-03","cited_by_count":170},{"id":"2005.03692","title":"A Systematic Assessment of Syntactic Generalization in Neural Language Models","created":"2020-05-07","cited_by_count":165},{"id":"2106.06087","title":"Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models","created":"2021-06-10","cited_by_count":131},{"id":"2011.04946","title":"When Do You Need Billions of Words of Pretraining Data?","created":"2020-11-10","cited_by_count":104},{"id":"1804.03984","title":"Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input","created":"2018-04-11","cited_by_count":102},{"id":"2011.11588","title":"The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling","created":"2020-11-23","cited_by_count":101},{"id":"2004.10827","title":"Syntactic Structure from Deep Learning","created":"2020-04-22","cited_by_count":99},{"id":"1706.08502","title":"Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialog","created":"2017-06-26","cited_by_count":86},{"id":"1809.00042","title":"What do RNN Language Models Learn about Filler-Gap Dependencies?","created":"2018-08-31","cited_by_count":86},{"id":"2002.01365","title":"Compositional Languages Emerge in a Neural Iterated Learning Model","created":"2020-02-04","cited_by_count":75},{"id":"2001.03632","title":"Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networks","created":"2020-01-10","cited_by_count":72},{"id":"1607.08723","title":"Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learner","created":"2016-07-29","cited_by_count":68},{"id":"2005.07064","title":"Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning","created":"2020-05-14","cited_by_count":66},{"id":"1906.02403","title":"Ease-of-Teaching and Language Structure from Emergent Communication","created":"2019-06-06","cited_by_count":65},{"id":"2007.16189","title":"Self-supervised learning through the eyes of a child","created":"2020-07-31","cited_by_count":61},{"id":"1905.12561","title":"Anti-efficient encoding in emergent communication","created":"2019-05-29","cited_by_count":59},{"id":"1901.04587","title":"Human few-shot learning of compositional instructions","created":"2019-01-14","cited_by_count":47},{"id":"1808.10696","title":"How agents see things: On visual representations in an emergent language game","created":"2018-08-31","cited_by_count":45},{"id":"2106.08694","title":"On the proper role of linguistically-oriented deep net analysis in linguistic theorizing","created":"2021-06-16","cited_by_count":43},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41},{"id":"2110.02406","title":"Word Acquisition in Neural Language Models","created":"2021-10-05","cited_by_count":41},{"id":"1708.05763","title":"The Natural Stories Corpus","created":"2017-08-18","cited_by_count":40},{"id":"1903.06400","title":"Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages","created":"2019-03-15","cited_by_count":37},{"id":"2109.06096","title":"The Grammar-Learning Trajectories of Neural Language Models","created":"2021-09-13","cited_by_count":36},{"id":"2007.06761","title":"Can neural networks acquire a structural bias from raw linguistic data?","created":"2020-07-14","cited_by_count":35},{"id":"1802.09091","title":"Revisiting the poverty of the stimulus: hierarchical generalization without a hierarchical bias in recurrent neural networks","created":"2018-02-25","cited_by_count":33},{"id":"2106.03232","title":"A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans","created":"2021-06-06","cited_by_count":32},{"id":"1910.11424","title":"Capacity, Bandwidth, and Compositionality in Emergent Language Learning","created":"2019-10-24","cited_by_count":30},{"id":"1501.02598","title":"Combining Language and Vision with a Multimodal Skip-gram Model","created":"2015-01-12","cited_by_count":28},{"id":"1804.05922","title":"Neural Models for Reasoning over Multiple Mentions using Coreference","created":"2018-04-16","cited_by_count":27},{"id":"1909.00111","title":"Quantity doesn't buy quality syntax with neural language models","created":"2019-08-31","cited_by_count":25},{"id":"2109.10246","title":"Does Vision-and-Language Pretraining Improve Lexical Grounding?","created":"2021-09-21","cited_by_count":25},{"id":"2010.01878","title":"\"LazImpa\": Lazy and Impatient neural agents learn to communicate efficiently","created":"2020-10-05","cited_by_count":23},{"id":"1711.06301","title":"One Model for the Learning of Language","created":"2017-11-16","cited_by_count":22},{"id":"2109.03160","title":"How much pretraining data do language models need to learn syntax?","created":"2021-09-07","cited_by_count":21},{"id":"2109.12036","title":"Transformers Generalize Linearly","created":"2021-09-24","cited_by_count":19},{"id":"2104.08066","title":"Effect of Visual Extensions on Natural Language Understanding in Vision-and-Language Models","created":"2021-04-16","cited_by_count":18},{"id":"1809.04179","title":"What can linguistics and deep learning contribute to each other?","created":"2018-09-11","cited_by_count":10},{"id":"2010.04637","title":"Recurrent babbling: evaluating the acquisition of grammar from limited input data","created":"2020-10-09","cited_by_count":9}],"next_cursor":null}