{"list":"other","total":86,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"1301.3781","title":"Efficient Estimation of Word Representations in Vector Space","created":"2013-01-16","cited_by_count":4375},{"id":"2212.04356","title":"Robust Speech Recognition via Large-Scale Weak Supervision","created":"2022-12-06","cited_by_count":4057},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"1508.07909","title":"Neural Machine Translation of Rare Words with Subword Units","created":"2015-08-31","cited_by_count":2918},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1808.06226","title":"SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing","created":"2018-08-19","cited_by_count":1989},{"id":"2211.05100","title":"BLOOM: A 176B-Parameter Open-Access Multilingual Language Model","created":"2022-11-09","cited_by_count":1984},{"id":"2010.11934","title":"mT5: A massively multilingual pre-trained text-to-text transformer","created":"2020-10-22","cited_by_count":1818},{"id":"1609.08144","title":"Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation","created":"2016-09-26","cited_by_count":1475},{"id":"1903.10676","title":"SciBERT: A Pretrained Language Model for Scientific Text","created":"2019-03-26","cited_by_count":1414},{"id":"2012.14913","title":"Transformer Feed-Forward Layers Are Key-Value Memories","created":"2020-12-29","cited_by_count":1336},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"1906.04341","title":"What Does BERT Look At? An Analysis of BERT's Attention","created":"2019-06-11","cited_by_count":1003},{"id":"2302.04023","title":"A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity","created":"2023-02-08","cited_by_count":894},{"id":"2005.00928","title":"Quantifying Attention Flow in Transformers","created":"2020-05-02","cited_by_count":775},{"id":"2105.01051","title":"SUPERB: Speech processing Universal PERformance Benchmark","created":"2021-05-03","cited_by_count":666},{"id":"2012.09838","title":"Transformer Interpretability Beyond Attention Visualization","created":"2020-12-17","cited_by_count":627},{"id":"2102.07350","title":"Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm","created":"2021-02-15","cited_by_count":606},{"id":"2106.02997","title":"Causal Abstractions of Neural Networks","created":"2021-06-06","cited_by_count":422},{"id":"1808.09121","title":"WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations","created":"2018-08-28","cited_by_count":372},{"id":"2302.09210","title":"How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation","created":"2023-02-18","cited_by_count":348},{"id":"2010.09885","title":"ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction","created":"2020-10-19","cited_by_count":337},{"id":"2303.12528","title":"MEGA: Multilingual Evaluation of Generative AI","created":"2023-03-22","cited_by_count":293},{"id":"1812.08951","title":"Analysis Methods in Neural Language Processing: A Survey","created":"2018-12-21","cited_by_count":277},{"id":"1711.08412","title":"Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes","created":"2017-11-22","cited_by_count":253},{"id":"2303.01037","title":"Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages","created":"2023-03-02","cited_by_count":231},{"id":"1605.09096","title":"Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change","created":"2016-05-30","cited_by_count":221},{"id":"2304.05613","title":"ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning","created":"2023-04-12","cited_by_count":206},{"id":"2304.05969","title":"Localizing Model Behavior with Path Patching","created":"2023-04-12","cited_by_count":195},{"id":"1408.3456","title":"SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimation","created":"2014-08-15","cited_by_count":172},{"id":"2212.10789","title":"Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing","created":"2022-12-21","cited_by_count":166},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156},{"id":"2112.10508","title":"Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP","created":"2021-12-20","cited_by_count":132},{"id":"2209.05481","title":"A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language","created":"2022-09-12","cited_by_count":131},{"id":"2209.11326","title":"Towards Faithful Model Explanation in NLP: A Survey","created":"2022-09-22","cited_by_count":130},{"id":"2209.01712","title":"ChemBERTa-2: Towards Chemical Foundation Models","created":"2022-09-05","cited_by_count":127},{"id":"1908.04211","title":"On Identifiability in Transformers","created":"2019-08-12","cited_by_count":116},{"id":"2007.11464","title":"SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection","created":"2020-07-22","cited_by_count":108},{"id":"2011.13230","title":"Molecular representation learning with language models and domain-relevant auxiliary tasks","created":"2020-11-26","cited_by_count":94},{"id":"2012.00893","title":"Evaluating Explanations: How much do explanations from the teacher aid students?","created":"2020-12-01","cited_by_count":94},{"id":"2301.12586","title":"Unifying Molecular and Textual Representations via Multi-task Language Modelling","created":"2023-01-29","cited_by_count":93},{"id":"1806.03537","title":"Diachronic word embeddings and semantic shifts: a survey","created":"2018-06-09","cited_by_count":92},{"id":"2004.14118","title":"Analysing Lexical Semantic Change with Contextualised Word Representations","created":"2020-04-29","cited_by_count":92},{"id":"2012.06051","title":"Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks","created":"2020-12-09","cited_by_count":70},{"id":"1502.04585","title":"The Ladder: A Reliable Leaderboard for Machine Learning Competitions","created":"2015-02-16","cited_by_count":69},{"id":"2203.04212","title":"Measuring the Mixing of Contextual Information in the Transformer","created":"2022-03-08","cited_by_count":65},{"id":"2302.04611","title":"A Text-guided Protein Design Framework","created":"2023-02-09","cited_by_count":64},{"id":"1811.06278","title":"Survey of Computational Approaches to Lexical Semantic Change","created":"2018-11-15","cited_by_count":62},{"id":"2106.00840","title":"Comparing Test Sets with Item Response Theory","created":"2021-06-01","cited_by_count":57},{"id":"1405.3515","title":"Temporal Analysis of Language through Neural Language Models","created":"2014-05-14","cited_by_count":54},{"id":"2109.07152","title":"Incorporating Residual and Normalization Layers into Analysis of Masked Language Models","created":"2021-09-15","cited_by_count":51},{"id":"2303.02913","title":"OpenICL: An Open-Source Framework for In-context Learning","created":"2023-03-06","cited_by_count":51},{"id":"2110.06366","title":"Time Masking for Temporal Language Models","created":"2021-10-12","cited_by_count":46},{"id":"2010.09435","title":"An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storage","created":"2020-10-14","cited_by_count":45},{"id":"2205.11631","title":"Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer","created":"2022-05-23","cited_by_count":45},{"id":"2205.03286","title":"GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers","created":"2022-05-06","cited_by_count":44},{"id":"2303.03363","title":"Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Language","created":"2023-03-06","cited_by_count":44},{"id":"1908.11421","title":"Learning Latent Parameters without Human Response Patterns: Item Response Theory with Artificial Crowds","created":"2019-08-29","cited_by_count":40},{"id":"1703.00607","title":"Dynamic Word Embeddings for Evolving Semantic Discovery","created":"2017-03-02","cited_by_count":38},{"id":"1804.06517","title":"Diachronic Usage Relatedness (DURel): A Framework for the Annotation of Lexical Semantic Change","created":"2018-04-18","cited_by_count":35},{"id":"2110.15486","title":"DOCKSTRING: easy molecular docking yields better benchmarks for ligand design","created":"2021-10-29","cited_by_count":35},{"id":"2103.07259","title":"Explaining and Improving BERT Performance on Lexical Semantic Change Detection","created":"2021-03-12","cited_by_count":34},{"id":"1906.01688","title":"Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Change","created":"2019-06-04","cited_by_count":33},{"id":"2211.13322","title":"Group SELFIES: A Robust Fragment-Based Molecular String Representation","created":"2022-11-23","cited_by_count":33},{"id":"2002.00276","title":"Variational Item Response Theory: Fast, Accurate, and Expressive","created":"2020-02-01","cited_by_count":29},{"id":"1906.02376","title":"Training Temporal Word Embeddings with a Compass","created":"2019-06-05","cited_by_count":23},{"id":"2205.02007","title":"A Computational Inflection for Scientific Discovery","created":"2022-05-04","cited_by_count":23},{"id":"2011.00080","title":"Dynamic Data Selection for Curriculum Learning via Ability Estimation","created":"2020-10-30","cited_by_count":21},{"id":"2211.03495","title":"How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers","created":"2022-11-07","cited_by_count":21},{"id":"2203.01282","title":"py-irt: A Scalable Item Response Theory Library for Python","created":"2022-03-02","cited_by_count":19},{"id":"1907.08922","title":"Using Word Embeddings to Examine Gender Bias in Dutch Newspapers, 1950-1990","created":"2019-07-21","cited_by_count":11},{"id":"2205.06691","title":"LSCDiscovery: A shared task on semantic change discovery and detection in Spanish","created":"2022-05-13","cited_by_count":11},{"id":"1906.01440","title":"Tracing Antisemitic Language Through Diachronic Embedding Projections: France 1789-1914","created":"2019-06-04","cited_by_count":9},{"id":"2106.06849","title":"Can Transformer Language Models Predict Psychometric Properties?","created":"2021-06-12","cited_by_count":8},{"id":"2205.07750","title":"What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris","created":"2022-05-16","cited_by_count":8},{"id":"2201.05123","title":"NorDiaChange: Diachronic Semantic Change Dataset for Norwegian","created":"2022-01-13","cited_by_count":7},{"id":"1811.08186","title":"Analysing Results from AI Benchmarks: Key Indicators and How to Obtain Them","created":"2018-11-20","cited_by_count":6},{"id":"2105.08039","title":"Fine-grained Interpretation and Causation Analysis in Deep NLP Models","created":"2021-05-17","cited_by_count":4},{"id":"1909.12136","title":"Semantic Change and Emerging Tropes In a Large Corpus of New High German Poetry","created":"2019-09-26","cited_by_count":3}],"next_cursor":null}