{"list":"other","total":79,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"2210.11416","title":"Scaling Instruction-Finetuned Language Models","created":"2022-10-20","cited_by_count":3024},{"id":"1909.11942","title":"ALBERT: A Lite BERT for Self-supervised Learning of Language Representations","created":"2019-09-26","cited_by_count":2790},{"id":"2006.03654","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","created":"2020-06-05","cited_by_count":2181},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"2202.12837","title":"Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?","created":"2022-02-25","cited_by_count":1434},{"id":"1808.08745","title":"Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization","created":"2018-08-27","cited_by_count":1317},{"id":"2111.09543","title":"DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing","created":"2021-11-18","cited_by_count":1254},{"id":"2104.08663","title":"BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models","created":"2021-04-17","cited_by_count":1252},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"2204.07705","title":"Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks","created":"2022-04-16","cited_by_count":868},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"1910.14599","title":"Adversarial NLI: A New Benchmark for Natural Language Understanding","created":"2019-10-31","cited_by_count":807},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"1805.01070","title":"What you can cram into a single vector: Probing sentence embeddings for linguistic properties","created":"2018-05-03","cited_by_count":457},{"id":"1905.06316","title":"What do you learn from context? Probing for sentence structure in contextualized word representations","created":"2019-05-15","cited_by_count":438},{"id":"2306.04751","title":"How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources","created":"2023-06-07","cited_by_count":408},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"2401.00595","title":"State of What Art? A Call for Multi-Prompt LLM Evaluation","created":"2023-12-31","cited_by_count":310},{"id":"2003.12298","title":"Information-Theoretic Probing with Minimum Description Length","created":"2020-03-27","cited_by_count":232},{"id":"2111.02840","title":"Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models","created":"2021-11-04","cited_by_count":232},{"id":"2402.03927","title":"Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs","created":"2024-02-06","cited_by_count":229},{"id":"1608.04207","title":"Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks","created":"2016-08-15","cited_by_count":216},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"2005.04611","title":"How Context Affects Language Models' Factual Predictions","created":"2020-05-10","cited_by_count":181},{"id":"1704.03471","title":"What do Neural Machine Translation Models Learn about Morphology?","created":"2017-04-11","cited_by_count":166},{"id":"1912.13283","title":"oLMpics -- On what Language Model Pre-training Captures","created":"2019-12-31","cited_by_count":161},{"id":"2311.11045","title":"Orca 2: Teaching Small Language Models How to Reason","created":"2023-11-18","cited_by_count":159},{"id":"2312.13558","title":"The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction","created":"2023-12-21","cited_by_count":123},{"id":"1811.01157","title":"Identifying and Controlling Important Neurons in Neural Machine Translation","created":"2018-11-03","cited_by_count":111},{"id":"2004.14786","title":"Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT","created":"2020-04-30","cited_by_count":109},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109},{"id":"2011.04946","title":"When Do You Need Billions of Words of Pretraining Data?","created":"2020-11-10","cited_by_count":104},{"id":"1808.08079","title":"Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information","created":"2018-08-24","cited_by_count":97},{"id":"2211.08073","title":"GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective","created":"2022-11-15","cited_by_count":72},{"id":"2010.05345","title":"Do Language Embeddings Capture Scales?","created":"2020-10-11","cited_by_count":63},{"id":"2010.02812","title":"Intrinsic Probing through Dimension Selection","created":"2020-10-06","cited_by_count":45},{"id":"2312.00575","title":"Instruction-tuning Aligns LLMs to the Human Brain","created":"2023-12-01","cited_by_count":40},{"id":"2010.02616","title":"On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers","created":"2020-10-06","cited_by_count":39},{"id":"2211.07830","title":"Prompting Language Models for Linguistic Structure","created":"2022-11-15","cited_by_count":39},{"id":"2403.01081","title":"LAB: Large-Scale Alignment for ChatBots","created":"2024-03-02","cited_by_count":39},{"id":"2104.05882","title":"Discourse Probing of Pretrained Language Models","created":"2021-04-13","cited_by_count":38},{"id":"2203.14139","title":"Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages","created":"2022-03-26","cited_by_count":30},{"id":"2005.01810","title":"Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words","created":"2020-05-04","cited_by_count":28},{"id":"1902.01390","title":"Fine-Grained Temporal Relation Extraction","created":"2019-02-04","cited_by_count":21},{"id":"1804.02472","title":"Neural models of factuality","created":"2018-04-06","cited_by_count":20},{"id":"2305.16051","title":"What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns","created":"2023-05-25","cited_by_count":19},{"id":"2311.13171","title":"ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization","created":"2023-11-22","cited_by_count":18},{"id":"2404.03134","title":"Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?","created":"2024-04-04","cited_by_count":17},{"id":"2004.07898","title":"Bridging Anaphora Resolution as Question Answering","created":"2020-04-16","cited_by_count":14},{"id":"2104.09400","title":"Probing for Bridging Inference in Transformer Language Models","created":"2021-04-19","cited_by_count":14},{"id":"2210.07352","title":"Predicting Fine-Tuning Performance with Probing","created":"2022-10-13","cited_by_count":13},{"id":"2106.04832","title":"Probing Multilingual Language Models for Discourse","created":"2021-06-09","cited_by_count":12},{"id":"1901.11429","title":"Decomposing Generalization: Models of Generic, Habitual, and Episodic Statements","created":"2019-01-31","cited_by_count":10},{"id":"1804.07976","title":"Neural-Davidsonian Semantic Proto-role Labeling","created":"2018-04-21","cited_by_count":9},{"id":"2104.08464","title":"A multilabel approach to morphosyntactic probing","created":"2021-04-17","cited_by_count":8},{"id":"2402.01375","title":"Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization","created":"2024-02-02","cited_by_count":6},{"id":"2404.03818","title":"PRobELM: Plausibility Ranking Evaluation for Language Models","created":"2024-04-04","cited_by_count":6},{"id":"2402.05455","title":"Large Language Models for Psycholinguistic Plausibility Pretesting","created":"2024-02-08","cited_by_count":5},{"id":"2202.12801","title":"On the data requirements of probing","created":"2022-02-25","cited_by_count":4},{"id":"2309.08316","title":"How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study","created":"2023-09-15","cited_by_count":4},{"id":"1803.04790","title":"Enhanced Word Representations for Bridging Anaphora Resolution","created":"2018-03-13","cited_by_count":3}],"next_cursor":null}