{"list":"other","total":223,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"1802.05365","title":"Deep contextualized word representations","created":"2018-02-15","cited_by_count":2290},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2005.04118","title":"Beyond Accuracy: Behavioral Testing of NLP models with CheckList","created":"2020-05-08","cited_by_count":1006},{"id":"1906.04341","title":"What Does BERT Look At? An Analysis of BERT's Attention","created":"2019-06-11","cited_by_count":1003},{"id":"2308.10248","title":"Steering Language Models With Activation Engineering","created":"2023-08-20","cited_by_count":922},{"id":"1902.01007","title":"Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference","created":"2019-02-04","cited_by_count":876},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"2004.09095","title":"The State and Fate of Linguistic Diversity and Inclusion in the NLP World","created":"2020-04-20","cited_by_count":798},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"1906.01502","title":"How multilingual is Multilingual BERT?","created":"2019-06-04","cited_by_count":645},{"id":"1910.11856","title":"On the Cross-lingual Transferability of Monolingual Representations","created":"2019-10-25","cited_by_count":578},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"1905.06316","title":"What do you learn from context? Probing for sentence structure in contextualized word representations","created":"2019-05-15","cited_by_count":438},{"id":"2403.19647","title":"Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models","created":"2024-03-28","cited_by_count":435},{"id":"2404.14082","title":"Mechanistic Interpretability for AI Safety -- A Review","created":"2024-04-22","cited_by_count":422},{"id":"1903.08855","title":"Linguistic Knowledge and Transferability of Contextual Representations","created":"2019-03-21","cited_by_count":383},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334},{"id":"1907.13528","title":"What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models","created":"2019-07-31","cited_by_count":320},{"id":"2502.02013","title":"Layer by Layer: Uncovering Hidden Representations in Language Models","created":"2025-02-04","cited_by_count":311},{"id":"1904.09077","title":"Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT","created":"2019-04-19","cited_by_count":301},{"id":"1906.04284","title":"Analyzing the Structure of Attention in a Transformer Language Model","created":"2019-06-07","cited_by_count":243},{"id":"1906.02715","title":"Visualizing and Measuring the Geometry of BERT","created":"2019-06-06","cited_by_count":216},{"id":"1803.11138","title":"Colorless green recurrent networks dream hierarchically","created":"2018-03-29","cited_by_count":213},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"2005.09093","title":"Are All Languages Created Equal in Multilingual BERT?","created":"2020-05-18","cited_by_count":207},{"id":"1901.05287","title":"Assessing BERT's Syntactic Abilities","created":"2019-01-16","cited_by_count":192},{"id":"1912.07840","title":"Cross-Lingual Ability of Multilingual BERT: An Empirical Study","created":"2019-12-17","cited_by_count":182},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177},{"id":"2005.03692","title":"A Systematic Assessment of Syntactic Generalization in Neural Language Models","created":"2020-05-07","cited_by_count":165},{"id":"2406.19384","title":"The Remarkable Robustness of LLMs: Stages of Inference?","created":"2024-06-27","cited_by_count":146},{"id":"2106.06087","title":"Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models","created":"2021-06-10","cited_by_count":131},{"id":"2005.00628","title":"Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?","created":"2020-05-01","cited_by_count":127},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124},{"id":"1906.01698","title":"Open Sesame: Getting Inside BERT's Linguistic Knowledge","created":"2019-06-04","cited_by_count":120},{"id":"2202.08005","title":"Should You Mask 15% in Masked Language Modeling?","created":"2022-02-16","cited_by_count":118},{"id":"2002.03518","title":"Multilingual Alignment of Contextual Word Representations","created":"2020-02-10","cited_by_count":114},{"id":"2005.04511","title":"Finding Universal Grammatical Relations in Multilingual BERT","created":"2020-05-09","cited_by_count":110},{"id":"2004.14786","title":"Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT","created":"2020-04-30","cited_by_count":109},{"id":"2103.15949","title":"Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors","created":"2021-03-29","cited_by_count":108},{"id":"2011.04946","title":"When Do You Need Billions of Words of Pretraining Data?","created":"2020-11-10","cited_by_count":104},{"id":"2004.10827","title":"Syntactic Structure from Deep Learning","created":"2020-04-22","cited_by_count":99},{"id":"2010.02695","title":"Analyzing Individual Neurons in Pre-trained Language Models","created":"2020-10-06","cited_by_count":97},{"id":"2403.00824","title":"Information Flow Routes: Automatically Interpreting Language Models at Scale","created":"2024-02-27","cited_by_count":95},{"id":"2202.10419","title":"Interpreting Language Models with Contrastive Explanations","created":"2022-02-21","cited_by_count":92},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92},{"id":"1911.12246","title":"Do Attention Heads in BERT Track Syntactic Dependencies?","created":"2019-11-27","cited_by_count":88},{"id":"2004.11999","title":"Syntactic Data Augmentation Increases Robustness to Inference Heuristics","created":"2020-04-24","cited_by_count":86},{"id":"2012.15180","title":"Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks?","created":"2020-12-30","cited_by_count":73},{"id":"2104.07885","title":"Probing Across Time: What Does RoBERTa Know and When?","created":"2021-04-16","cited_by_count":73},{"id":"2504.02768","title":"MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs","created":"2025-04-03","cited_by_count":71},{"id":"2101.00010","title":"UnNatural Language Inference","created":"2020-12-30","cited_by_count":69},{"id":"2403.19827","title":"Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs","created":"2024-03-28","cited_by_count":65},{"id":"2109.07020","title":"Frequency Effects on Syntactic Rule Learning in Transformers","created":"2021-09-14","cited_by_count":59},{"id":"2501.06346","title":"Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages","created":"2025-01-10","cited_by_count":59},{"id":"1909.02597","title":"Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs","created":"2019-09-05","cited_by_count":58},{"id":"2203.13112","title":"minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models","created":"2022-03-24","cited_by_count":58},{"id":"2005.00187","title":"Cross-Linguistic Syntactic Evaluation of Word Prediction Models","created":"2020-05-01","cited_by_count":55},{"id":"2010.02180","title":"Pareto Probing: Trading Off Accuracy for Complexity","created":"2020-10-05","cited_by_count":55},{"id":"2404.02418","title":"Auxiliary task demands mask the capabilities of smaller language models","created":"2024-04-03","cited_by_count":54},{"id":"2305.18741","title":"Grokking of Hierarchical Structure in Vanilla Transformers","created":"2023-05-30","cited_by_count":53},{"id":"2106.01229","title":"Lower Perplexity is Not Always Human-Like","created":"2021-06-02","cited_by_count":52},{"id":"2103.04350","title":"Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees","created":"2021-03-07","cited_by_count":51},{"id":"2104.03869","title":"Probing BERT in Hyperbolic Spaces","created":"2021-04-08","cited_by_count":50},{"id":"2402.01676","title":"Language models align with human judgments on key grammatical constructions","created":"2024-01-19","cited_by_count":49},{"id":"2008.09084","title":"Do Syntax Trees Help Pre-trained Transformers Extract Information?","created":"2020-08-20","cited_by_count":48},{"id":"2002.00737","title":"Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction","created":"2020-01-30","cited_by_count":47},{"id":"1909.06775","title":"Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing","created":"2019-09-15","cited_by_count":46},{"id":"2101.11131","title":"CLiMP: A Benchmark for Chinese Language Model Evaluation","created":"2021-01-26","cited_by_count":46},{"id":"2402.12560","title":"CausalGym: Benchmarking causal interpretability methods on linguistic tasks","created":"2024-02-19","cited_by_count":46},{"id":"1906.06448","title":"Can neural networks understand monotonicity reasoning?","created":"2019-06-15","cited_by_count":45},{"id":"2010.02812","title":"Intrinsic Probing through Dimension Selection","created":"2020-10-06","cited_by_count":45},{"id":"2309.10312","title":"Rigorously Assessing Natural Language Explanations of Neurons","created":"2023-09-19","cited_by_count":45},{"id":"2101.03453","title":"BERT & Family Eat Word Salad: Experiments with Text Understanding","created":"2021-01-10","cited_by_count":44},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44},{"id":"1803.03585","title":"The Importance of Being Recurrent for Modeling Hierarchical Structure","created":"2018-03-09","cited_by_count":42},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41},{"id":"2104.09635","title":"Refining Targeted Syntactic Evaluation of Language Models","created":"2021-04-19","cited_by_count":41},{"id":"2203.00633","title":"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale","created":"2022-03-01","cited_by_count":41},{"id":"2005.01641","title":"A Tale of a Probe and a Parser","created":"2020-05-04","cited_by_count":40},{"id":"2105.07109","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","created":"2021-05-15","cited_by_count":40},{"id":"2106.01044","title":"Examining the Inductive Bias of Neural Language Models with Artificial Languages","created":"2021-06-02","cited_by_count":40},{"id":"2105.14002","title":"What if This Modified That? Syntactic Interventions via Counterfactual Embeddings","created":"2021-05-28","cited_by_count":39},{"id":"2211.07830","title":"Prompting Language Models for Linguistic Structure","created":"2022-11-15","cited_by_count":39},{"id":"2206.13289","title":"Analyzing Encoded Concepts in Transformer Language Models","created":"2022-06-27","cited_by_count":38},{"id":"2502.19249","title":"Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases","created":"2025-02-26","cited_by_count":37},{"id":"2109.06096","title":"The Grammar-Learning Trajectories of Neural Language Models","created":"2021-09-13","cited_by_count":36},{"id":"2007.06761","title":"Can neural networks acquire a structural bias from raw linguistic data?","created":"2020-07-14","cited_by_count":35},{"id":"2210.13181","title":"The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative","created":"2022-10-24","cited_by_count":35},{"id":"2304.13060","title":"Injecting structural hints: Using language models to study inductive biases in language learning","created":"2023-04-25","cited_by_count":35},{"id":"2405.15750","title":"Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence","created":"2024-05-24","cited_by_count":35},{"id":"2004.14513","title":"Asking without Telling: Exploring Latent Ontologies in Contextual Representations","created":"2020-04-29","cited_by_count":34},{"id":"2008.06788","title":"Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation","created":"2020-08-15","cited_by_count":34},{"id":"1905.06401","title":"Correlating neural and symbolic representations of language","created":"2019-05-14","cited_by_count":33}],"next_cursor":"100"}