{"list":"other","total":94,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"1301.3781","title":"Efficient Estimation of Word Representations in Vector Space","created":"2013-01-16","cited_by_count":4375},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"1906.04341","title":"What Does BERT Look At? An Analysis of BERT's Attention","created":"2019-06-11","cited_by_count":1003},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"1909.00512","title":"How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings","created":"2019-09-02","cited_by_count":784},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"2005.00052","title":"MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer","created":"2020-04-30","cited_by_count":445},{"id":"1903.08855","title":"Linguistic Knowledge and Transferability of Contextual Representations","created":"2019-03-21","cited_by_count":383},{"id":"2309.01029","title":"Explainability for Large Language Models: A Survey","created":"2023-09-02","cited_by_count":333},{"id":"1812.08951","title":"Analysis Methods in Neural Language Processing: A Survey","created":"2018-12-21","cited_by_count":277},{"id":"1906.02715","title":"Visualizing and Measuring the Geometry of BERT","created":"2019-06-06","cited_by_count":216},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177},{"id":"1912.13283","title":"oLMpics -- On what Language Model Pre-training Captures","created":"2019-12-31","cited_by_count":161},{"id":"2010.05731","title":"Probing Pretrained Language Models for Lexical Semantics","created":"2020-10-12","cited_by_count":156},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156},{"id":"2004.11207","title":"Self-Attention Attribution: Interpreting Information Interactions Inside Transformer","created":"2020-04-23","cited_by_count":125},{"id":"1906.01698","title":"Open Sesame: Getting Inside BERT's Linguistic Knowledge","created":"2019-06-04","cited_by_count":120},{"id":"2005.04511","title":"Finding Universal Grammatical Relations in Multilingual BERT","created":"2020-05-09","cited_by_count":110},{"id":"2004.14786","title":"Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT","created":"2020-04-30","cited_by_count":109},{"id":"2011.04946","title":"When Do You Need Billions of Words of Pretraining Data?","created":"2020-11-10","cited_by_count":104},{"id":"2010.02695","title":"Analyzing Individual Neurons in Pre-trained Language Models","created":"2020-10-06","cited_by_count":97},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92},{"id":"1911.12246","title":"Do Attention Heads in BERT Track Syntactic Dependencies?","created":"2019-11-27","cited_by_count":88},{"id":"2104.07885","title":"Probing Across Time: What Does RoBERTa Know and When?","created":"2021-04-16","cited_by_count":73},{"id":"2101.00010","title":"UnNatural Language Inference","created":"2020-12-30","cited_by_count":69},{"id":"1909.07521","title":"Probing Natural Language Inference Models through Semantic Fragments","created":"2019-09-16","cited_by_count":64},{"id":"2109.09234","title":"Conditional probing: measuring usable information beyond a baseline","created":"2021-09-19","cited_by_count":62},{"id":"2109.07020","title":"Frequency Effects on Syntactic Rule Learning in Transformers","created":"2021-09-14","cited_by_count":59},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59},{"id":"2005.11787","title":"Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers","created":"2020-05-24","cited_by_count":57},{"id":"2010.02180","title":"Pareto Probing: Trading Off Accuracy for Complexity","created":"2020-10-05","cited_by_count":55},{"id":"2403.08946","title":"Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era","created":"2024-03-13","cited_by_count":46},{"id":"2212.01488","title":"Event knowledge in large language models: the gap between the impossible and the unlikely","created":"2022-12-02","cited_by_count":45},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41},{"id":"2104.09635","title":"Refining Targeted Syntactic Evaluation of Language Models","created":"2021-04-19","cited_by_count":41},{"id":"2005.01641","title":"A Tale of a Probe and a Parser","created":"2020-05-04","cited_by_count":40},{"id":"2105.07109","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","created":"2021-05-15","cited_by_count":40},{"id":"2104.14694","title":"Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses","created":"2021-04-29","cited_by_count":39},{"id":"2105.14002","title":"What if This Modified That? Syntactic Interventions via Counterfactual Embeddings","created":"2021-05-28","cited_by_count":39},{"id":"2104.05882","title":"Discourse Probing of Pretrained Language Models","created":"2021-04-13","cited_by_count":38},{"id":"2206.13289","title":"Analyzing Encoded Concepts in Transformer Language Models","created":"2022-06-27","cited_by_count":38},{"id":"2004.14513","title":"Asking without Telling: Exploring Latent Ontologies in Contextual Representations","created":"2020-04-29","cited_by_count":34},{"id":"2008.06788","title":"Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation","created":"2020-08-15","cited_by_count":34},{"id":"1905.06401","title":"Correlating neural and symbolic representations of language","created":"2019-05-14","cited_by_count":33},{"id":"2105.10185","title":"A Non-Linear Structural Probe","created":"2021-05-21","cited_by_count":31},{"id":"2004.14096","title":"Do Neural Language Models Show Preferences for Syntactic Formalisms?","created":"2020-04-29","cited_by_count":30},{"id":"2203.14139","title":"Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages","created":"2022-03-26","cited_by_count":30},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29},{"id":"2005.01810","title":"Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words","created":"2020-05-04","cited_by_count":28},{"id":"2106.02559","title":"Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing","created":"2021-06-04","cited_by_count":28},{"id":"2011.02070","title":"Probing Multilingual BERT for Genetic and Typological Signals","created":"2020-11-04","cited_by_count":27},{"id":"2404.18923","title":"Holmes: A Benchmark to Assess the Linguistic Competence of Language Models","created":"2024-04-29","cited_by_count":26},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25},{"id":"2105.07452","title":"How is BERT surprised? Layerwise detection of linguistic anomalies","created":"2021-05-16","cited_by_count":24},{"id":"2203.06204","title":"When classifying grammatical role, BERT doesn't care about word order... except when it matters","created":"2022-03-11","cited_by_count":24},{"id":"2010.01869","title":"Linguistic Profiling of a Neural Language Model","created":"2020-10-05","cited_by_count":23},{"id":"1906.01958","title":"From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions","created":"2019-06-05","cited_by_count":22},{"id":"2102.10934","title":"Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks","created":"2021-02-22","cited_by_count":22},{"id":"2012.15228","title":"Introducing Orthogonal Constraint in Structural Probes","created":"2020-12-30","cited_by_count":21},{"id":"2206.03529","title":"How to Dissect a Muppet: The Structure of Transformer Embedding Spaces","created":"2022-06-07","cited_by_count":20},{"id":"2205.07043","title":"Naturalistic Causal Probing for Morpho-Syntax","created":"2022-05-14","cited_by_count":19},{"id":"2004.12198","title":"Quantifying the Contextualization of Word Representations with Semantic Class Probing","created":"2020-04-25","cited_by_count":18},{"id":"2010.04887","title":"Discourse structure interacts with reference but not syntax in neural language models","created":"2020-10-10","cited_by_count":17},{"id":"2105.12449","title":"LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyond","created":"2021-05-26","cited_by_count":17},{"id":"2109.05958","title":"Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations","created":"2021-09-13","cited_by_count":16},{"id":"2203.10415","title":"How does the pre-training objective affect what large language models learn about linguistic properties?","created":"2022-03-20","cited_by_count":16},{"id":"2101.09115","title":"The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT","created":"2021-01-22","cited_by_count":15},{"id":"2104.07578","title":"Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models","created":"2021-04-15","cited_by_count":14},{"id":"2210.14328","title":"Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models","created":"2022-10-25","cited_by_count":14},{"id":"2004.14999","title":"A Matter of Framing: The Impact of Linguistic Formalism on Probing Results","created":"2020-04-30","cited_by_count":12},{"id":"2204.09722","title":"When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes","created":"2022-04-20","cited_by_count":12},{"id":"2004.14620","title":"Universal Dependencies according to BERT: both more specific and more general","created":"2020-04-30","cited_by_count":11},{"id":"1909.00303","title":"Higher-order Comparisons of Sentence Encoder Representations","created":"2019-09-01","cited_by_count":10},{"id":"2109.14017","title":"Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations","created":"2021-09-28","cited_by_count":10},{"id":"2105.02629","title":"Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach","created":"2021-05-06","cited_by_count":9},{"id":"2104.08464","title":"A multilabel approach to morphosyntactic probing","created":"2021-04-17","cited_by_count":8},{"id":"2306.06205","title":"Morphosyntactic probing of multilingual BERT models","created":"2023-06-09","cited_by_count":8},{"id":"2010.00153","title":"Examining the rhetorical capacities of neural language models","created":"2020-10-01","cited_by_count":7},{"id":"2010.12784","title":"Deep Clustering of Text Representations for Supervision-free Probing of Syntax","created":"2020-10-24","cited_by_count":7},{"id":"2103.01819","title":"The Rediscovery Hypothesis: Language Models Need to Meet Linguistics","created":"2021-03-02","cited_by_count":7},{"id":"2302.07232","title":"A Psycholinguistic Analysis of BERT's Representations of Compounds","created":"2023-02-14","cited_by_count":7},{"id":"2008.11608","title":"Analysis and Evaluation of Language Models for Word Sense Disambiguation","created":"2020-08-26","cited_by_count":6},{"id":"2102.07926","title":"Have Attention Heads in BERT Learned Constituency Grammar?","created":"2021-02-16","cited_by_count":5},{"id":"2104.12847","title":"Morph Call: Probing Morphosyntactic Content of Multilingual Transformers","created":"2021-04-26","cited_by_count":5},{"id":"2201.08214","title":"A Latent-Variable Model for Intrinsic Probing","created":"2022-01-20","cited_by_count":5},{"id":"2211.06420","title":"The Architectural Bottleneck Principle","created":"2022-11-11","cited_by_count":5},{"id":"2103.00573","title":"RuSentEval: Linguistic Source, Encoder Force!","created":"2021-02-28","cited_by_count":4},{"id":"2010.07711","title":"Does Chinese BERT Encode Word Structure?","created":"2020-10-15","cited_by_count":2}],"next_cursor":null}