{"total":391,"rows":[{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691,"area":null},{"id":"2211.05100","title":"BLOOM: A 176B-Parameter Open-Access Multilingual Language Model","created":"2022-11-09","cited_by_count":1984,"area":null},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876,"area":null},{"id":"2108.08810","title":"Do Vision Transformers See Like Convolutional Neural Networks?","created":"2021-08-19","cited_by_count":675,"area":null},{"id":"2110.11309","title":"Fast Model Editing at Scale","created":"2021-10-21","cited_by_count":498,"area":null},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431,"area":null},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334,"area":null},{"id":"2106.07139","title":"Pre-Trained Models: Past, Present and Future","created":"2021-06-14","cited_by_count":319,"area":null},{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270,"area":null},{"id":"2308.09124","title":"Linearity of Relation Decoding in Transformer Language Models","created":"2023-08-17","cited_by_count":200,"area":null},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177,"area":null},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156,"area":null},{"id":"2304.00740","title":"Inspecting and Editing Knowledge Representations in Language Models","created":"2023-04-03","cited_by_count":141,"area":null},{"id":"2209.11326","title":"Towards Faithful Model Explanation in NLP: A Survey","created":"2022-09-22","cited_by_count":130,"area":null},{"id":"2207.13243","title":"Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks","created":"2022-07-27","cited_by_count":129,"area":null},{"id":"2401.14446","title":"Black-Box Access is Insufficient for Rigorous AI Audits","created":"2024-01-25","cited_by_count":126,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2305.08809","title":"Interpretability at Scale: Identifying Causal Mechanisms in Alpaca","created":"2023-05-15","cited_by_count":103,"area":null},{"id":"2311.02262","title":"Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs","created":"2023-11-03","cited_by_count":91,"area":null},{"id":"2303.09435","title":"Jump to Conclusions: Short-Cutting Transformers With Linear Transformations","created":"2023-03-16","cited_by_count":90,"area":null},{"id":"2108.13138","title":"Neuron-level Interpretation of Deep NLP Models: A Survey","created":"2021-08-30","cited_by_count":81,"area":null},{"id":"2101.11109","title":"First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT","created":"2021-01-26","cited_by_count":65,"area":null},{"id":"2202.12938","title":"Assessing the State of Self-Supervised Human Activity Recognition using Wearables","created":"2022-02-22","cited_by_count":65,"area":null},{"id":"2104.03514","title":"Low-Complexity Probing via Finding Subnetworks","created":"2021-04-08","cited_by_count":64,"area":null},{"id":"2107.05677","title":"Codified audio language modeling learns useful representations for music information retrieval","created":"2021-07-12","cited_by_count":64,"area":null},{"id":"2402.16061","title":"How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study","created":"2024-02-25","cited_by_count":64,"area":null},{"id":"2110.07483","title":"On the Pitfalls of Analyzing Individual Neurons in Language Models","created":"2021-10-14","cited_by_count":62,"area":null},{"id":"2305.09863","title":"Explaining black box text modules in natural language with language models","created":"2023-05-17","cited_by_count":62,"area":null},{"id":"2105.06965","title":"Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction","created":"2021-05-14","cited_by_count":59,"area":null},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59,"area":null},{"id":"2203.13112","title":"minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models","created":"2022-03-24","cited_by_count":58,"area":null},{"id":"2405.15471","title":"Emergence of a High-Dimensional Abstraction Phase in Language Transformers","created":"2024-05-24","cited_by_count":56,"area":null},{"id":"2104.10809","title":"Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?","created":"2021-04-22","cited_by_count":55,"area":null},{"id":"2205.14140","title":"CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior","created":"2022-05-27","cited_by_count":55,"area":null},{"id":"2310.11877","title":"The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models","created":"2023-10-18","cited_by_count":55,"area":null},{"id":"2101.00387","title":"What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure","created":"2021-01-02","cited_by_count":52,"area":null},{"id":"2202.06840","title":"What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code","created":"2022-02-14","cited_by_count":50,"area":null},{"id":"2109.04825","title":"Artificial Text Detection via Examining the Topology of Attention Maps","created":"2021-09-10","cited_by_count":49,"area":null},{"id":"2303.08117","title":"Do Transformers Parse while Predicting the Masked Word?","created":"2023-03-14","cited_by_count":48,"area":null},{"id":"2410.05864","title":"From Tokens to Words: On the Inner Lexicon of LLMs","created":"2024-10-08","cited_by_count":48,"area":null},{"id":"2109.06304","title":"Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration","created":"2021-09-13","cited_by_count":44,"area":null},{"id":"2310.00603","title":"Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals","created":"2023-10-01","cited_by_count":44,"area":null},{"id":"2106.08694","title":"On the proper role of linguistically-oriented deep net analysis in linguistic theorizing","created":"2021-06-16","cited_by_count":43,"area":null},{"id":"2304.06248","title":"LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model","created":"2023-04-13","cited_by_count":43,"area":null},{"id":"2106.14282","title":"A Closer Look at How Fine-tuning Changes BERT","created":"2021-06-27","cited_by_count":42,"area":null},{"id":"2310.16410","title":"Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero","created":"2023-10-25","cited_by_count":42,"area":null},{"id":"2203.00633","title":"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale","created":"2022-03-01","cited_by_count":41,"area":null},{"id":"2207.04153","title":"Probing Classifiers are Unreliable for Concept Removal and Detection","created":"2022-07-08","cited_by_count":41,"area":null},{"id":"2105.07109","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","created":"2021-05-15","cited_by_count":40,"area":null},{"id":"2104.14694","title":"Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses","created":"2021-04-29","cited_by_count":39,"area":null},{"id":"2105.14002","title":"What if This Modified That? Syntactic Interventions via Counterfactual Embeddings","created":"2021-05-28","cited_by_count":39,"area":null},{"id":"2206.13289","title":"Analyzing Encoded Concepts in Transformer Language Models","created":"2022-06-27","cited_by_count":38,"area":null},{"id":"2209.11799","title":"Augmenting Interpretable Models with LLMs during Training","created":"2022-09-23","cited_by_count":38,"area":null},{"id":"2104.05824","title":"Evaluating Saliency Methods for Neural Language Models","created":"2021-04-12","cited_by_count":37,"area":null},{"id":"2212.08094","title":"Joint processing of linguistic properties in brains and language models","created":"2022-12-15","cited_by_count":37,"area":null},{"id":"2108.11308","title":"What do pre-trained code models know about code?","created":"2021-08-25","cited_by_count":36,"area":null},{"id":"2210.13181","title":"The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative","created":"2022-10-24","cited_by_count":35,"area":null},{"id":"2105.15179","title":"How transfer learning impacts linguistic knowledge in deep NLP models?","created":"2021-05-31","cited_by_count":32,"area":null},{"id":"2103.11072","title":"Local Interpretations for Explainable Natural Language Processing: A Survey","created":"2021-03-20","cited_by_count":31,"area":null},{"id":"2401.08495","title":"Large Language Models Portray Socially Subordinate Groups as More Homogeneous, Consistent with a Bias Observed in Humans","created":"2024-01-16","cited_by_count":31,"area":null},{"id":"2203.14139","title":"Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages","created":"2022-03-26","cited_by_count":30,"area":null},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29,"area":null},{"id":"2205.00305","title":"AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks","created":"2022-04-30","cited_by_count":29,"area":null},{"id":"2209.14279","title":"Causal Proxy Models for Concept-Based Model Explanations","created":"2022-09-28","cited_by_count":29,"area":null},{"id":"2402.09236","title":"Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Models","created":"2024-02-14","cited_by_count":29,"area":null},{"id":"2106.02559","title":"Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing","created":"2021-06-04","cited_by_count":28,"area":null},{"id":"2202.07359","title":"textless-lib: a Library for Textless Spoken Language Processing","created":"2022-02-15","cited_by_count":28,"area":null},{"id":"2203.10326","title":"Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models","created":"2022-03-19","cited_by_count":28,"area":null},{"id":"2205.15301","title":"Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation","created":"2022-05-30","cited_by_count":28,"area":null},{"id":"2202.08975","title":"Probing Pretrained Models of Source Code","created":"2022-02-16","cited_by_count":26,"area":null},{"id":"2404.18923","title":"Holmes: A Benchmark to Assess the Linguistic Competence of Language Models","created":"2024-04-29","cited_by_count":26,"area":null},{"id":"2104.05904","title":"DirectProbe: Studying Representations without Classifiers","created":"2021-04-13","cited_by_count":25,"area":null},{"id":"2110.04399","title":"Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors","created":"2021-10-08","cited_by_count":25,"area":null},{"id":"2101.06013","title":"Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge","created":"2021-01-15","cited_by_count":24,"area":null},{"id":"2310.16484","title":"Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training","created":"2023-10-25","cited_by_count":23,"area":null},{"id":"2403.16865","title":"Encoding of lexical tone in self-supervised models of spoken language","created":"2024-03-25","cited_by_count":23,"area":null},{"id":"2103.03872","title":"Rissanen Data Analysis: Examining Dataset Characteristics via Description Length","created":"2021-03-05","cited_by_count":22,"area":null},{"id":"2104.05115","title":"Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models","created":"2021-04-11","cited_by_count":22,"area":null},{"id":"2109.03160","title":"How much pretraining data do language models need to learn syntax?","created":"2021-09-07","cited_by_count":21,"area":null},{"id":"2206.13288","title":"Discovering Salient Neurons in Deep NLP Models","created":"2022-06-27","cited_by_count":21,"area":null},{"id":"2211.11109","title":"Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairness","created":"2022-11-20","cited_by_count":21,"area":null},{"id":"2102.11115","title":"Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Case","created":"2021-02-22","cited_by_count":20,"area":null},{"id":"2104.04515","title":"Connecting Attributions and QA Model Behavior on Realistic Counterfactuals","created":"2021-04-09","cited_by_count":20,"area":null},{"id":"2203.02679","title":"Just Rank: Rethinking Evaluation with Word and Sentence Similarities","created":"2022-03-05","cited_by_count":20,"area":null},{"id":"2110.10470","title":"Interpreting Deep Learning Models in Natural Language Processing: A Review","created":"2021-10-20","cited_by_count":19,"area":null},{"id":"2205.07043","title":"Naturalistic Causal Probing for Morpho-Syntax","created":"2022-05-14","cited_by_count":19,"area":null},{"id":"2210.12696","title":"On the Transformation of Latent Space in Fine-Tuned NLP Models","created":"2022-10-23","cited_by_count":19,"area":null},{"id":"2305.18957","title":"Wave to Syntax: Probing spoken language models for syntax","created":"2023-05-30","cited_by_count":18,"area":null},{"id":"2410.08113","title":"Robust AI-Generated Text Detection by Restricted Embeddings","created":"2024-10-10","cited_by_count":18,"area":null},{"id":"2109.03777","title":"Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP","created":"2021-09-08","cited_by_count":17,"area":null},{"id":"2109.04095","title":"Debiasing Methods in Natural Language Understanding Make Bias More Accessible","created":"2021-09-09","cited_by_count":17,"area":null},{"id":"2410.16090","title":"Analysing the Residual Stream of Language Models Under Knowledge Conflicts","created":"2024-10-21","cited_by_count":17,"area":null},{"id":"2510.00296","title":"Beyond Token Probes: Hallucination Detection via Activation Tensors with ACT-ViT","created":"2025-09-30","cited_by_count":17,"area":null},{"id":"2109.05958","title":"Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations","created":"2021-09-13","cited_by_count":16,"area":null},{"id":"2203.10415","title":"How does the pre-training objective affect what large language models learn about linguistic properties?","created":"2022-03-20","cited_by_count":16,"area":null},{"id":"2206.11719","title":"AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models","created":"2022-06-23","cited_by_count":16,"area":null},{"id":"2305.13386","title":"Can LLMs facilitate interpretation of pre-trained language models?","created":"2023-05-22","cited_by_count":16,"area":null},{"id":"2104.07155","title":"Disentangling Representations of Text by Masking Transformers","created":"2021-04-14","cited_by_count":15,"area":null},{"id":"2105.13471","title":"Inspecting the concept knowledge graph encoded by modern language models","created":"2021-05-27","cited_by_count":15,"area":null},{"id":"2201.11239","title":"Diagnosing AI Explanation Methods with Folk Concepts of Behavior","created":"2022-01-27","cited_by_count":15,"area":null}],"next_cursor":"100"}