{"total":215,"rows":[{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876,"area":null},{"id":"2105.11447","title":"True Few-Shot Learning with Language Models","created":"2021-05-24","cited_by_count":344,"area":null},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334,"area":null},{"id":"2104.05240","title":"Factual Probing Is [MASK]: Learning vs. Learning to Recall","created":"2021-04-12","cited_by_count":291,"area":null},{"id":"2308.09124","title":"Linearity of Relation Decoding in Transformer Language Models","created":"2023-08-17","cited_by_count":200,"area":null},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177,"area":null},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156,"area":null},{"id":"2209.11326","title":"Towards Faithful Model Explanation in NLP: A Survey","created":"2022-09-22","cited_by_count":130,"area":null},{"id":"2111.09259","title":"Acquisition of Chess Knowledge in AlphaZero","created":"2021-11-17","cited_by_count":123,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2208.07998","title":"What Artificial Neural Networks Can Tell Us About Human Language Acquisition","created":"2022-08-17","cited_by_count":99,"area":null},{"id":"2203.11364","title":"An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels","created":"2022-03-21","cited_by_count":89,"area":null},{"id":"2303.07971","title":"A Theory of Emergent In-Context Learning as Implicit Structure Induction","created":"2023-03-14","cited_by_count":86,"area":null},{"id":"2108.13138","title":"Neuron-level Interpretation of Deep NLP Models: A Survey","created":"2021-08-30","cited_by_count":81,"area":null},{"id":"2111.13654","title":"Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs","created":"2021-11-26","cited_by_count":79,"area":null},{"id":"2102.00529","title":"Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers","created":"2021-01-31","cited_by_count":64,"area":null},{"id":"2104.03514","title":"Low-Complexity Probing via Finding Subnetworks","created":"2021-04-08","cited_by_count":64,"area":null},{"id":"2109.09234","title":"Conditional probing: measuring usable information beyond a baseline","created":"2021-09-19","cited_by_count":62,"area":null},{"id":"2312.03729","title":"Cognitive Dissonance: Why Do Language Model Outputs Disagree with Internal Representations of Truthfulness?","created":"2023-11-27","cited_by_count":62,"area":null},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59,"area":null},{"id":"2106.08367","title":"What Context Features Can Transformer Language Models Use?","created":"2021-06-15","cited_by_count":50,"area":null},{"id":"2305.13299","title":"Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations","created":"2023-05-22","cited_by_count":49,"area":null},{"id":"2403.08946","title":"Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era","created":"2024-03-13","cited_by_count":46,"area":null},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44,"area":null},{"id":"2301.12971","title":"Quantifying Context Mixing in Transformers","created":"2023-01-30","cited_by_count":43,"area":null},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41,"area":null},{"id":"2203.00633","title":"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale","created":"2022-03-01","cited_by_count":41,"area":null},{"id":"2105.07109","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","created":"2021-05-15","cited_by_count":40,"area":null},{"id":"2311.14975","title":"Eliminating Domain Bias for Federated Learning in Representation Space","created":"2023-11-25","cited_by_count":38,"area":null},{"id":"2401.17139","title":"Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models","created":"2024-01-30","cited_by_count":35,"area":null},{"id":"2503.09543","title":"PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs","created":"2025-03-12","cited_by_count":35,"area":null},{"id":"2112.06837","title":"Sparse Interventions in Language Models with Differentiable Masking","created":"2021-12-13","cited_by_count":34,"area":null},{"id":"2110.08182","title":"The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color","created":"2021-10-15","cited_by_count":32,"area":null},{"id":"2103.11072","title":"Local Interpretations for Explainable Natural Language Processing: A Survey","created":"2021-03-20","cited_by_count":31,"area":null},{"id":"2105.10185","title":"A Non-Linear Structural Probe","created":"2021-05-21","cited_by_count":31,"area":null},{"id":"2105.13818","title":"Language Models Use Monotonicity to Assess NPI Licensing","created":"2021-05-28","cited_by_count":31,"area":null},{"id":"2203.14139","title":"Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages","created":"2022-03-26","cited_by_count":30,"area":null},{"id":"2211.08714","title":"Reward Gaming in Conditional Text Generation","created":"2022-11-16","cited_by_count":30,"area":null},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29,"area":null},{"id":"2210.11471","title":"Choose Your Lenses: Flaws in Gender Bias Evaluation","created":"2022-10-20","cited_by_count":29,"area":null},{"id":"2210.14011","title":"Are All Spurious Features in Natural Language Alike? An Analysis through a Causal Lens","created":"2022-10-25","cited_by_count":28,"area":null},{"id":"2310.13620","title":"Bridging Information-Theoretic and Geometric Compression in Language Models","created":"2023-10-20","cited_by_count":26,"area":null},{"id":"2404.18923","title":"Holmes: A Benchmark to Assess the Linguistic Competence of Language Models","created":"2024-04-29","cited_by_count":26,"area":null},{"id":"2104.05904","title":"DirectProbe: Studying Representations without Classifiers","created":"2021-04-13","cited_by_count":25,"area":null},{"id":"2305.10204","title":"Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projection","created":"2023-05-17","cited_by_count":25,"area":null},{"id":"2307.15054","title":"A Geometric Notion of Causal Probing","created":"2023-07-27","cited_by_count":25,"area":null},{"id":"2402.17954","title":"Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps","created":"2024-02-28","cited_by_count":25,"area":null},{"id":"2203.06204","title":"When classifying grammatical role, BERT doesn't care about word order... except when it matters","created":"2022-03-11","cited_by_count":24,"area":null},{"id":"2303.07616","title":"The Life Cycle of Knowledge in Big Language Models: A Survey","created":"2023-03-14","cited_by_count":23,"area":null},{"id":"2310.16484","title":"Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training","created":"2023-10-25","cited_by_count":23,"area":null},{"id":"2103.03872","title":"Rissanen Data Analysis: Examining Dataset Characteristics via Description Length","created":"2021-03-05","cited_by_count":22,"area":null},{"id":"2109.03853","title":"A Bayesian Framework for Information-Theoretic Probing","created":"2021-09-08","cited_by_count":22,"area":null},{"id":"2212.10563","title":"BLIND: Bias Removal With No Demographics","created":"2022-12-20","cited_by_count":22,"area":null},{"id":"2311.08576","title":"Towards Evaluating AI Systems for Moral Status Using Self-Reports","created":"2023-11-14","cited_by_count":22,"area":null},{"id":"2109.03160","title":"How much pretraining data do language models need to learn syntax?","created":"2021-09-07","cited_by_count":21,"area":null},{"id":"2110.03618","title":"Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP","created":"2021-10-07","cited_by_count":21,"area":null},{"id":"2104.04515","title":"Connecting Attributions and QA Model Behavior on Realistic Counterfactuals","created":"2021-04-09","cited_by_count":20,"area":null},{"id":"2206.03945","title":"Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models","created":"2022-06-08","cited_by_count":20,"area":null},{"id":"2112.02805","title":"Forward Compatible Training for Large-Scale Embedding Retrieval Systems","created":"2021-12-06","cited_by_count":19,"area":null},{"id":"2205.07043","title":"Naturalistic Causal Probing for Morpho-Syntax","created":"2022-05-14","cited_by_count":19,"area":null},{"id":"2104.08197","title":"Probing artificial neural networks: insights from neuroscience","created":"2021-04-16","cited_by_count":17,"area":null},{"id":"2109.04095","title":"Debiasing Methods in Natural Language Understanding Make Bias More Accessible","created":"2021-09-09","cited_by_count":17,"area":null},{"id":"2109.12742","title":"FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding","created":"2021-09-27","cited_by_count":17,"area":null},{"id":"2109.05958","title":"Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations","created":"2021-09-13","cited_by_count":16,"area":null},{"id":"2203.10415","title":"How does the pre-training objective affect what large language models learn about linguistic properties?","created":"2022-03-20","cited_by_count":16,"area":null},{"id":"2311.09194","title":"Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models","created":"2023-11-15","cited_by_count":16,"area":null},{"id":"2505.13737","title":"Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers","created":"2025-05-19","cited_by_count":16,"area":null},{"id":"2201.11239","title":"Diagnosing AI Explanation Methods with Folk Concepts of Behavior","created":"2022-01-27","cited_by_count":15,"area":null},{"id":"2202.00035","title":"Learning Fair Representations via Rate-Distortion Maximization","created":"2022-01-31","cited_by_count":15,"area":null},{"id":"2203.11131","title":"Towards Explainable Evaluation Metrics for Natural Language Generation","created":"2022-03-21","cited_by_count":15,"area":null},{"id":"2210.11689","title":"SLING: Sino Linguistic Evaluation of Large Language Models","created":"2022-10-21","cited_by_count":15,"area":null},{"id":"2403.10381","title":"Monotonic Representation of Numeric Properties in Language Models","created":"2024-03-15","cited_by_count":15,"area":null},{"id":"2109.08613","title":"Adversarial Scrubbing of Demographic Information for Text Classification","created":"2021-09-17","cited_by_count":14,"area":null},{"id":"2306.08193","title":"Operationalising Representation in Natural Language Processing","created":"2023-06-14","cited_by_count":14,"area":null},{"id":"2310.12956","title":"Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2105.05641","title":"How Reliable are Model Diagnostics?","created":"2021-05-12","cited_by_count":13,"area":null},{"id":"2210.07352","title":"Predicting Fine-Tuning Performance with Probing","created":"2022-10-13","cited_by_count":13,"area":null},{"id":"2210.07931","title":"Sequential Learning Of Neural Networks for Prequential MDL","created":"2022-10-14","cited_by_count":13,"area":null},{"id":"2210.10041","title":"Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning","created":"2022-10-18","cited_by_count":13,"area":null},{"id":"2403.03823","title":"A Modular Approach for Multimodal Summarization of TV Shows","created":"2024-03-06","cited_by_count":13,"area":null},{"id":"2110.08388","title":"Probing as Quantifying Inductive Bias","created":"2021-10-15","cited_by_count":12,"area":null},{"id":"2204.06827","title":"How Gender Debiasing Affects Internal Model Representations, and Why It Matters","created":"2022-04-14","cited_by_count":12,"area":null},{"id":"2210.09404","title":"Measures of Information Reflect Memorization Patterns","created":"2022-10-17","cited_by_count":12,"area":null},{"id":"2311.04354","title":"Uncovering Intermediate Variables in Transformers using Circuit Probing","created":"2023-11-07","cited_by_count":12,"area":null},{"id":"2512.18792","title":"The Dead Salmons of AI Interpretability","created":"2025-12-21","cited_by_count":12,"area":null},{"id":"2305.18213","title":"Gaussian Process Probes (GPP) for Uncertainty-Aware Probing","created":"2023-05-29","cited_by_count":11,"area":null},{"id":"2312.10019","title":"Understanding Probe Behaviors through Variational Bounds of Mutual Information","created":"2023-12-15","cited_by_count":11,"area":null},{"id":"2405.05386","title":"Interpretability Needs a New Paradigm","created":"2024-05-08","cited_by_count":11,"area":null},{"id":"2109.08634","title":"Grounding Natural Language Instructions: Can Large Language Models Capture Spatial Information?","created":"2021-09-17","cited_by_count":10,"area":null},{"id":"2212.05421","title":"Feature-Level Debiased Natural Language Understanding","created":"2022-12-11","cited_by_count":10,"area":null},{"id":"2212.10879","title":"Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?","created":"2022-12-21","cited_by_count":10,"area":null},{"id":"2301.12855","title":"How Far Can It Go?: On Intrinsic Gender Bias Mitigation for Text Classification","created":"2023-01-30","cited_by_count":10,"area":null},{"id":"2303.03951","title":"Probing Graph Representations","created":"2023-03-07","cited_by_count":10,"area":null},{"id":"2404.03036","title":"MuLan: A Study of Fact Mutability in Language Models","created":"2024-04-03","cited_by_count":10,"area":null},{"id":"2105.02629","title":"Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach","created":"2021-05-06","cited_by_count":9,"area":null},{"id":"2107.00439","title":"What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis","created":"2021-07-01","cited_by_count":9,"area":null},{"id":"2109.11491","title":"Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords","created":"2021-09-23","cited_by_count":9,"area":null},{"id":"2203.17081","title":"Interpretation of Black Box NLP Models: A Survey","created":"2022-03-31","cited_by_count":9,"area":null},{"id":"2205.06135","title":"Fair NLP Models with Differentially Private Text Encoders","created":"2022-05-12","cited_by_count":9,"area":null}],"next_cursor":"100"}