{"list":"other","total":71,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1607.06450","title":"Layer Normalization","created":"2016-07-21","cited_by_count":5669},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1606.08415","title":"Gaussian Error Linear Units (GELUs)","created":"2016-06-27","cited_by_count":3502},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2101.00027","title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","created":"2020-12-31","cited_by_count":2411},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1610.01644","title":"Understanding intermediate layers using linear classifier probes","created":"2016-10-05","cited_by_count":1353},{"id":"2012.14913","title":"Transformer Feed-Forward Layers Are Key-Value Memories","created":"2020-12-29","cited_by_count":1336},{"id":"1711.11279","title":"Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)","created":"2017-11-30","cited_by_count":1319},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"1810.03292","title":"Sanity Checks for Saliency Maps","created":"2018-10-08","cited_by_count":1156},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"1606.03657","title":"InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets","created":"2016-06-12","cited_by_count":860},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"2212.03827","title":"Discovering Latent Knowledge in Language Models Without Supervision","created":"2022-12-07","cited_by_count":767},{"id":"1704.05796","title":"Network Dissection: Quantifying Interpretability of Deep Visual Representations","created":"2017-04-19","cited_by_count":708},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"1802.05983","title":"Disentangling by Factorising","created":"2018-02-16","cited_by_count":616},{"id":"2203.14680","title":"Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space","created":"2022-03-28","cited_by_count":532},{"id":"1805.01070","title":"What you can cram into a single vector: Probing sentence embeddings for linguistic properties","created":"2018-05-03","cited_by_count":457},{"id":"1905.06316","title":"What do you learn from context? Probing for sentence structure in contextualized word representations","created":"2019-05-15","cited_by_count":438},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431},{"id":"1310.1531","title":"DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition","created":"2013-10-06","cited_by_count":424},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2009.05041","title":"Understanding the Role of Individual Units in a Deep Neural Network","created":"2020-09-10","cited_by_count":255},{"id":"2301.04213","title":"Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models","created":"2023-01-10","cited_by_count":243},{"id":"2003.12298","title":"Information-Theoretic Probing with Minimum Description Length","created":"2020-03-27","cited_by_count":232},{"id":"1906.02715","title":"Visualizing and Measuring the Geometry of BERT","created":"2019-06-06","cited_by_count":216},{"id":"2004.03061","title":"Information-Theoretic Probing for Linguistic Structure","created":"2020-04-07","cited_by_count":207},{"id":"2304.05969","title":"Localizing Model Behavior with Path Patching","created":"2023-04-12","cited_by_count":195},{"id":"2006.14032","title":"Compositional Explanations of Neurons","created":"2020-06-24","cited_by_count":172},{"id":"1601.03764","title":"Linear Algebraic Structure of Word Senses, with Applications to Polysemy","created":"2016-01-14","cited_by_count":165},{"id":"2005.00719","title":"Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?","created":"2020-05-02","cited_by_count":151},{"id":"1704.01444","title":"Learning to Generate Reviews and Discovering Sentiment","created":"2017-04-05","cited_by_count":148},{"id":"2302.03025","title":"A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations","created":"2023-02-06","cited_by_count":144},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2209.02535","title":"Analyzing Transformers in Embedding Space","created":"2022-09-06","cited_by_count":132},{"id":"1812.09355","title":"What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models","created":"2018-12-21","cited_by_count":124},{"id":"1811.01157","title":"Identifying and Controlling Important Neurons in Neural Machine Translation","created":"2018-11-03","cited_by_count":111},{"id":"1807.07814","title":"Interactive Supercomputing on 40,000 Cores for Machine Learning and Data Analysis","created":"2018-07-20","cited_by_count":110},{"id":"1602.03616","title":"Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks","created":"2016-02-11","cited_by_count":106},{"id":"2206.13353","title":"Is Power-Seeking AI an Existential Risk?","created":"2022-06-16","cited_by_count":105},{"id":"2010.02695","title":"Analyzing Individual Neurons in Pre-trained Language Models","created":"2020-10-06","cited_by_count":97},{"id":"2104.07143","title":"An Interpretability Illusion for BERT","created":"2021-04-14","cited_by_count":97},{"id":"2108.13138","title":"Neuron-level Interpretation of Deep NLP Models: A Survey","created":"2021-08-30","cited_by_count":81},{"id":"2212.11870","title":"Impossibility Theorems for Feature Attribution","created":"2022-12-22","cited_by_count":78},{"id":"2210.01892","title":"Polysemanticity and Capacity in Neural Networks","created":"2022-10-04","cited_by_count":77},{"id":"1805.12233","title":"How Important Is a Neuron?","created":"2018-05-30","cited_by_count":73},{"id":"2104.07885","title":"Probing Across Time: What Does RoBERTa Know and When?","created":"2021-04-16","cited_by_count":73},{"id":"2211.07349","title":"Finding Skill Neurons in Pre-trained Transformer-based Language Models","created":"2022-11-14","cited_by_count":66},{"id":"2104.03514","title":"Low-Complexity Probing via Finding Subnetworks","created":"2021-04-08","cited_by_count":64},{"id":"2110.07483","title":"On the Pitfalls of Analyzing Individual Neurons in Language Models","created":"2021-10-14","cited_by_count":62},{"id":"2010.02812","title":"Intrinsic Probing through Dimension Selection","created":"2020-10-06","cited_by_count":45},{"id":"2112.06837","title":"Sparse Interventions in Language Models with Differentiable Masking","created":"2021-12-13","cited_by_count":34},{"id":"2211.12312","title":"Interpreting Neural Networks through the Polytope Lens","created":"2022-11-22","cited_by_count":33},{"id":"2005.07647","title":"Finding Experts in Transformer Models","created":"2020-05-15","cited_by_count":28},{"id":"2106.02559","title":"Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing","created":"2021-06-04","cited_by_count":28},{"id":"1902.06547","title":"Sparse Regression: Scalable algorithms and empirical performance","created":"2019-02-18","cited_by_count":27},{"id":"2206.13288","title":"Discovering Salient Neurons in Deep NLP Models","created":"2022-06-27","cited_by_count":21},{"id":"1710.01352","title":"Sparse Classification: a scalable discrete optimization perspective","created":"2017-10-03","cited_by_count":18},{"id":"2212.06925","title":"On the Relationship Between Explanation and Prediction: A Causal View","created":"2022-12-13","cited_by_count":14},{"id":"1804.06679","title":"Understanding Neural Networks and Individual Neuron Importance via Information-Ordered Cumulative Ablation","created":"2018-04-18","cited_by_count":13},{"id":"2211.09169","title":"Engineering Monosemanticity in Toy Models","created":"2022-11-16","cited_by_count":13},{"id":"2106.09606","title":"Cardinality Minimization, Constraints, and Regularization: A Survey","created":"2021-06-17","cited_by_count":12}],"next_cursor":null}