{"list":"other","total":121,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1705.07874","title":"A Unified Approach to Interpreting Model Predictions","created":"2017-05-22","cited_by_count":6555},{"id":"2312.00752","title":"Mamba: Linear-Time Sequence Modeling with Selective State Spaces","created":"2023-12-01","cited_by_count":4718},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"1301.3781","title":"Efficient Estimation of Word Representations in Vector Space","created":"2013-01-16","cited_by_count":4375},{"id":"1310.4546","title":"Distributed Representations of Words and Phrases and their Compositionality","created":"2013-10-16","cited_by_count":3474},{"id":"1703.01365","title":"Axiomatic Attribution for Deep Networks","created":"2017-03-04","cited_by_count":3384},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2111.00396","title":"Efficiently Modeling Long Sequences with Structured State Spaces","created":"2021-10-31","cited_by_count":2465},{"id":"1312.6034","title":"Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps","created":"2013-12-20","cited_by_count":2371},{"id":"1311.2901","title":"Visualizing and Understanding Convolutional Networks","created":"2013-11-12","cited_by_count":2290},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"2312.06681","title":"Steering Llama 2 via Contrastive Activation Addition","created":"2023-12-09","cited_by_count":1085},{"id":"2007.04612","title":"Concept Bottleneck Models","created":"2020-07-09","cited_by_count":1032},{"id":"2210.07229","title":"Mass-Editing Memory in a Transformer","created":"2022-10-13","cited_by_count":1001},{"id":"1802.01933","title":"A Survey Of Methods For Explaining Black Box Models","created":"2018-02-06","cited_by_count":973},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"1909.03368","title":"Designing and Interpreting Probes with Control Tasks","created":"2019-09-08","cited_by_count":640},{"id":"2304.14767","title":"Dissecting Recall of Factual Associations in Auto-Regressive Language Models","created":"2023-04-28","cited_by_count":528},{"id":"1806.00069","title":"Explaining Explanations: An Overview of Interpretability of Machine Learning","created":"2018-05-31","cited_by_count":508},{"id":"1805.01070","title":"What you can cram into a single vector: Probing sentence embeddings for linguistic properties","created":"2018-05-03","cited_by_count":457},{"id":"2004.07667","title":"Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection","created":"2020-04-16","cited_by_count":455},{"id":"2403.19647","title":"Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models","created":"2024-03-28","cited_by_count":435},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431},{"id":"2106.02997","title":"Causal Abstractions of Neural Networks","created":"2021-06-06","cited_by_count":422},{"id":"2308.14761","title":"Unified Concept Editing in Diffusion Models","created":"2023-08-25","cited_by_count":388},{"id":"1903.08855","title":"Linguistic Knowledge and Transferability of Contextual Representations","created":"2019-03-21","cited_by_count":383},{"id":"2309.00941","title":"Emergent Linear Representations in World Models of Self-Supervised Sequence Models","created":"2023-09-02","cited_by_count":319},{"id":"2305.14795","title":"MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions","created":"2023-05-24","cited_by_count":300},{"id":"1301.2300","title":"Direct and Indirect Effects","created":"2013-01-10","cited_by_count":280},{"id":"1812.08951","title":"Analysis Methods in Neural Language Processing: A Survey","created":"2018-12-21","cited_by_count":277},{"id":"2306.03819","title":"LEACE: Perfect linear concept erasure in closed form","created":"2023-06-06","cited_by_count":267},{"id":"2009.05041","title":"Understanding the Role of Individual Units in a Deep Neural Network","created":"2020-09-10","cited_by_count":255},{"id":"1705.07857","title":"Real Time Image Saliency for Black Box Classifiers","created":"2017-05-22","cited_by_count":246},{"id":"2301.04213","title":"Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models","created":"2023-01-10","cited_by_count":243},{"id":"2307.12976","title":"Evaluating the Ripple Effects of Knowledge Editing in Language Models","created":"2023-07-24","cited_by_count":242},{"id":"2404.15574","title":"Retrieval Head Mechanistically Explains Long-Context Factuality","created":"2024-04-24","cited_by_count":232},{"id":"1612.08220","title":"Understanding Neural Networks through Representation Erasure","created":"2016-12-24","cited_by_count":224},{"id":"1606.05386","title":"Model-Agnostic Interpretability of Machine Learning","created":"2016-06-16","cited_by_count":219},{"id":"2405.14860","title":"Not All Language Model Features Are One-Dimensionally Linear","created":"2024-05-23","cited_by_count":212},{"id":"2303.02536","title":"Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations","created":"2023-03-05","cited_by_count":209},{"id":"2010.00711","title":"A Survey of the State of Explainable AI for Natural Language Processing","created":"2020-10-01","cited_by_count":206},{"id":"2404.03592","title":"ReFT: Representation Finetuning for Language Models","created":"2024-04-04","cited_by_count":197},{"id":"2304.05969","title":"Localizing Model Behavior with Path Patching","created":"2023-04-12","cited_by_count":195},{"id":"2404.16014","title":"Improving Dictionary Learning with Gated Sparse Autoencoders","created":"2024-04-24","cited_by_count":179},{"id":"2109.00725","title":"Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond","created":"2021-09-02","cited_by_count":178},{"id":"1704.03471","title":"What do Neural Machine Translation Models Learn about Morphology?","created":"2017-04-11","cited_by_count":166},{"id":"1601.03764","title":"Linear Algebraic Structure of Word Senses, with Applications to Polysemy","created":"2016-01-14","cited_by_count":165},{"id":"2310.15154","title":"Linear Representations of Sentiment in Large Language Models","created":"2023-10-23","cited_by_count":163},{"id":"1506.02078","title":"Visualizing and Understanding Recurrent Networks","created":"2015-06-05","cited_by_count":160},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156},{"id":"2307.15771","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","created":"2023-07-28","cited_by_count":156},{"id":"2005.00719","title":"Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?","created":"2020-05-02","cited_by_count":151},{"id":"2402.14811","title":"Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking","created":"2024-02-22","cited_by_count":149},{"id":"2403.17806","title":"Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms","created":"2024-03-26","cited_by_count":149},{"id":"2406.19384","title":"The Remarkable Robustness of LLMs: Stages of Inference?","created":"2024-06-27","cited_by_count":146},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"1907.07165","title":"Explaining Classifiers with Causal Concept Effect (CaCE)","created":"2019-07-16","cited_by_count":135},{"id":"2106.06087","title":"Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models","created":"2021-06-10","cited_by_count":131},{"id":"2209.11326","title":"Towards Faithful Model Explanation in NLP: A Survey","created":"2022-09-22","cited_by_count":130},{"id":"1905.08160","title":"Interpretable Neural Predictions with Differentiable Binary Variables","created":"2019-05-20","cited_by_count":126},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124},{"id":"2004.03844","title":"On the Effect of Dropping Layers of Pre-trained Transformer Models","created":"2020-04-08","cited_by_count":118},{"id":"1811.01157","title":"Identifying and Controlling Important Neurons in Neural Machine Translation","created":"2018-11-03","cited_by_count":111},{"id":"2403.00745","title":"AtP*: An efficient and scalable method for localizing LLM behaviour to components","created":"2024-03-01","cited_by_count":111},{"id":"1904.12847","title":"Optimal Sparse Decision Trees","created":"2019-04-29","cited_by_count":105},{"id":"2305.08809","title":"Interpretability at Scale: Identifying Causal Mechanisms in Alpaca","created":"2023-05-15","cited_by_count":103},{"id":"1803.06959","title":"On the importance of single directions for generalization","created":"2018-03-19","cited_by_count":99},{"id":"2002.09815","title":"Neuron Shapley: Discovering the Responsible Neurons","created":"2020-02-23","cited_by_count":98},{"id":"1808.08079","title":"Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information","created":"2018-08-24","cited_by_count":97},{"id":"1903.07435","title":"The emergence of number and syntax units in LSTM language models","created":"2019-03-18","cited_by_count":94},{"id":"2310.08559","title":"Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement","created":"2023-10-12","cited_by_count":89},{"id":"2405.08366","title":"Towards Principled Evaluations of Sparse Autoencoders for Interpretability and Control","created":"2024-05-14","cited_by_count":86},{"id":"2003.03934","title":"Causal Interpretability for Machine Learning -- Problems, Methods and Evaluation","created":"2020-03-09","cited_by_count":82},{"id":"2108.13138","title":"Neuron-level Interpretation of Deep NLP Models: A Survey","created":"2021-08-30","cited_by_count":81},{"id":"2402.17700","title":"RAVEL: Evaluating Interpretability Methods on Disentangling Language Model Representations","created":"2024-02-27","cited_by_count":79},{"id":"2405.12241","title":"Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning","created":"2024-05-17","cited_by_count":67},{"id":"2104.03514","title":"Low-Complexity Probing via Finding Subnetworks","created":"2021-04-08","cited_by_count":64},{"id":"2004.14992","title":"How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking","created":"2020-04-30","cited_by_count":63},{"id":"2109.09234","title":"Conditional probing: measuring usable information beyond a baseline","created":"2021-09-19","cited_by_count":62},{"id":"2110.07483","title":"On the Pitfalls of Analyzing Individual Neurons in Language Models","created":"2021-10-14","cited_by_count":62},{"id":"2105.06965","title":"Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction","created":"2021-05-14","cited_by_count":59},{"id":"2204.08831","title":"Probing for the Usage of Grammatical Number","created":"2022-04-19","cited_by_count":59},{"id":"2403.07809","title":"pyvene: A Library for Understanding and Improving PyTorch Models via Interventions","created":"2024-03-12","cited_by_count":54},{"id":"2408.00113","title":"Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models","created":"2024-07-31","cited_by_count":51},{"id":"2402.09631","title":"Representation Surgery: Theory and Practice of Affine Steering","created":"2024-02-15","cited_by_count":50},{"id":"2402.11917","title":"A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task","created":"2024-02-19","cited_by_count":49},{"id":"1908.03020","title":"Measurable Counterfactual Local Explanations for Any Classifier","created":"2019-08-08","cited_by_count":48},{"id":"2201.12191","title":"Kernelized Concept Erasure","created":"2022-01-28","cited_by_count":48},{"id":"2310.17230","title":"Codebook Features: Sparse and Discrete Interpretability for Neural Networks","created":"2023-10-26","cited_by_count":48},{"id":"2402.12560","title":"CausalGym: Benchmarking causal interpretability methods on linguistic tasks","created":"2024-02-19","cited_by_count":46},{"id":"2406.07882","title":"Designing a Dashboard for Transparency and Control of Conversational AI","created":"2024-06-12","cited_by_count":46}],"next_cursor":"100"}