{"list":"other","total":190,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1602.04938","title":"\"Why Should I Trust You?\": Explaining the Predictions of Any Classifier","created":"2016-02-16","cited_by_count":5070},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"1310.4546","title":"Distributed Representations of Words and Phrases and their Compositionality","created":"2013-10-16","cited_by_count":3474},{"id":"1703.01365","title":"Axiomatic Attribution for Deep Networks","created":"2017-03-04","cited_by_count":3384},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"1311.2901","title":"Visualizing and Understanding Convolutional Networks","created":"2013-11-12","cited_by_count":2290},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1905.00414","title":"Similarity of Neural Network Representations Revisited","created":"2019-05-01","cited_by_count":1755},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1704.02685","title":"Learning Important Features Through Propagating Activation Differences","created":"2017-04-10","cited_by_count":1458},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"1702.08608","title":"Towards A Rigorous Science of Interpretable Machine Learning","created":"2017-02-28","cited_by_count":1416},{"id":"1610.01644","title":"Understanding intermediate layers using linear classifier probes","created":"2016-10-05","cited_by_count":1353},{"id":"2310.01405","title":"Representation Engineering: A Top-Down Approach to AI Transparency","created":"2023-10-02","cited_by_count":1336},{"id":"2306.03341","title":"Inference-Time Intervention: Eliciting Truthful Answers from a Language Model","created":"2023-06-06","cited_by_count":1302},{"id":"1706.07269","title":"Explanation in Artificial Intelligence: Insights from the Social Sciences","created":"2017-06-22","cited_by_count":1206},{"id":"1706.03825","title":"SmoothGrad: removing noise by adding noise","created":"2017-06-12","cited_by_count":1109},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2310.13548","title":"Towards Understanding Sycophancy in Language Models","created":"2023-10-20","cited_by_count":1040},{"id":"2210.07229","title":"Mass-Editing Memory in a Transformer","created":"2022-10-13","cited_by_count":1001},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"1905.02175","title":"Adversarial Examples Are Not Bugs, They Are Features","created":"2019-05-06","cited_by_count":953},{"id":"1811.12359","title":"Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations","created":"2018-11-29","cited_by_count":941},{"id":"2308.10248","title":"Steering Language Models With Activation Engineering","created":"2023-08-20","cited_by_count":922},{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876},{"id":"1809.01999","title":"Recurrent World Models Facilitate Policy Evolution","created":"2018-09-04","cited_by_count":785},{"id":"2212.03827","title":"Discovering Latent Knowledge in Language Models Without Supervision","created":"2022-12-07","cited_by_count":767},{"id":"2307.15217","title":"Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback","created":"2023-07-27","cited_by_count":759},{"id":"2311.03658","title":"The Linear Representation Hypothesis and the Geometry of Large Language Models","created":"2023-11-07","cited_by_count":716},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"2303.08112","title":"Eliciting Latent Predictions from Transformers with the Tuned Lens","created":"2023-03-14","cited_by_count":623},{"id":"2104.08696","title":"Knowledge Neurons in Pretrained Transformers","created":"2021-04-18","cited_by_count":601},{"id":"2004.03685","title":"Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?","created":"2020-04-07","cited_by_count":599},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"2203.14680","title":"Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space","created":"2022-03-28","cited_by_count":532},{"id":"2401.05566","title":"Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training","created":"2024-01-10","cited_by_count":529},{"id":"2304.14767","title":"Dissecting Recall of Factual Associations in Auto-Regressive Language Models","created":"2023-04-28","cited_by_count":528},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2212.14052","title":"Hungry Hungry Hippos: Towards Language Modeling with State Space Models","created":"2022-12-28","cited_by_count":499},{"id":"2004.07667","title":"Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection","created":"2020-04-16","cited_by_count":455},{"id":"2403.19647","title":"Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models","created":"2024-03-28","cited_by_count":435},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431},{"id":"2106.02997","title":"Causal Abstractions of Neural Networks","created":"2021-06-06","cited_by_count":422},{"id":"2302.10866","title":"Hyena Hierarchy: Towards Larger Convolutional Language Models","created":"2023-02-21","cited_by_count":393},{"id":"2309.16042","title":"Towards Best Practices of Activation Patching in Language Models: Metrics and Methods","created":"2023-09-27","cited_by_count":359},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334},{"id":"2309.00941","title":"Emergent Linear Representations in World Models of Self-Supervised Sequence Models","created":"2023-09-02","cited_by_count":319},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316},{"id":"2209.02299","title":"A Survey of Machine Unlearning","created":"2022-09-06","cited_by_count":312},{"id":"2310.15916","title":"In-Context Learning Creates Task Vectors","created":"2023-10-24","cited_by_count":312},{"id":"2207.07061","title":"Confident Adaptive Language Modeling","created":"2022-07-14","cited_by_count":310},{"id":"2310.15213","title":"Function Vectors in Large Language Models","created":"2023-10-23","cited_by_count":308},{"id":"1812.02230","title":"Towards a Definition of Disentangled Representations","created":"2018-12-05","cited_by_count":296},{"id":"2109.13916","title":"Unsolved Problems in ML Safety","created":"2021-09-28","cited_by_count":292},{"id":"1906.01820","title":"Risks from Learned Optimization in Advanced Machine Learning Systems","created":"2019-06-05","cited_by_count":258},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2301.04213","title":"Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models","created":"2023-01-10","cited_by_count":243},{"id":"2401.06102","title":"Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models","created":"2024-01-11","cited_by_count":235},{"id":"2003.12298","title":"Information-Theoretic Probing with Minimum Description Length","created":"2020-03-27","cited_by_count":232},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230},{"id":"1511.07543","title":"Convergent Learning: Do different neural networks learn the same representations?","created":"2015-11-24","cited_by_count":220},{"id":"2011.14878","title":"Explaining by Removing: A Unified Framework for Model Explanation","created":"2020-11-21","cited_by_count":218},{"id":"2106.07682","title":"Revisiting Model Stitching to Compare Neural Representations","created":"2021-06-14","cited_by_count":209},{"id":"2303.02536","title":"Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations","created":"2023-03-05","cited_by_count":209},{"id":"1905.11604","title":"SGD on Neural Networks Learns Functions of Increasing Complexity","created":"2019-05-28","cited_by_count":204},{"id":"2305.00586","title":"How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model","created":"2023-04-30","cited_by_count":202},{"id":"2308.09124","title":"Linearity of Relation Decoding in Transformer Language Models","created":"2023-08-17","cited_by_count":200},{"id":"2404.03592","title":"ReFT: Representation Finetuning for Language Models","created":"2024-04-04","cited_by_count":197},{"id":"2304.05969","title":"Localizing Model Behavior with Path Patching","created":"2023-04-12","cited_by_count":195},{"id":"1804.02477","title":"Programmatically Interpretable Reinforcement Learning","created":"2018-04-06","cited_by_count":193},{"id":"2308.14752","title":"AI Deception: A Survey of Examples, Risks, and Potential Solutions","created":"2023-08-28","cited_by_count":188},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2401.01967","title":"A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity","created":"2024-01-03","cited_by_count":185},{"id":"2106.00737","title":"Implicit Representations of Meaning in Neural Language Models","created":"2021-06-01","cited_by_count":180},{"id":"2006.14032","title":"Compositional Explanations of Neurons","created":"2020-06-24","cited_by_count":172},{"id":"1601.03764","title":"Linear Algebraic Structure of Word Senses, with Applications to Polysemy","created":"2016-01-14","cited_by_count":165},{"id":"2310.15154","title":"Linear Representations of Sentiment in Large Language Models","created":"2023-10-23","cited_by_count":163},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156},{"id":"2307.15771","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","created":"2023-07-28","cited_by_count":156},{"id":"2205.10487","title":"Scaling Laws and Interpretability of Learning from Repeated Data","created":"2022-05-21","cited_by_count":152},{"id":"2307.09458","title":"Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla","created":"2023-07-18","cited_by_count":149},{"id":"2402.14811","title":"Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking","created":"2024-02-22","cited_by_count":149},{"id":"2210.01117","title":"Omnigrok: Grokking Beyond Algorithmic Data","created":"2022-10-03","cited_by_count":146},{"id":"2310.13018","title":"Getting aligned on representational alignment","created":"2023-10-18","cited_by_count":143},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2209.02535","title":"Analyzing Transformers in Embedding Space","created":"2022-09-06","cited_by_count":132},{"id":"2207.13243","title":"Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks","created":"2022-07-27","cited_by_count":129},{"id":"2206.12654","title":"BackdoorBench: A Comprehensive Benchmark of Backdoor Learning","created":"2022-06-25","cited_by_count":128},{"id":"2401.14446","title":"Black-Box Access is Insufficient for Rigorous AI Audits","created":"2024-01-25","cited_by_count":126},{"id":"2111.09259","title":"Acquisition of Chess Knowledge in AlphaZero","created":"2021-11-17","cited_by_count":123},{"id":"2311.04897","title":"Future Lens: Anticipating Subsequent Tokens from a Single Hidden State","created":"2023-11-08","cited_by_count":121},{"id":"2006.13155","title":"Logical Neural Networks","created":"2020-06-23","cited_by_count":119},{"id":"2306.12672","title":"From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought","created":"2023-06-22","cited_by_count":119},{"id":"2402.14735","title":"How Transformers Learn Causal Structure with Gradient Descent","created":"2024-02-22","cited_by_count":118}],"next_cursor":"100"}