{"total":368,"rows":[{"id":"2403.19647","title":"Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models","created":"2024-03-28","cited_by_count":435,"area":null},{"id":"2402.10588","title":"Do Llamas Work in English? On the Latent Language of Multilingual Transformers","created":"2024-02-16","cited_by_count":281,"area":null},{"id":"2307.10169","title":"Challenges and Applications of Large Language Models","created":"2023-07-19","cited_by_count":254,"area":null},{"id":"2404.15255","title":"How to use and interpret activation patching","created":"2024-04-23","cited_by_count":214,"area":null},{"id":"2405.14860","title":"Not All Language Model Features Are One-Dimensionally Linear","created":"2024-05-23","cited_by_count":212,"area":null},{"id":"2401.01286","title":"A Comprehensive Study of Knowledge Editing for Large Language Models","created":"2024-01-02","cited_by_count":163,"area":null},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156,"area":null},{"id":"2307.15771","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","created":"2023-07-28","cited_by_count":156,"area":null},{"id":"2307.09458","title":"Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla","created":"2023-07-18","cited_by_count":149,"area":null},{"id":"2402.14811","title":"Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking","created":"2024-02-22","cited_by_count":149,"area":null},{"id":"2403.17806","title":"Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms","created":"2024-03-26","cited_by_count":149,"area":null},{"id":"2403.00824","title":"Information Flow Routes: Automatically Interpreting Language Models at Scale","created":"2024-02-27","cited_by_count":95,"area":null},{"id":"2405.00208","title":"A Primer on the Inner Workings of Transformer-based Language Models","created":"2024-04-30","cited_by_count":85,"area":null},{"id":"2406.12775","title":"Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries","created":"2024-06-18","cited_by_count":78,"area":null},{"id":"2312.09230","title":"Successor Heads: Recurring, Interpretable Attention Heads In The Wild","created":"2023-12-14","cited_by_count":77,"area":null},{"id":"2310.04625","title":"Copy Suppression: Comprehensively Understanding an Attention Head","created":"2023-10-06","cited_by_count":76,"area":null},{"id":"2409.03752","title":"Attention Heads of Large Language Models: A Survey","created":"2024-09-05","cited_by_count":67,"area":null},{"id":"2407.10827","title":"LLM Circuit Analyses Are Consistent Across Training and Scale","created":"2024-07-15","cited_by_count":63,"area":null},{"id":"2305.09863","title":"Explaining black box text modules in natural language with language models","created":"2023-05-17","cited_by_count":62,"area":null},{"id":"2406.16778","title":"Finding Transformer Circuits with Edge Pruning","created":"2024-06-24","cited_by_count":60,"area":null},{"id":"2406.16254","title":"Confidence Regulation Neurons in Language Models","created":"2024-06-24","cited_by_count":57,"area":null},{"id":"2405.15471","title":"Emergence of a High-Dimensional Abstraction Phase in Language Transformers","created":"2024-05-24","cited_by_count":56,"area":null},{"id":"2403.07809","title":"pyvene: A Library for Understanding and Improving PyTorch Models via Interventions","created":"2024-03-12","cited_by_count":54,"area":null},{"id":"2409.01658","title":"From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning","created":"2024-09-03","cited_by_count":54,"area":null},{"id":"2407.15017","title":"Knowledge Mechanisms in Large Language Models: A Survey and Perspective","created":"2024-07-22","cited_by_count":51,"area":null},{"id":"2402.11917","title":"A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task","created":"2024-02-19","cited_by_count":49,"area":null},{"id":"2405.02421","title":"What does the Knowledge Neuron Thesis Have to do with Knowledge?","created":"2024-05-03","cited_by_count":49,"area":null},{"id":"2403.08946","title":"Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era","created":"2024-03-13","cited_by_count":46,"area":null},{"id":"2309.10312","title":"Rigorously Assessing Natural Language Explanations of Neurons","created":"2023-09-19","cited_by_count":45,"area":null},{"id":"2507.16003","title":"Learning without training: The implicit dynamics of in-context learning","created":"2025-07-21","cited_by_count":43,"area":null},{"id":"2402.07321","title":"Summing Up the Facts: Additive Mechanisms Behind Factual Recall in LLMs","created":"2024-02-11","cited_by_count":42,"area":null},{"id":"2310.04444","title":"What's the Magic Word? A Control Theory of LLM Prompting","created":"2023-10-02","cited_by_count":41,"area":null},{"id":"2505.13763","title":"Language Models Are Capable of Metacognitive Monitoring and Control of Their Internal Activations","created":"2025-05-19","cited_by_count":41,"area":null},{"id":"2402.15390","title":"Explorations of Self-Repair in Language Models","created":"2024-02-23","cited_by_count":39,"area":null},{"id":"2403.18167","title":"Mechanistic Understanding and Mitigation of Language Model Non-Factual Hallucinations","created":"2024-03-27","cited_by_count":38,"area":null},{"id":"2312.12141","title":"Neuron-Level Knowledge Attribution in Large Language Models","created":"2023-12-19","cited_by_count":37,"area":null},{"id":"2410.04962","title":"Activation Scaling for Steering and Interpreting Language Models","created":"2024-10-07","cited_by_count":35,"area":null},{"id":"2307.03637","title":"Discovering Variable Binding Circuitry with Desiderata","created":"2023-07-07","cited_by_count":34,"area":null},{"id":"2310.13121","title":"Understanding Addition in Transformers","created":"2023-10-19","cited_by_count":34,"area":null},{"id":"2410.04332","title":"Gradient Routing: Masking Gradients to Localize Computation in Neural Networks","created":"2024-10-06","cited_by_count":34,"area":null},{"id":"2504.04635","title":"Steering off Course: Reliability Challenges in Steering Language Models","created":"2025-04-06","cited_by_count":34,"area":null},{"id":"2403.19521","title":"Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models","created":"2024-03-28","cited_by_count":31,"area":null},{"id":"2502.12170","title":"MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections","created":"2025-02-13","cited_by_count":31,"area":null},{"id":"2511.08579","title":"Training Language Models to Explain Their Own Computations","created":"2025-11-11","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2309.05973","title":"Circuit Breaking: Removing Model Behaviors with Targeted Ablation","created":"2023-09-12","cited_by_count":27,"area":null},{"id":"2410.00153","title":"Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution","created":"2024-09-30","cited_by_count":27,"area":null},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25,"area":null},{"id":"2409.09951","title":"Optimal ablation for interpretability","created":"2024-09-16","cited_by_count":25,"area":null},{"id":"2312.06581","title":"Grokking Group Multiplication with Cosets","created":"2023-12-11","cited_by_count":24,"area":null},{"id":"2410.07959","title":"COMPL-AI Framework: A Technical Interpretation and LLM Benchmarking Suite for the EU Artificial Intelligence Act","created":"2024-10-10","cited_by_count":24,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2407.04690","title":"Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networks","created":"2024-07-05","cited_by_count":23,"area":null},{"id":"2407.15248","title":"XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models","created":"2024-07-21","cited_by_count":23,"area":null},{"id":"2502.11196","title":"How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training","created":"2025-02-16","cited_by_count":23,"area":null},{"id":"2404.09554","title":"Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda","created":"2024-04-15","cited_by_count":22,"area":null},{"id":"2410.04691","title":"Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning","created":"2024-10-07","cited_by_count":21,"area":null},{"id":"2502.11812","title":"Towards Understanding Fine-Tuning Mechanisms of LLMs via Circuit Analysis","created":"2025-02-17","cited_by_count":20,"area":null},{"id":"2404.11534","title":"Decomposing and Editing Predictions by Modeling Model Computation","created":"2024-04-17","cited_by_count":19,"area":null},{"id":"2406.10368","title":"A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts","created":"2024-06-14","cited_by_count":19,"area":null},{"id":"2405.03207","title":"A Philosophical Introduction to Language Models - Part II: The Way Forward","created":"2024-05-06","cited_by_count":18,"area":null},{"id":"2407.15421","title":"Planning in a recurrent neural network that plays Sokoban","created":"2024-07-22","cited_by_count":18,"area":null},{"id":"2305.14699","title":"Can Transformers Learn to Solve Problems Recursively?","created":"2023-05-24","cited_by_count":17,"area":null},{"id":"2307.01189","title":"Trainable Transformer in Transformer","created":"2023-07-03","cited_by_count":17,"area":null},{"id":"2310.03084","title":"Discovering Knowledge-Critical Subnetworks in Pretrained Language Models","created":"2023-10-04","cited_by_count":16,"area":null},{"id":"2312.02566","title":"Structured World Representations in Maze-Solving Transformers","created":"2023-12-05","cited_by_count":16,"area":null},{"id":"2404.07004","title":"LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models","created":"2024-04-10","cited_by_count":16,"area":null},{"id":"2505.17495","title":"ProxySPEX: Inference-Efficient Interpretability via Sparse Feature Interactions in LLMs","created":"2025-05-23","cited_by_count":16,"area":null},{"id":"2506.20790","title":"Stochastic Parameter Decomposition","created":"2025-06-25","cited_by_count":16,"area":null},{"id":"2403.10381","title":"Monotonic Representation of Numeric Properties in Language Models","created":"2024-03-15","cited_by_count":15,"area":null},{"id":"2502.01954","title":"Constrained belief updates explain geometric structures in transformer representations","created":"2025-02-04","cited_by_count":15,"area":null},{"id":"2502.14258","title":"Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific Information","created":"2025-02-20","cited_by_count":15,"area":null},{"id":"2402.16726","title":"Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials","created":"2024-02-26","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2406.10868","title":"Identifying Query-Relevant Neurons in Large Language Models for Long-Form Texts","created":"2024-06-16","cited_by_count":14,"area":null},{"id":"2407.03779","title":"Sheaf Discovery with Joint Computation Graph Pruning and Flexible Granularity","created":"2024-07-04","cited_by_count":14,"area":null},{"id":"2501.05382","title":"Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models","created":"2025-01-09","cited_by_count":14,"area":null},{"id":"2405.10548","title":"Language Models can Exploit Cross-Task In-context Learning for Data-Scarce Novel Tasks","created":"2024-05-17","cited_by_count":13,"area":null},{"id":"2311.04354","title":"Uncovering Intermediate Variables in Transformers using Circuit Probing","created":"2023-11-07","cited_by_count":12,"area":null},{"id":"2502.15007","title":"LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers","created":"2025-02-20","cited_by_count":12,"area":null},{"id":"2512.16856","title":"Distributional AGI Safety","created":"2025-12-18","cited_by_count":12,"area":null},{"id":"2512.18792","title":"The Dead Salmons of AI Interpretability","created":"2025-12-21","cited_by_count":12,"area":null},{"id":"2406.01352","title":"Position: An Inner Interpretability Framework for AI Inspired by Lessons from Cognitive Neuroscience","created":"2024-06-03","cited_by_count":11,"area":null},{"id":"2407.09221","title":"Evaluating AI Evaluation: Perils and Prospects","created":"2024-07-12","cited_by_count":11,"area":null},{"id":"2410.01434","title":"Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models","created":"2024-10-02","cited_by_count":11,"area":null},{"id":"2410.22244","title":"Abrupt Learning in Transformers: A Case Study on Matrix Completion","created":"2024-10-29","cited_by_count":11,"area":null},{"id":"2502.15886","title":"A Close Look at Decomposition-based XAI-Methods for Transformer Language Models","created":"2025-02-21","cited_by_count":11,"area":null},{"id":"2503.11302","title":"Are formal and functional linguistic mechanisms dissociated in language models?","created":"2025-03-14","cited_by_count":11,"area":null},{"id":"2504.07440","title":"Model Utility Law: Evaluating LLMs beyond Performance through Mechanism Interpretable Metric","created":"2025-04-10","cited_by_count":11,"area":null},{"id":"2505.11770","title":"Internal Causal Mechanisms Robustly Predict Language Model Out-of-Distribution Behaviors","created":"2025-05-17","cited_by_count":11,"area":null},{"id":"2505.15807","title":"The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation","created":"2025-05-21","cited_by_count":11,"area":null},{"id":"2403.03942","title":"The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models","created":"2024-03-06","cited_by_count":10,"area":null},{"id":"2502.11771","title":"The Validation Gap: A Mechanistic Analysis of How Language Models Compute Arithmetic but Fail to Validate It","created":"2025-02-17","cited_by_count":10,"area":null},{"id":"2504.00132","title":"Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B","created":"2025-03-31","cited_by_count":10,"area":null},{"id":"2505.16694","title":"Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence","created":"2025-05-22","cited_by_count":10,"area":null},{"id":"2601.21725","title":"Procedural Pretraining: Warming Up Language Models with Abstract Data","created":"2026-01-29","cited_by_count":10,"area":null},{"id":"2604.19117","title":"LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit","created":"2026-04-21","cited_by_count":10,"area":null},{"id":"2605.13625","title":"How to Interpret Agent Behavior","created":"2026-05-13","cited_by_count":10,"area":null},{"id":"2309.00244","title":"NeuroSurgeon: A Toolkit for Subnetwork Analysis","created":"2023-09-01","cited_by_count":9,"area":null},{"id":"2310.11431","title":"Identifying Interpretable Visual Features in Artificial and Biological Neural Systems","created":"2023-10-17","cited_by_count":9,"area":null}],"next_cursor":"100"}