{"list":"other","total":85,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"2210.07229","title":"Mass-Editing Memory in a Transformer","created":"2022-10-13","cited_by_count":1001},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2111.02080","title":"An Explanation of In-context Learning as Implicit Bayesian Inference","created":"2021-11-03","cited_by_count":938},{"id":"2403.08295","title":"Gemma: Open Models Based on Gemini Research and Technology","created":"2024-03-13","cited_by_count":916},{"id":"2302.00093","title":"Large Language Models Can Be Easily Distracted by Irrelevant Context","created":"2023-01-31","cited_by_count":841},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"2211.09527","title":"Ignore Previous Prompt: Attack Techniques For Language Models","created":"2022-11-17","cited_by_count":832},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715},{"id":"2306.05499","title":"Prompt Injection attack against LLM-integrated Applications","created":"2023-06-08","cited_by_count":605},{"id":"2104.08696","title":"Knowledge Neurons in Pretrained Transformers","created":"2021-04-18","cited_by_count":601},{"id":"2104.08164","title":"Editing Factual Knowledge in Language Models","created":"2021-04-16","cited_by_count":553},{"id":"2304.14767","title":"Dissecting Recall of Factual Associations in Auto-Regressive Language Models","created":"2023-04-28","cited_by_count":528},{"id":"2306.11698","title":"DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models","created":"2023-06-20","cited_by_count":518},{"id":"2110.11309","title":"Fast Model Editing at Scale","created":"2021-10-21","cited_by_count":498},{"id":"2305.13860","title":"Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study","created":"2023-05-23","cited_by_count":498},{"id":"2008.03703","title":"What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation","created":"2020-08-09","cited_by_count":497},{"id":"2008.02217","title":"Hopfield Networks is All You Need","created":"2020-07-16","cited_by_count":475},{"id":"1906.05271","title":"Does Learning Require Memorization? A Short Tale about a Long Tail","created":"2019-06-12","cited_by_count":460},{"id":"2206.06520","title":"Memory-Based Model Editing at Scale","created":"2022-06-13","cited_by_count":447},{"id":"2106.02997","title":"Causal Abstractions of Neural Networks","created":"2021-06-06","cited_by_count":422},{"id":"2310.01558","title":"Making Retrieval-Augmented Language Models Robust to Irrelevant Context","created":"2023-10-02","cited_by_count":369},{"id":"2205.09712","title":"Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning","created":"2022-05-19","cited_by_count":334},{"id":"2306.04637","title":"Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection","created":"2023-06-07","cited_by_count":298},{"id":"2305.16367","title":"Role-Play with Large Language Models","created":"2023-05-25","cited_by_count":294},{"id":"2305.12740","title":"Can We Edit Factual Knowledge by In-Context Learning?","created":"2023-05-22","cited_by_count":285},{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270},{"id":"2301.04213","title":"Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models","created":"2023-01-10","cited_by_count":243},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230},{"id":"2302.12095","title":"On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective","created":"2023-02-22","cited_by_count":211},{"id":"2303.02536","title":"Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations","created":"2023-03-05","cited_by_count":209},{"id":"2005.04611","title":"How Context Affects Language Models' Factual Predictions","created":"2020-05-10","cited_by_count":181},{"id":"2306.00802","title":"Birth of a Transformer: A Memory Viewpoint","created":"2023-06-01","cited_by_count":161},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156},{"id":"2307.15771","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","created":"2023-07-28","cited_by_count":156},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144},{"id":"2309.14402","title":"Physics of Language Models: Part 3.2, Knowledge Manipulation","created":"2023-09-25","cited_by_count":143},{"id":"2402.11004","title":"The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains","created":"2024-02-16","cited_by_count":118},{"id":"2402.14735","title":"How Transformers Learn Causal Structure with Gradient Descent","created":"2024-02-22","cited_by_count":118},{"id":"2310.13345","title":"An LLM can Fool Itself: A Prompt-Based Adversarial Attack","created":"2023-10-20","cited_by_count":116},{"id":"2112.00826","title":"Inducing Causal Structure for Interpretable Neural Networks","created":"2021-12-01","cited_by_count":110},{"id":"2206.04301","title":"Unveiling Transformers with LEGO: a synthetic reasoning task","created":"2022-06-09","cited_by_count":106},{"id":"2305.08809","title":"Interpretability at Scale: Identifying Causal Mechanisms in Alpaca","created":"2023-05-15","cited_by_count":103},{"id":"2305.16380","title":"Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer","created":"2023-05-25","cited_by_count":102},{"id":"2303.04245","title":"How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding","created":"2023-03-07","cited_by_count":86},{"id":"2403.03867","title":"On the Origins of Linear Representations in Large Language Models","created":"2024-03-06","cited_by_count":79},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74},{"id":"2212.14315","title":"\"Real Attackers Don't Compute Gradients\": Bridging the Gap Between Adversarial ML Research and Practice","created":"2022-12-29","cited_by_count":56},{"id":"2202.04557","title":"Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models","created":"2022-02-09","cited_by_count":55},{"id":"2310.00535","title":"JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention","created":"2023-10-01","cited_by_count":52},{"id":"1909.12362","title":"Overparameterized Neural Networks Implement Associative Memory","created":"2019-09-26","cited_by_count":45},{"id":"2403.04786","title":"Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models","created":"2024-03-03","cited_by_count":44},{"id":"2309.12673","title":"On Sparse Modern Hopfield Model","created":"2023-09-22","cited_by_count":42},{"id":"2402.04520","title":"On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis","created":"2024-02-07","cited_by_count":41},{"id":"2306.02010","title":"Memorization Capacity of Multi-Head Attention in Transformers","created":"2023-06-03","cited_by_count":40},{"id":"2402.04161","title":"Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains","created":"2024-02-06","cited_by_count":40},{"id":"2404.03827","title":"Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models","created":"2024-04-04","cited_by_count":38},{"id":"2404.03828","title":"Outlier-Efficient Hopfield Layers for Large Transformer-Based Models","created":"2024-04-04","cited_by_count":38},{"id":"2310.02984","title":"Scaling Laws for Associative Memories","created":"2023-10-04","cited_by_count":35},{"id":"2312.17346","title":"STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction","created":"2023-12-28","cited_by_count":35},{"id":"2402.13512","title":"From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers","created":"2024-02-21","cited_by_count":34},{"id":"2403.08081","title":"Mechanics of Next Token Prediction with Self-Attention","created":"2024-03-12","cited_by_count":34},{"id":"2209.03463","title":"Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbots","created":"2022-09-07","cited_by_count":33},{"id":"2310.07343","title":"How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances","created":"2023-10-11","cited_by_count":33},{"id":"2111.05498","title":"Attention Approximates Sparse Distributed Memory","created":"2021-11-10","cited_by_count":29},{"id":"2402.09236","title":"Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Models","created":"2024-02-14","cited_by_count":29},{"id":"2405.20653","title":"Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundaries","created":"2024-05-31","cited_by_count":28},{"id":"2109.12393","title":"Sorting through the noise: Testing robustness of information processing in pre-trained language models","created":"2021-09-25","cited_by_count":27},{"id":"2309.05605","title":"Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models","created":"2023-09-11","cited_by_count":21},{"id":"2211.00170","title":"What is my math transformer doing? -- Three results on interpretability and generalization","created":"2022-10-31","cited_by_count":19},{"id":"2403.08699","title":"Implicit Regularization of Gradient Flow on One-Layer Softmax Attention","created":"2024-03-13","cited_by_count":19},{"id":"2402.16123","title":"InstructEdit: Instruction-based Knowledge Editing for Large Language Models","created":"2024-02-25","cited_by_count":17},{"id":"2402.18724","title":"Learning Associative Memories with Gradient Descent","created":"2024-02-28","cited_by_count":16},{"id":"2404.03900","title":"Nonparametric Modern Hopfield Models","created":"2024-04-05","cited_by_count":16},{"id":"2311.03498","title":"In-Context Exemplars as Clues to Retrieving from Large Associative Memory","created":"2023-11-06","cited_by_count":13},{"id":"2006.16540","title":"Associative Memory in Iterated Overparameterized Sigmoid Autoencoders","created":"2020-06-30","cited_by_count":9},{"id":"2406.01514","title":"Decoupled Alignment for Robust Plug-and-Play Adaptation","created":"2024-06-03","cited_by_count":9},{"id":"2310.04680","title":"The Cost of Down-Scaling Language Models: Fact Recall Deteriorates before In-Context Learning","created":"2023-10-07","cited_by_count":7}],"next_cursor":null}