{"list":"other","total":52,"rows":[{"id":"2006.07733","title":"Bootstrap your own latent: A new approach to self-supervised Learning","created":"2020-06-13","cited_by_count":4750},{"id":"2011.10566","title":"Exploring Simple Siamese Representation Learning","created":"2020-11-20","cited_by_count":2866},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"1810.02340","title":"SNIP: Single-shot Network Pruning based on Connection Sensitivity","created":"2018-10-04","cited_by_count":812},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"2011.00362","title":"A Survey on Contrastive Self-supervised Learning","created":"2020-10-31","cited_by_count":554},{"id":"2006.05467","title":"Pruning neural networks without any data by iteratively conserving synaptic flow","created":"2020-06-09","cited_by_count":479},{"id":"2002.07376","title":"Picking Winning Tickets Before Training by Preserving Gradient Flow","created":"2020-02-18","cited_by_count":471},{"id":"2403.19647","title":"Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models","created":"2024-03-28","cited_by_count":435},{"id":"2405.07987","title":"The Platonic Representation Hypothesis","created":"2024-05-13","cited_by_count":382},{"id":"2010.10144","title":"Keystroke Dynamics as Part of Lifelogging","created":"2020-10-20","cited_by_count":334},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316},{"id":"1911.13299","title":"What's Hidden in a Randomly Weighted Neural Network?","created":"2019-11-29","cited_by_count":237},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230},{"id":"2405.14860","title":"Not All Language Model Features Are One-Dimensionally Linear","created":"2024-05-23","cited_by_count":212},{"id":"1905.01067","title":"Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask","created":"2019-05-03","cited_by_count":207},{"id":"2002.00585","title":"Proving the Lottery Ticket Hypothesis: Pruning is All You Need","created":"2020-02-03","cited_by_count":201},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2009.08576","title":"Pruning Neural Networks at Initialization: Why are We Missing the Mark?","created":"2020-09-18","cited_by_count":182},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156},{"id":"2210.01117","title":"Omnigrok: Grokking Beyond Algorithmic Data","created":"2022-10-03","cited_by_count":146},{"id":"2302.03025","title":"A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations","created":"2023-02-06","cited_by_count":144},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124},{"id":"1906.02773","title":"One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers","created":"2019-06-06","cited_by_count":102},{"id":"2401.12181","title":"Universal Neurons in GPT2 Language Models","created":"2024-01-22","cited_by_count":102},{"id":"2206.04817","title":"The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon","created":"2022-06-10","cited_by_count":94},{"id":"1911.02969","title":"BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance","created":"2019-11-07","cited_by_count":89},{"id":"2404.07129","title":"What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation","created":"2024-04-10","cited_by_count":89},{"id":"2006.07990","title":"Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient","created":"2020-06-14","cited_by_count":81},{"id":"2312.09230","title":"Successor Heads: Recurring, Interpretable Attention Heads In The Wild","created":"2023-12-14","cited_by_count":77},{"id":"2006.12156","title":"Logarithmic Pruning is All You Need","created":"2020-06-22","cited_by_count":71},{"id":"2103.09377","title":"Multi-Prize Lottery Ticket Hypothesis: Finding Accurate Binary Neural Networks by Pruning A Randomly Weighted Network","created":"2021-03-17","cited_by_count":55},{"id":"2004.10802","title":"A Neural Scaling Law from the Dimension of the Data Manifold","created":"2020-04-22","cited_by_count":52},{"id":"2303.06173","title":"Unifying Grokking and Double Descent","created":"2023-03-10","cited_by_count":50},{"id":"2402.02364","title":"Loss Landscape Degeneracy and Stagewise Development in Transformers","created":"2024-02-04","cited_by_count":40},{"id":"2303.14151","title":"Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle","created":"2023-03-24","cited_by_count":37},{"id":"2103.16547","title":"The Elastic Lottery Ticket Hypothesis","created":"2021-03-30","cited_by_count":23},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23},{"id":"2308.09543","title":"Latent State Models of Training Dynamics","created":"2023-08-18","cited_by_count":16},{"id":"2402.09142","title":"When Representations Align: Universality in Representation Learning Dynamics","created":"2024-02-14","cited_by_count":10},{"id":"2106.03485","title":"Redundant representations help generalization in wide neural networks","created":"2021-06-07","cited_by_count":9},{"id":"2206.01378","title":"Regularization-wise double descent: Why it occurs and how to eliminate it","created":"2022-06-03","cited_by_count":9},{"id":"2402.05164","title":"A Resource Model For Neural Scaling Law","created":"2024-02-07","cited_by_count":9},{"id":"2402.02619","title":"Understanding Addition and Subtraction in Transformers","created":"2024-02-04","cited_by_count":8},{"id":"2311.00863","title":"Training Dynamics of Contextual N-Grams in Language Models","created":"2023-11-01","cited_by_count":7},{"id":"2402.05916","title":"GenEFT: Understanding Statics and Dynamics of Model Generalization via Effective Theory","created":"2024-02-08","cited_by_count":4}],"next_cursor":null}