{"list":"other","total":52,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1612.00796","title":"Overcoming catastrophic forgetting in neural networks","created":"2016-12-02","cited_by_count":4787},{"id":"1703.01365","title":"Axiomatic Attribution for Deep Networks","created":"2017-03-04","cited_by_count":3384},{"id":"1705.03551","title":"TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension","created":"2017-05-09","cited_by_count":2955},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"1704.05426","title":"A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference","created":"2017-04-18","cited_by_count":2682},{"id":"1312.6034","title":"Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps","created":"2013-12-20","cited_by_count":2371},{"id":"1509.01626","title":"Character-level Convolutional Networks for Text Classification","created":"2015-09-04","cited_by_count":2330},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"1910.07467","title":"Root Mean Square Layer Normalization","created":"2019-10-16","cited_by_count":1480},{"id":"2202.12837","title":"Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?","created":"2022-02-25","cited_by_count":1434},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"2102.09690","title":"Calibrate Before Use: Improving Few-Shot Performance of Language Models","created":"2021-02-19","cited_by_count":1392},{"id":"2101.06804","title":"What Makes Good In-Context Examples for GPT-$3$?","created":"2021-01-17","cited_by_count":1195},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"1706.03825","title":"SmoothGrad: removing noise by adding noise","created":"2017-06-12","cited_by_count":1109},{"id":"2210.07229","title":"Mass-Editing Memory in a Transformer","created":"2022-10-13","cited_by_count":1001},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"1503.05671","title":"Optimizing Neural Networks with Kronecker-factored Approximate Curvature","created":"2015-03-19","cited_by_count":796},{"id":"2212.03827","title":"Discovering Latent Knowledge in Language Models Without Supervision","created":"2022-12-07","cited_by_count":767},{"id":"2304.14997","title":"Towards Automated Circuit Discovery for Mechanistic Interpretability","created":"2023-04-28","cited_by_count":724},{"id":"2111.09832","title":"Merging Models with Fisher-Weighted Averaging","created":"2021-11-18","cited_by_count":621},{"id":"1412.1193","title":"New insights and perspectives on the natural gradient method","created":"2014-12-03","cited_by_count":443},{"id":"1909.02027","title":"An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction","created":"2019-09-04","cited_by_count":386},{"id":"2308.03296","title":"Studying Large Language Model Generalization with Influence Functions","created":"2023-08-07","cited_by_count":326},{"id":"1606.05386","title":"Model-Agnostic Interpretability of Machine Learning","created":"2016-06-16","cited_by_count":219},{"id":"1905.12558","title":"Limitations of the Empirical Fisher Approximation for Natural Gradient Descent","created":"2019-05-29","cited_by_count":217},{"id":"1902.03545","title":"Task2Vec: Task Embedding for Meta-Learning","created":"2019-02-10","cited_by_count":205},{"id":"2305.00586","title":"How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model","created":"2023-04-30","cited_by_count":202},{"id":"2211.04486","title":"Active Example Selection for In-Context Learning","created":"2022-11-08","cited_by_count":196},{"id":"2207.00112","title":"Language model compression with weighted low-rank factorization","created":"2022-06-30","cited_by_count":195},{"id":"2308.08742","title":"PMET: Precise Model Editing in a Transformer","created":"2023-08-17","cited_by_count":173},{"id":"2204.09656","title":"A Fast Post-Training Pruning Framework for Transformers","created":"2022-03-29","cited_by_count":162},{"id":"1301.3584","title":"Revisiting Natural Gradient for Deep Networks","created":"2013-01-16","cited_by_count":159},{"id":"2209.05364","title":"If Influence Functions are the Answer, Then What is the Question?","created":"2022-09-12","cited_by_count":144},{"id":"2202.07206","title":"Impact of Pretraining Term Frequencies on Few-Shot Reasoning","created":"2022-02-15","cited_by_count":142},{"id":"1602.01407","title":"A Kronecker-factored approximate Fisher matrix for convolution layers","created":"2016-02-03","cited_by_count":141},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2108.00708","title":"Group Fisher Pruning for Practical Network Compression","created":"2021-08-02","cited_by_count":131},{"id":"1801.05787","title":"Faster gaze prediction with dense networks and Fisher pruning","created":"2018-01-17","cited_by_count":94},{"id":"1711.08856","title":"Critical Learning Periods in Deep Neural Networks","created":"2017-11-24","cited_by_count":79},{"id":"1906.07774","title":"On the interplay between noise and curvature and its effect on optimization and generalization","created":"2019-06-18","cited_by_count":44},{"id":"2102.11673","title":"Measuring Data Leakage in Machine-Learning Models with Fisher Information","created":"2021-02-23","cited_by_count":33},{"id":"2211.14133","title":"PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices","created":"2022-11-25","cited_by_count":24},{"id":"2107.04205","title":"On the Variance of the Fisher Information for Deep Learning","created":"2021-07-09","cited_by_count":22},{"id":"2002.06015","title":"Scalable and Practical Natural Gradient for Large-Scale Deep Learning","created":"2020-02-13","cited_by_count":15},{"id":"2201.10285","title":"Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition","created":"2022-01-25","cited_by_count":9},{"id":"1706.04371","title":"A survey of dimensionality reduction techniques based on random projection","created":"2017-06-14","cited_by_count":8},{"id":"2202.09518","title":"Distributed Out-of-Memory NMF on CPU/GPU Architectures","created":"2022-02-19","cited_by_count":2}],"next_cursor":null}