{"list":"other","total":59,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"2101.00190","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","created":"2021-01-01","cited_by_count":3915},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"2305.14314","title":"QLoRA: Efficient Finetuning of Quantized LLMs","created":"2023-05-23","cited_by_count":3418},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2006.03654","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","created":"2020-06-05","cited_by_count":2181},{"id":"2106.10199","title":"BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models","created":"2021-06-18","cited_by_count":1245},{"id":"2111.02080","title":"An Explanation of In-context Learning as Implicit Bayesian Inference","created":"2021-11-03","cited_by_count":938},{"id":"2205.05638","title":"Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning","created":"2022-05-11","cited_by_count":896},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2212.07677","title":"Transformers learn in-context by gradient descent","created":"2022-12-15","cited_by_count":732},{"id":"2211.15661","title":"What learning algorithm is in-context learning? Investigations with linear models","created":"2022-11-28","cited_by_count":684},{"id":"1805.08974","title":"Do Better ImageNet Models Transfer Better?","created":"2018-05-23","cited_by_count":565},{"id":"2305.16381","title":"DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models","created":"2023-05-25","cited_by_count":450},{"id":"1310.1531","title":"DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition","created":"2013-10-06","cited_by_count":424},{"id":"1912.10077","title":"Are Transformers universal approximators of sequence-to-sequence functions?","created":"2019-12-20","cited_by_count":406},{"id":"1709.02540","title":"The Expressive Power of Neural Networks: A View from the Width","created":"2017-09-08","cited_by_count":320},{"id":"1403.6382","title":"CNN Features off-the-shelf: an Astounding Baseline for Recognition","created":"2014-03-23","cited_by_count":316},{"id":"1606.05336","title":"On the Expressive Power of Deep Neural Networks","created":"2016-06-16","cited_by_count":306},{"id":"2306.04637","title":"Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection","created":"2023-06-07","cited_by_count":298},{"id":"2306.00297","title":"Transformers learn to implement preconditioned gradient descent for in-context learning","created":"2023-06-01","cited_by_count":279},{"id":"1602.04485","title":"Benefits of depth in neural networks","created":"2016-02-14","cited_by_count":250},{"id":"2301.13196","title":"Looped Transformers as Programmable Computers","created":"2023-01-30","cited_by_count":237},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2003.00307","title":"Loss landscapes and optimization in over-parameterized non-linear systems and neural networks","created":"2020-02-29","cited_by_count":233},{"id":"2002.09434","title":"Few-Shot Learning via Learning the Representation, Provably","created":"2020-02-21","cited_by_count":214},{"id":"1505.06279","title":"The Benefit of Multitask Representation Learning","created":"2015-05-23","cited_by_count":195},{"id":"2006.11650","title":"On the Theory of Transfer Learning: The Importance of Task Diversity","created":"2020-06-20","cited_by_count":186},{"id":"1512.03965","title":"The Power of Depth for Feedforward Neural Networks","created":"2015-12-12","cited_by_count":183},{"id":"2206.06565","title":"LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks","created":"2022-06-14","cited_by_count":148},{"id":"2006.07322","title":"Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks","created":"2020-06-12","cited_by_count":138},{"id":"1901.03429","title":"On the Turing Completeness of Modern Neural Network Architectures","created":"2019-01-10","cited_by_count":129},{"id":"2303.07895","title":"The Learnability of In-Context Learning","created":"2023-03-14","cited_by_count":127},{"id":"1405.3531","title":"Return of the Devil in the Details: Delving Deep into Convolutional Nets","created":"2014-05-14","cited_by_count":122},{"id":"1906.05497","title":"Deep Network Approximation Characterized by Number of Neurons","created":"2019-06-13","cited_by_count":122},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121},{"id":"1806.11146","title":"Adversarial Reprogramming of Neural Networks","created":"2018-06-28","cited_by_count":116},{"id":"1611.04231","title":"Identity Matters in Deep Learning","created":"2016-11-14","cited_by_count":109},{"id":"2006.08859","title":"Minimum Width for Universal Approximation","created":"2020-06-16","cited_by_count":94},{"id":"1509.08101","title":"Representation Benefits of Deep Feedforward Networks","created":"2015-09-27","cited_by_count":86},{"id":"2009.14397","title":"Deep Equals Shallow for ReLU Networks in Kernel Regimes","created":"2020-09-30","cited_by_count":85},{"id":"2006.04862","title":"$O(n)$ Connections are Expressive Enough: Universal Approximability of Sparse Transformers","created":"2020-06-08","cited_by_count":83},{"id":"1610.04161","title":"Why Deep Neural Networks for Function Approximation?","created":"2016-10-13","cited_by_count":82},{"id":"1712.01473","title":"Deep linear neural networks with arbitrary loss: All local minima are global","created":"2017-12-05","cited_by_count":65},{"id":"2202.10629","title":"Model Reprogramming: Resource-Efficient Cross-Domain Machine Learning","created":"2022-02-22","cited_by_count":64},{"id":"2306.03435","title":"On the Role of Attention in Prompt-tuning","created":"2023-06-06","cited_by_count":50},{"id":"2106.03764","title":"On the Expressive Power of Self-Attention Matrices","created":"2021-06-07","cited_by_count":47},{"id":"1711.05772","title":"Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models","created":"2017-11-15","cited_by_count":39},{"id":"1702.08580","title":"Depth Creates No Bad Local Minima","created":"2017-02-27","cited_by_count":29},{"id":"2102.02336","title":"On the Approximation Power of Two-Layer Networks of Random ReLUs","created":"2021-02-03","cited_by_count":29},{"id":"1702.07028","title":"On the ability of neural nets to express distributions","created":"2017-02-22","cited_by_count":26},{"id":"2310.13571","title":"Why Can Large Language Models Generate Correct Chain-of-Thoughts?","created":"2023-10-20","cited_by_count":16},{"id":"2206.03466","title":"Adversarial Reprogramming Revisited","created":"2022-06-07","cited_by_count":10},{"id":"2201.02692","title":"Improved Input Reprogramming for GAN Conditioning","created":"2022-01-07","cited_by_count":7}],"next_cursor":null}