{"list":"other","total":62,"rows":[{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2004.11362","title":"Supervised Contrastive Learning","created":"2020-04-23","cited_by_count":2829},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2110.08207","title":"Multitask Prompted Training Enables Zero-Shot Task Generalization","created":"2021-10-15","cited_by_count":1470},{"id":"1707.08114","title":"A Survey on Multi-Task Learning","created":"2017-07-25","cited_by_count":840},{"id":"1706.05098","title":"An Overview of Multi-Task Learning in Deep Neural Networks","created":"2017-06-15","cited_by_count":803},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"2102.07078","title":"Exploiting Shared Representations for Personalized Federated Learning","created":"2021-02-14","cited_by_count":541},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"2009.09796","title":"Multi-Task Learning with Deep Neural Networks: A Survey","created":"2020-09-10","cited_by_count":375},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"2003.02218","title":"The large learning rate phase of deep learning: the catapult mechanism","created":"2020-03-04","cited_by_count":216},{"id":"2002.09434","title":"Few-Shot Learning via Learning the Representation, Provably","created":"2020-02-21","cited_by_count":214},{"id":"1505.06279","title":"The Benefit of Multitask Representation Learning","created":"2015-05-23","cited_by_count":195},{"id":"2101.11038","title":"Muppet: Massive Multi-task Representations with Pre-Finetuning","created":"2021-01-26","cited_by_count":192},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2006.11650","title":"On the Theory of Transfer Learning: The Importance of Task Diversity","created":"2020-06-20","cited_by_count":186},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"1907.04595","title":"Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks","created":"2019-07-10","cited_by_count":162},{"id":"2002.11684","title":"Provable Meta-Learning of Linear Representations","created":"2020-02-26","cited_by_count":161},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"1811.08888","title":"Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks","created":"2018-11-21","cited_by_count":141},{"id":"2104.04670","title":"Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections","created":"2021-04-10","cited_by_count":128},{"id":"1909.12292","title":"Polylogarithmic width suffices for gradient descent to achieve arbitrarily small test error with shallow ReLU networks","created":"2019-09-26","cited_by_count":121},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119},{"id":"2303.02861","title":"Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning","created":"2023-03-06","cited_by_count":115},{"id":"2005.00944","title":"Understanding and Improving Information Transfer in Multi-Task Learning","created":"2020-05-02","cited_by_count":114},{"id":"1910.01619","title":"Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks","created":"2019-10-03","cited_by_count":79},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47},{"id":"2105.02221","title":"How Fine-Tuning Allows for Effective Meta-Learning","created":"2021-05-05","cited_by_count":41},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35},{"id":"1911.01462","title":"Time/Accuracy Tradeoffs for Learning a ReLU with respect to Gaussian Marginals","created":"2019-11-04","cited_by_count":32},{"id":"2202.03483","title":"MAML and ANIL Provably Learn Representations","created":"2022-02-07","cited_by_count":30},{"id":"1902.02880","title":"Mean Field Limit of the Learning Dynamics of Multilayer Neural Networks","created":"2019-02-07","cited_by_count":25},{"id":"2003.04180","title":"Approximate is Good Enough: Probabilistic Variants of Dimensional and Margin Complexity","created":"2020-03-09","cited_by_count":25},{"id":"2105.08306","title":"Sample Efficient Linear Meta-Learning by Alternating Minimization","created":"2021-05-18","cited_by_count":25},{"id":"2001.02992","title":"Poly-time universality and limitations of deep learning","created":"2020-01-07","cited_by_count":23},{"id":"2105.14989","title":"Representation Learning Beyond Linear Prediction Functions","created":"2021-05-31","cited_by_count":21},{"id":"2201.06142","title":"Towards Sample-efficient Overparameterized Meta-learning","created":"2022-01-16","cited_by_count":21},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17},{"id":"2108.00207","title":"The Separation Capacity of Random Neural Networks","created":"2021-07-31","cited_by_count":14},{"id":"2202.00911","title":"Active Multi-Task Representation Learning","created":"2022-02-02","cited_by_count":14},{"id":"2208.02789","title":"Feature selection with gradient descent on two-layer networks in low-rotation regimes","created":"2022-08-04","cited_by_count":14},{"id":"2105.05001","title":"FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis","created":"2021-05-11","cited_by_count":13},{"id":"2106.15615","title":"A Representation Learning Perspective on the Importance of Train-Validation Splitting in Meta-Learning","created":"2021-06-29","cited_by_count":12},{"id":"2107.10868","title":"Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time","created":"2021-07-22","cited_by_count":10},{"id":"2205.14818","title":"Excess Risk of Two-Layer ReLU Neural Networks in Teacher-Student Settings and its Superiority to Kernel Methods","created":"2022-05-30","cited_by_count":10},{"id":"2106.15367","title":"MAML is a Noisy Contrastive Learner in Classification","created":"2021-06-29","cited_by_count":9},{"id":"2008.08059","title":"When Hardness of Approximation Meets Hardness of Learning","created":"2020-08-18","cited_by_count":7},{"id":"2210.11618","title":"Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve","created":"2022-10-20","cited_by_count":1}],"next_cursor":null}