{"list":"other","total":51,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1505.04597","title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","created":"2015-05-18","cited_by_count":19713},{"id":"2002.05709","title":"A Simple Framework for Contrastive Learning of Visual Representations","created":"2020-02-13","cited_by_count":12049},{"id":"2111.06377","title":"Masked Autoencoders Are Scalable Vision Learners","created":"2021-11-11","cited_by_count":7403},{"id":"2104.14294","title":"Emerging Properties in Self-Supervised Vision Transformers","created":"2021-04-29","cited_by_count":6968},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2103.03230","title":"Barlow Twins: Self-Supervised Learning via Redundancy Reduction","created":"2021-03-04","cited_by_count":1838},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1902.09229","title":"A Theoretical Analysis of Contrastive Unsupervised Representation Learning","created":"2019-02-25","cited_by_count":530},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"2106.04156","title":"Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss","created":"2021-06-08","cited_by_count":313},{"id":"2109.13916","title":"Unsolved Problems in ML Safety","created":"2021-09-28","cited_by_count":292},{"id":"2002.04486","title":"Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss","created":"2020-02-11","cited_by_count":268},{"id":"1610.04794","title":"Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering","created":"2016-10-15","cited_by_count":237},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150},{"id":"2007.13916","title":"Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases","created":"2020-07-28","cited_by_count":143},{"id":"2010.01092","title":"On the linearity of large non-linear models: when and why the tangent kernel is constant","created":"2020-10-02","cited_by_count":129},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57},{"id":"2402.11337","title":"Learning by Reconstruction Produces Uninformative Features For Perception","created":"2024-02-17","cited_by_count":55},{"id":"1901.08168","title":"Loss Landscapes of Regularized Linear Autoencoders","created":"2019-01-23","cited_by_count":46},{"id":"2007.10099","title":"Early Stopping in Deep Networks: Double Descent and How to Eliminate it","created":"2020-07-20","cited_by_count":41},{"id":"2302.02774","title":"The SSL Interplay: Augmentations, Inductive Bias, and Generalization","created":"2023-02-06","cited_by_count":40},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35},{"id":"2210.01883","title":"Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions","created":"2022-10-04","cited_by_count":32},{"id":"2201.02115","title":"The dynamics of representation learning in shallow, non-linear autoencoders","created":"2022-01-06","cited_by_count":27},{"id":"2007.06731","title":"Regularized linear autoencoders recover the principal components, eventually","created":"2020-07-13","cited_by_count":26},{"id":"2110.02501","title":"On the Surrogate Gap between Contrastive and Supervised Losses","created":"2021-10-06","cited_by_count":25},{"id":"2303.01566","title":"On the Provable Advantage of Unsupervised Pretraining","created":"2023-03-02","cited_by_count":22},{"id":"1910.04464","title":"PAC-Bayesian Contrastive Unsupervised Representation Learning","created":"2019-10-10","cited_by_count":20},{"id":"2111.06063","title":"On the Equivalence between Neural Network and Support Vector Machine","created":"2021-11-11","cited_by_count":17},{"id":"2305.17297","title":"Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers","created":"2023-05-26","cited_by_count":14},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14},{"id":"2309.02028","title":"Non-Parametric Representation Learning with Kernels","created":"2023-09-05","cited_by_count":11},{"id":"2403.06871","title":"On the Generalization Ability of Unsupervised Pretraining","created":"2024-03-11","cited_by_count":8},{"id":"2412.00537","title":"Exact Certification of (Graph) Neural Networks Against Label Poisoning","created":"2024-11-30","cited_by_count":6},{"id":"2412.03486","title":"Tight PAC-Bayesian Risk Certificates for Contrastive Learning","created":"2024-12-04","cited_by_count":6},{"id":"2411.01767","title":"A Theoretical Characterization of Optimal Data Augmentations in Self-Supervised Learning","created":"2024-11-04","cited_by_count":4},{"id":"2411.11176","title":"Infinite Width Limits of Self Supervised Neural Networks","created":"2024-11-17","cited_by_count":4},{"id":"2212.01046","title":"Improved Representation Learning Through Tensorized Autoencoders","created":"2022-12-02","cited_by_count":1},{"id":"2412.03471","title":"Cluster Specific Representation Learning","created":"2024-12-04","cited_by_count":1}],"next_cursor":null}