{"list":"other","total":62,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2002.05709","title":"A Simple Framework for Contrastive Learning of Visual Representations","created":"2020-02-13","cited_by_count":12049},{"id":"1807.03748","title":"Representation Learning with Contrastive Predictive Coding","created":"2018-07-10","cited_by_count":7777},{"id":"2104.14294","title":"Emerging Properties in Self-Supervised Vision Transformers","created":"2021-04-29","cited_by_count":6968},{"id":"2006.07733","title":"Bootstrap your own latent: A new approach to self-supervised Learning","created":"2020-06-13","cited_by_count":4750},{"id":"2011.10566","title":"Exploring Simple Siamese Representation Learning","created":"2020-11-20","cited_by_count":2866},{"id":"2006.09882","title":"Unsupervised Learning of Visual Features by Contrasting Cluster Assignments","created":"2020-06-17","cited_by_count":2857},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2103.03230","title":"Barlow Twins: Self-Supervised Learning via Redundancy Reduction","created":"2021-03-04","cited_by_count":1838},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1803.07728","title":"Unsupervised Representation Learning by Predicting Image Rotations","created":"2018-03-21","cited_by_count":1591},{"id":"2105.04906","title":"VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning","created":"2021-05-11","cited_by_count":1057},{"id":"1912.01991","title":"Self-Supervised Learning of Pretext-Invariant Representations","created":"2019-12-04","cited_by_count":808},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"1902.06162","title":"Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey","created":"2019-02-16","cited_by_count":657},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1706.08947","title":"Exploring Generalization in Deep Learning","created":"2017-06-27","cited_by_count":600},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"1902.09229","title":"A Theoretical Analysis of Contrastive Unsupervised Representation Learning","created":"2019-02-25","cited_by_count":530},{"id":"1704.06888","title":"Time-Contrastive Networks: Self-Supervised Learning from Video","created":"2017-04-23","cited_by_count":459},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2110.09348","title":"Understanding Dimensional Collapse in Contrastive Self-supervised Learning","created":"2021-10-18","cited_by_count":378},{"id":"2106.04156","title":"Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss","created":"2021-06-08","cited_by_count":313},{"id":"2007.06346","title":"Whitening for Self-Supervised Representation Learning","created":"2020-07-13","cited_by_count":279},{"id":"2205.10643","title":"Self-Supervised Speech Representation Learning: A Review","created":"2022-05-21","cited_by_count":260},{"id":"1905.13192","title":"Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels","created":"2019-05-30","cited_by_count":161},{"id":"2008.01064","title":"Predicting What You Already Know Helps: Provable Self-Supervised Learning","created":"2020-08-03","cited_by_count":152},{"id":"2205.11508","title":"Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods","created":"2022-05-23","cited_by_count":149},{"id":"2008.10150","title":"Contrastive learning, multi-view redundancy, and linear models","created":"2020-08-24","cited_by_count":146},{"id":"2010.01092","title":"On the linearity of large non-linear models: when and why the tangent kernel is constant","created":"2020-10-02","cited_by_count":129},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119},{"id":"2206.02574","title":"On the duality between contrastive and non-contrastive self-supervised learning","created":"2022-06-03","cited_by_count":108},{"id":"2106.09226","title":"Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning","created":"2021-06-17","cited_by_count":82},{"id":"2010.03648","title":"A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks","created":"2020-10-07","cited_by_count":72},{"id":"2006.10246","title":"The Recurrent Neural Tangent Kernel","created":"2020-06-18","cited_by_count":67},{"id":"1809.00846","title":"Towards Understanding Regularization in Batch Normalization","created":"2018-09-04","cited_by_count":56},{"id":"1901.08168","title":"Loss Landscapes of Regularized Linear Autoencoders","created":"2019-01-23","cited_by_count":46},{"id":"2007.10099","title":"Early Stopping in Deep Networks: Double Descent and How to Eliminate it","created":"2020-07-20","cited_by_count":41},{"id":"2302.02774","title":"The SSL Interplay: Augmentations, Inductive Bias, and Generalization","created":"2023-02-06","cited_by_count":40},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35},{"id":"2303.02387","title":"Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism","created":"2023-03-04","cited_by_count":33},{"id":"2210.01883","title":"Contrastive Learning Can Find An Optimal Basis For Approximately View-Invariant Functions","created":"2022-10-04","cited_by_count":32},{"id":"2108.05574","title":"Implicit Sparse Regularization: The Impact of Depth and Early Stopping","created":"2021-08-12","cited_by_count":30},{"id":"1804.01552","title":"Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection","created":"2018-04-04","cited_by_count":27},{"id":"2112.11450","title":"Max-Margin Contrastive Learning","created":"2021-12-21","cited_by_count":27},{"id":"2110.02501","title":"On the Surrogate Gap between Contrastive and Supervised Losses","created":"2021-10-06","cited_by_count":25},{"id":"2202.04777","title":"Exact Solutions of a Deep Linear Network","created":"2022-02-10","cited_by_count":24},{"id":"2203.15702","title":"Contrasting the landscape of contrastive and non-contrastive learning","created":"2022-03-29","cited_by_count":24},{"id":"1604.05592","title":"WarpNet: Weakly Supervised Matching for Single-view Reconstruction","created":"2016-04-19","cited_by_count":22},{"id":"2010.08508","title":"For self-supervised learning, Rationality implies generalization, provably","created":"2020-10-16","cited_by_count":22},{"id":"2303.01566","title":"On the Provable Advantage of Unsupervised Pretraining","created":"2023-03-02","cited_by_count":22},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20},{"id":"2210.00638","title":"What shapes the loss landscape of self-supervised learning?","created":"2022-10-02","cited_by_count":19},{"id":"1809.06848","title":"On the Learning Dynamics of Deep Neural Networks","created":"2018-09-18","cited_by_count":18},{"id":"2111.06063","title":"On the Equivalence between Neural Network and Support Vector Machine","created":"2021-11-11","cited_by_count":17},{"id":"1806.05413","title":"Learning Dynamics of Linear Denoising Autoencoders","created":"2018-06-14","cited_by_count":16},{"id":"1911.11983","title":"Benefits of Jointly Training Autoencoders: An Improved Neural Tangent Kernel Analysis","created":"2019-11-27","cited_by_count":13},{"id":"2209.14884","title":"Joint Embedding Self-Supervised Learning in the Kernel Regime","created":"2022-09-29","cited_by_count":12},{"id":"2206.00471","title":"Augmentation Component Analysis: Modeling Similarity via the Augmentation Overlaps","created":"2022-06-01","cited_by_count":5},{"id":"1904.10689","title":"Layer Dynamics of Linearised Neural Nets","created":"2019-04-24","cited_by_count":1},{"id":"2009.13502","title":"Simpler Grassmannian optimization","created":"2020-09-28","cited_by_count":1}],"next_cursor":null}