{"total":52,"rows":[{"id":"2106.04619","title":"Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style","created":"2021-06-08","cited_by_count":312,"area":null},{"id":"2110.05025","title":"Self-supervised Learning is More Robust to Dataset Imbalance","created":"2021-10-11","cited_by_count":123,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2203.13457","title":"Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap","created":"2022-03-25","cited_by_count":105,"area":null},{"id":"2202.14037","title":"Understanding Contrastive Learning Requires Incorporating Inductive Biases","created":"2022-02-28","cited_by_count":96,"area":null},{"id":"2303.04245","title":"How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding","created":"2023-03-07","cited_by_count":86,"area":null},{"id":"2106.09226","title":"Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning","created":"2021-06-17","cited_by_count":82,"area":null},{"id":"2204.00570","title":"Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain Adaptation","created":"2022-04-01","cited_by_count":67,"area":null},{"id":"2106.09943","title":"Investigating the Role of Negatives in Contrastive Representation Learning","created":"2021-06-18","cited_by_count":54,"area":null},{"id":"2201.12498","title":"Investigating Why Contrastive Learning Benefits Robustness Against Label Noise","created":"2022-01-29","cited_by_count":46,"area":null},{"id":"2204.02683","title":"Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulations","created":"2022-04-06","cited_by_count":44,"area":null},{"id":"2211.14699","title":"A Theoretical Study of Inductive Biases in Contrastive Learning","created":"2022-11-27","cited_by_count":40,"area":null},{"id":"2302.02774","title":"The SSL Interplay: Augmentations, Inductive Bias, and Generalization","created":"2023-02-06","cited_by_count":40,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2209.06235","title":"Improving Self-Supervised Learning by Characterizing Idealized Representations","created":"2022-09-13","cited_by_count":34,"area":null},{"id":"2305.16536","title":"Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression","created":"2023-05-25","cited_by_count":30,"area":null},{"id":"2310.00927","title":"Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP","created":"2023-10-02","cited_by_count":26,"area":null},{"id":"2302.12383","title":"Generalization Analysis for Contrastive Representation Learning","created":"2023-02-24","cited_by_count":25,"area":null},{"id":"2302.09195","title":"Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least","created":"2023-02-18","cited_by_count":22,"area":null},{"id":"2303.01566","title":"On the Provable Advantage of Unsupervised Pretraining","created":"2023-03-02","cited_by_count":22,"area":null},{"id":"2311.03524","title":"A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised Learning","created":"2023-11-06","cited_by_count":22,"area":null},{"id":"2305.17326","title":"Matrix Information Theory for Self-Supervised Learning","created":"2023-05-27","cited_by_count":21,"area":null},{"id":"2308.05017","title":"When and How Does Known Class Help Discover Unknown Ones? Provable Understanding Through Spectral Analysis","created":"2023-08-09","cited_by_count":21,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2210.00638","title":"What shapes the loss landscape of self-supervised learning?","created":"2022-10-02","cited_by_count":19,"area":null},{"id":"2206.03826","title":"Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks","created":"2022-06-08","cited_by_count":18,"area":null},{"id":"2309.17281","title":"Information Flow in Self-Supervised Learning","created":"2023-09-29","cited_by_count":16,"area":null},{"id":"2406.13371","title":"Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment","created":"2024-06-19","cited_by_count":12,"area":null},{"id":"2111.02599","title":"Leveraging Time Irreversibility with Order-Contrastive Pre-training","created":"2021-11-04","cited_by_count":7,"area":null},{"id":"2410.04959","title":"Collapse-Proof Non-Contrastive Self-Supervised Learning","created":"2024-10-07","cited_by_count":7,"area":null},{"id":"2212.13425","title":"GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning","created":"2022-12-27","cited_by_count":6,"area":null},{"id":"2304.00395","title":"Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis","created":"2023-04-01","cited_by_count":6,"area":null},{"id":"2502.16849","title":"Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models","created":"2025-02-24","cited_by_count":6,"area":null},{"id":"2204.08226","title":"Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey","created":"2022-04-18","cited_by_count":5,"area":null},{"id":"2503.17538","title":"A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics","created":"2025-03-21","cited_by_count":5,"area":null},{"id":"2511.03114","title":"An Augmentation Overlap Theory of Contrastive Learning","created":"2025-11-05","cited_by_count":5,"area":null},{"id":"2202.09305","title":"Masked prediction tasks: a parameter identifiability view","created":"2022-02-18","cited_by_count":4,"area":null},{"id":"2310.04971","title":"Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift","created":"2023-10-08","cited_by_count":4,"area":null},{"id":"2103.02740","title":"Contrastive learning of strong-mixing continuous-time stochastic processes","created":"2021-03-03","cited_by_count":3,"area":null},{"id":"2203.03539","title":"Understanding The Robustness of Self-supervised Learning Through Topic Modeling","created":"2022-02-02","cited_by_count":3,"area":null},{"id":"2409.18205","title":"Bridging OOD Detection and Generalization: A Graph-Theoretic View","created":"2024-09-26","cited_by_count":3,"area":null},{"id":"2310.00729","title":"Spectral Neural Networks: Approximation Theory and Optimization Landscape","created":"2023-10-01","cited_by_count":2,"area":null},{"id":"2401.00873","title":"Unifying Self-Supervised Clustering and Energy-Based Models","created":"2023-12-30","cited_by_count":2,"area":null},{"id":"2401.03214","title":"Understanding Representation Learnability of Nonlinear Self-Supervised Learning","created":"2024-01-06","cited_by_count":2,"area":null},{"id":"2407.21740","title":"Beyond Spectral Decomposition: Bayesian Contrastive Learning and its Non-negative Formulation via Factor Analysis","created":"2024-07-31","cited_by_count":2,"area":null},{"id":"2307.02078","title":"Graph Contrastive Topic Model","created":"2023-07-05","cited_by_count":1,"area":null},{"id":"2310.06221","title":"Detecting and Learning Out-of-Distribution Data in the Open world: Algorithm and Theory","created":"2023-10-10","cited_by_count":1,"area":null},{"id":"2403.08673","title":"When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis?","created":"2024-03-13","cited_by_count":1,"area":null},{"id":"2309.02651","title":"Contrastive Learning as Kernel Approximation","created":"2023-09-06","cited_by_count":0,"area":null},{"id":"2410.00699","title":"Investigating the Impact of Model Complexity in Large Language Models","created":"2024-10-01","cited_by_count":0,"area":null}],"next_cursor":null}