{"total":112,"rows":[{"id":"2205.11508","title":"Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods","created":"2022-05-23","cited_by_count":149,"area":null},{"id":"2203.12221","title":"Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)","created":"2022-03-23","cited_by_count":122,"area":null},{"id":"2206.02574","title":"On the duality between contrastive and non-contrastive self-supervised learning","created":"2022-06-03","cited_by_count":108,"area":null},{"id":"2111.00743","title":"Towards the Generalization of Contrastive Self-Supervised Learning","created":"2021-11-01","cited_by_count":99,"area":null},{"id":"2202.14037","title":"Understanding Contrastive Learning Requires Incorporating Inductive Biases","created":"2022-02-28","cited_by_count":96,"area":null},{"id":"2210.09221","title":"Vision Transformers provably learn spatial structure","created":"2022-10-13","cited_by_count":93,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2110.02473","title":"The Power of Contrast for Feature Learning: A Theoretical Analysis","created":"2021-10-06","cited_by_count":53,"area":null},{"id":"2303.13664","title":"Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data","created":"2023-03-23","cited_by_count":44,"area":null},{"id":"2303.15725","title":"Solving Regularized Exp, Cosh and Sinh Regression Problems","created":"2023-03-28","cited_by_count":44,"area":null},{"id":"2302.06232","title":"Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data","created":"2023-02-13","cited_by_count":43,"area":null},{"id":"2211.14699","title":"A Theoretical Study of Inductive Biases in Contrastive Learning","created":"2022-11-27","cited_by_count":40,"area":null},{"id":"2302.02774","title":"The SSL Interplay: Augmentations, Inductive Bias, and Generalization","created":"2023-02-06","cited_by_count":40,"area":null},{"id":"2407.00143","title":"InfoNCE: Identifying the Gap Between Theory and Practice","created":"2024-06-28","cited_by_count":40,"area":null},{"id":"2306.04949","title":"Robust Learning with Progressive Data Expansion Against Spurious Correlation","created":"2023-06-08","cited_by_count":39,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2211.16327","title":"On the Power of Foundation Models","created":"2022-11-29","cited_by_count":37,"area":null},{"id":"2302.07920","title":"InfoNCE Loss Provably Learns Cluster-Preserving Representations","created":"2023-02-15","cited_by_count":37,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35,"area":null},{"id":"2304.11327","title":"Understanding and Improving Feature Learning for Out-of-Distribution Generalization","created":"2023-04-22","cited_by_count":35,"area":null},{"id":"2209.06235","title":"Improving Self-Supervised Learning by Characterizing Idealized Representations","created":"2022-09-13","cited_by_count":34,"area":null},{"id":"2303.02387","title":"Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism","created":"2023-03-04","cited_by_count":33,"area":null},{"id":"2305.16536","title":"Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression","created":"2023-05-25","cited_by_count":30,"area":null},{"id":"2306.02295","title":"A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models","created":"2023-06-04","cited_by_count":29,"area":null},{"id":"2202.12230","title":"Sample Efficiency of Data Augmentation Consistency Regularization","created":"2022-02-24","cited_by_count":28,"area":null},{"id":"2205.14814","title":"Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding","created":"2022-05-30","cited_by_count":28,"area":null},{"id":"2303.00106","title":"The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning","created":"2023-02-28","cited_by_count":27,"area":null},{"id":"2310.00927","title":"Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP","created":"2023-10-02","cited_by_count":26,"area":null},{"id":"2110.02501","title":"On the Surrogate Gap between Contrastive and Supervised Losses","created":"2021-10-06","cited_by_count":25,"area":null},{"id":"2210.04561","title":"A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learning","created":"2022-10-10","cited_by_count":25,"area":null},{"id":"2203.15702","title":"Contrasting the landscape of contrastive and non-contrastive learning","created":"2022-03-29","cited_by_count":24,"area":null},{"id":"2110.04947","title":"Towards Demystifying Representation Learning with Non-contrastive Self-supervision","created":"2021-10-11","cited_by_count":23,"area":null},{"id":"2303.04435","title":"A Message Passing Perspective on Learning Dynamics of Contrastive Learning","created":"2023-03-08","cited_by_count":22,"area":null},{"id":"2305.17326","title":"Matrix Information Theory for Self-Supervised Learning","created":"2023-05-27","cited_by_count":21,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2206.03826","title":"Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks","created":"2022-06-08","cited_by_count":18,"area":null},{"id":"2310.16173","title":"On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $\\epsilon$-Greedy Exploration","created":"2023-10-24","cited_by_count":17,"area":null},{"id":"2302.02922","title":"Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks","created":"2023-02-06","cited_by_count":16,"area":null},{"id":"2307.06887","title":"Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks","created":"2023-07-13","cited_by_count":16,"area":null},{"id":"2309.17281","title":"Information Flow in Self-Supervised Learning","created":"2023-09-29","cited_by_count":16,"area":null},{"id":"2111.11398","title":"Why Do Self-Supervised Models Transfer? Investigating the Impact of Invariance on Downstream Tasks","created":"2021-11-22","cited_by_count":15,"area":null},{"id":"2312.00379","title":"Optimal Sample Complexity of Contrastive Learning","created":"2023-12-01","cited_by_count":15,"area":null},{"id":"2207.12258","title":"Equivariance and Invariance Inductive Bias for Learning from Insufficient Data","created":"2022-07-25","cited_by_count":14,"area":null},{"id":"2307.07380","title":"Composition-contrastive Learning for Sentence Embeddings","created":"2023-07-14","cited_by_count":14,"area":null},{"id":"2406.01977","title":"What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding","created":"2024-06-04","cited_by_count":14,"area":null},{"id":"2302.03357","title":"Towards Enhancing Time Series Contrastive Learning: A Dynamic Bad Pair Mining Approach","created":"2023-02-07","cited_by_count":13,"area":null},{"id":"2209.14884","title":"Joint Embedding Self-Supervised Learning in the Kernel Regime","created":"2022-09-29","cited_by_count":12,"area":null},{"id":"2210.14019","title":"The Curious Case of Benign Memorization","created":"2022-10-25","cited_by_count":12,"area":null},{"id":"2306.13926","title":"Quantifying the Optimization and Generalization Advantages of Graph Neural Networks Over Multilayer Perceptrons","created":"2023-06-24","cited_by_count":12,"area":null},{"id":"2403.03375","title":"Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations","created":"2024-03-05","cited_by_count":12,"area":null},{"id":"2410.08503","title":"Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data","created":"2024-10-11","cited_by_count":12,"area":null},{"id":"2206.14702","title":"Interventional Contrastive Learning with Meta Semantic Regularizer","created":"2022-06-29","cited_by_count":11,"area":null},{"id":"2502.00620","title":"Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions","created":"2025-02-02","cited_by_count":10,"area":null},{"id":"2111.11208","title":"Self-Supervised Class Incremental Learning","created":"2021-11-18","cited_by_count":8,"area":null},{"id":"2406.17167","title":"Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis","created":"2024-06-24","cited_by_count":8,"area":null},{"id":"2304.11718","title":"No Free Lunch in Self Supervised Representation Learning","created":"2023-04-23","cited_by_count":7,"area":null},{"id":"2411.06508","title":"Understanding the Role of Equivariance in Self-supervised Learning","created":"2024-11-10","cited_by_count":7,"area":null},{"id":"2304.00395","title":"Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis","created":"2023-04-01","cited_by_count":6,"area":null},{"id":"2306.03335","title":"Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage","created":"2023-06-06","cited_by_count":6,"area":null},{"id":"2311.05139","title":"Hard-Negative Sampling for Contrastive Learning: Optimal Representation Geometry and Neural- vs Dimensional-Collapse","created":"2023-11-09","cited_by_count":6,"area":null},{"id":"2204.08226","title":"Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey","created":"2022-04-18","cited_by_count":5,"area":null},{"id":"2205.07315","title":"Learn2Weight: Parameter Adaptation against Similar-domain Adversarial Attacks","created":"2022-05-15","cited_by_count":5,"area":null},{"id":"2301.12189","title":"Deciphering the Projection Head: Representation Evaluation Self-supervised Learning","created":"2023-01-28","cited_by_count":5,"area":null},{"id":"2306.04793","title":"On the Joint Interaction of Models, Data, and Features","created":"2023-06-07","cited_by_count":5,"area":null},{"id":"2405.05143","title":"Learning Object Semantic Similarity with Self-Supervision","created":"2024-04-19","cited_by_count":5,"area":null},{"id":"2410.11206","title":"Towards Understanding Why FixMatch Generalizes Better Than Supervised Learning","created":"2024-10-15","cited_by_count":5,"area":null},{"id":"2503.17538","title":"A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics","created":"2025-03-21","cited_by_count":5,"area":null},{"id":"2506.04411","title":"Self-Supervised Contrastive Learning is Approximately Supervised Contrastive Learning","created":"2025-06-04","cited_by_count":5,"area":null},{"id":"2511.03114","title":"An Augmentation Overlap Theory of Contrastive Learning","created":"2025-11-05","cited_by_count":5,"area":null},{"id":"2111.12460","title":"ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment","created":"2021-11-24","cited_by_count":4,"area":null},{"id":"2202.09305","title":"Masked prediction tasks: a parameter identifiability view","created":"2022-02-18","cited_by_count":4,"area":null},{"id":"2310.04971","title":"Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift","created":"2023-10-08","cited_by_count":4,"area":null},{"id":"2404.18161","title":"IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual Learning","created":"2024-04-28","cited_by_count":4,"area":null},{"id":"2412.00756","title":"Multi-View Incongruity Learning for Multimodal Sarcasm Detection","created":"2024-12-01","cited_by_count":4,"area":null},{"id":"2507.11372","title":"Attributes Shape the Embedding Space of Face Recognition Models","created":"2025-07-15","cited_by_count":4,"area":null},{"id":"2510.17526","title":"How Does Label Noise Gradient Descent Improve Generalization in the Low SNR Regime?","created":"2025-10-20","cited_by_count":4,"area":null},{"id":"2203.03539","title":"Understanding The Robustness of Self-supervised Learning Through Topic Modeling","created":"2022-02-02","cited_by_count":3,"area":null},{"id":"2204.03865","title":"Frequency Selective Augmentation for Video Representation Learning","created":"2022-04-08","cited_by_count":3,"area":null},{"id":"2309.02011","title":"Representation Learning Dynamics of Self-Supervised Models","created":"2023-09-05","cited_by_count":3,"area":null},{"id":"2407.07544","title":"Disentangling Masked Autoencoders for Unsupervised Domain Generalization","created":"2024-07-10","cited_by_count":3,"area":null},{"id":"2502.20681","title":"Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformers","created":"2025-02-28","cited_by_count":3,"area":null},{"id":"2603.03530","title":"Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning","created":"2026-03-03","cited_by_count":3,"area":null},{"id":"2211.00460","title":"Augmentation Invariant Manifold Learning","created":"2022-11-01","cited_by_count":2,"area":null},{"id":"2303.00403","title":"Can representation learning for multimodal image registration be improved by supervision of intermediate layers?","created":"2023-03-01","cited_by_count":2,"area":null},{"id":"2309.16109","title":"Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics","created":"2023-09-28","cited_by_count":2,"area":null},{"id":"2401.03214","title":"Understanding Representation Learnability of Nonlinear Self-Supervised Learning","created":"2024-01-06","cited_by_count":2,"area":null},{"id":"2503.08203","title":"A Theoretical Framework for Preventing Class Collapse in Supervised Contrastive Learning","created":"2025-03-11","cited_by_count":2,"area":null},{"id":"2509.23373","title":"Graph Your Own Prompt","created":"2025-09-27","cited_by_count":2,"area":null},{"id":"2510.08852","title":"On the Alignment Between Supervised and Self-Supervised Contrastive Learning","created":"2025-10-09","cited_by_count":2,"area":null},{"id":"2310.13836","title":"Foundation Model's Embedded Representations May Detect Distribution Shift","created":"2023-10-20","cited_by_count":1,"area":null},{"id":"2405.03355","title":"A Generalization Theory of Cross-Modality Distillation with Contrastive Learning","created":"2024-05-06","cited_by_count":1,"area":null},{"id":"2406.06909","title":"Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit","created":"2024-06-11","cited_by_count":1,"area":null},{"id":"2502.12413","title":"DivIL: Unveiling and Addressing Over-Invariance for Out-of- Distribution Generalization","created":"2025-02-18","cited_by_count":1,"area":null},{"id":"2503.07214","title":"Cross-Lingual IPA Contrastive Learning for Zero-Shot NER","created":"2025-03-10","cited_by_count":1,"area":null},{"id":"2505.19447","title":"A Contrastive Learning Foundation Model Based on Perfectly Aligned Sample Pairs for Remote Sensing Images","created":"2025-05-26","cited_by_count":1,"area":null},{"id":"2602.02767","title":"Provable Effects of Data Replay in Continual Learning: A Feature Learning Perspective","created":"2026-02-02","cited_by_count":1,"area":null},{"id":"2604.06440","title":"Visual prompting reimagined: The power of the Activation Prompts","created":"2026-04-07","cited_by_count":1,"area":null},{"id":"2309.02651","title":"Contrastive Learning as Kernel Approximation","created":"2023-09-06","cited_by_count":0,"area":null},{"id":"2310.01739","title":"Randomized Dimension Reduction with Statistical Guarantees","created":"2023-10-03","cited_by_count":0,"area":null}],"next_cursor":"100"}