{"total":203,"rows":[{"id":"2107.13586","title":"Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing","created":"2021-07-28","cited_by_count":2234,"area":null},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463,"area":null},{"id":"2305.07759","title":"TinyStories: How Small Can Language Models Be and Still Speak Coherent English?","created":"2023-05-12","cited_by_count":449,"area":null},{"id":"2106.14448","title":"R-Drop: Regularized Dropout for Neural Networks","created":"2021-06-28","cited_by_count":202,"area":null},{"id":"2306.00802","title":"Birth of a Transformer: A Memory Viewpoint","created":"2023-06-01","cited_by_count":161,"area":null},{"id":"2203.12221","title":"Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)","created":"2022-03-23","cited_by_count":122,"area":null},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2106.13799","title":"Assessing Generalization of SGD via Disagreement","created":"2021-06-25","cited_by_count":117,"area":null},{"id":"2310.05249","title":"In-Context Convergence of Transformers","created":"2023-10-08","cited_by_count":115,"area":null},{"id":"2410.24210","title":"TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling","created":"2024-10-31","cited_by_count":113,"area":null},{"id":"2210.09221","title":"Vision Transformers provably learn spatial structure","created":"2022-10-13","cited_by_count":93,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2204.12703","title":"Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning","created":"2022-04-27","cited_by_count":81,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2308.07686","title":"Boosting Multi-modal Model Performance with Adaptive Gradient Modulation","created":"2023-08-15","cited_by_count":73,"area":null},{"id":"2404.12715","title":"Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaboration","created":"2024-04-19","cited_by_count":67,"area":null},{"id":"2305.01233","title":"On Uni-Modal Feature Learning in Supervised Multi-Modal Learning","created":"2023-05-02","cited_by_count":53,"area":null},{"id":"2106.07875","title":"S-LIME: Stabilized-LIME for Model Explanation","created":"2021-06-15","cited_by_count":52,"area":null},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49,"area":null},{"id":"2106.11059","title":"Improving Multi-Modal Learning with Uni-Modal Teachers","created":"2021-06-21","cited_by_count":41,"area":null},{"id":"2207.05931","title":"Towards understanding how momentum improves generalization in deep learning","created":"2022-07-13","cited_by_count":40,"area":null},{"id":"2305.18891","title":"EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation","created":"2023-05-30","cited_by_count":40,"area":null},{"id":"2202.00155","title":"Fortuitous Forgetting in Connectionist Networks","created":"2022-02-01","cited_by_count":39,"area":null},{"id":"2306.04949","title":"Robust Learning with Progressive Data Expansion Against Spurious Correlation","created":"2023-06-08","cited_by_count":39,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2210.15031","title":"Characterizing Datapoints via Second-Split Forgetting","created":"2022-10-26","cited_by_count":37,"area":null},{"id":"2203.09747","title":"Efficient Split-Mix Federated Learning for On-Demand and In-Situ Customization","created":"2022-03-18","cited_by_count":35,"area":null},{"id":"2304.11327","title":"Understanding and Improving Feature Learning for Out-of-Distribution Generalization","created":"2023-04-22","cited_by_count":35,"area":null},{"id":"2402.15607","title":"How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?","created":"2024-02-23","cited_by_count":35,"area":null},{"id":"2209.05310","title":"On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models","created":"2022-09-12","cited_by_count":34,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2305.16635","title":"Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing","created":"2023-05-26","cited_by_count":31,"area":null},{"id":"2107.10878","title":"Bagging, optimized dynamic mode decomposition (BOP-DMD) for robust, stable forecasting with spatial and temporal uncertainty-quantification","created":"2021-07-22","cited_by_count":30,"area":null},{"id":"2302.03773","title":"What Matters In The Structured Pruning of Generative Language Models?","created":"2023-02-07","cited_by_count":30,"area":null},{"id":"2310.07269","title":"Why Does Sharpness-Aware Minimization Generalize Better Than SGD?","created":"2023-10-11","cited_by_count":28,"area":null},{"id":"2207.02598","title":"Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning","created":"2022-07-06","cited_by_count":26,"area":null},{"id":"2309.17230","title":"Spurious Feature Diversification Improves Out-of-distribution Generalization","created":"2023-09-29","cited_by_count":26,"area":null},{"id":"2508.04665","title":"Perch 2.0: The Bittern Lesson for Bioacoustics","created":"2025-08-06","cited_by_count":26,"area":null},{"id":"2210.05021","title":"The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective","created":"2022-10-10","cited_by_count":24,"area":null},{"id":"2307.03407","title":"Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentation","created":"2023-07-07","cited_by_count":24,"area":null},{"id":"2202.04598","title":"Reproducibility in Optimization: Theoretical Framework and Limits","created":"2022-02-09","cited_by_count":21,"area":null},{"id":"2305.17326","title":"Matrix Information Theory for Self-Supervised Learning","created":"2023-05-27","cited_by_count":21,"area":null},{"id":"2306.16788","title":"Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging","created":"2023-06-29","cited_by_count":20,"area":null},{"id":"2111.12172","title":"Multi-label Iterated Learning for Image Classification with Label Ambiguity","created":"2021-11-23","cited_by_count":19,"area":null},{"id":"2203.13344","title":"Linking Emergent and Natural Languages via Corpus Transfer","created":"2022-03-24","cited_by_count":19,"area":null},{"id":"2303.08433","title":"The Benefits of Mixup for Feature Learning","created":"2023-03-15","cited_by_count":19,"area":null},{"id":"2310.17942","title":"Diversifying Spatial-Temporal Perception for Video Domain Generalization","created":"2023-10-27","cited_by_count":19,"area":null},{"id":"2203.01572","title":"Data Augmentation as Feature Manipulation","created":"2022-03-03","cited_by_count":18,"area":null},{"id":"2206.03826","title":"Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks","created":"2022-06-08","cited_by_count":18,"area":null},{"id":"2310.18935","title":"Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data","created":"2023-10-29","cited_by_count":18,"area":null},{"id":"2410.05101","title":"CR-CTC: Consistency regularization on CTC for improved speech recognition","created":"2024-10-07","cited_by_count":17,"area":null},{"id":"2111.13280","title":"Efficient Self-Ensemble for Semantic Segmentation","created":"2021-11-26","cited_by_count":16,"area":null},{"id":"2403.09053","title":"Towards a theory of model distillation","created":"2024-03-14","cited_by_count":15,"area":null},{"id":"2410.18779","title":"A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs","created":"2024-10-24","cited_by_count":15,"area":null},{"id":"2210.05043","title":"Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling","created":"2022-10-10","cited_by_count":14,"area":null},{"id":"2210.13512","title":"Provably Learning Diverse Features in Multi-View Data with Midpoint Mixup","created":"2022-10-24","cited_by_count":14,"area":null},{"id":"2210.15976","title":"BEBERT: Efficient and Robust Binary Ensemble BERT","created":"2022-10-28","cited_by_count":14,"area":null},{"id":"2406.01977","title":"What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding","created":"2024-06-04","cited_by_count":14,"area":null},{"id":"2105.03048","title":"Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates","created":"2021-05-07","cited_by_count":13,"area":null},{"id":"2405.17258","title":"$\\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning","created":"2024-05-27","cited_by_count":13,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2110.08220","title":"Combining Diverse Feature Priors","created":"2021-10-15","cited_by_count":12,"area":null},{"id":"2306.13926","title":"Quantifying the Optimization and Generalization Advantages of Graph Neural Networks Over Multilayer Perceptrons","created":"2023-06-24","cited_by_count":12,"area":null},{"id":"2408.04301","title":"Tackling Noisy Clients in Federated Learning with End-to-end Label Correction","created":"2024-08-08","cited_by_count":12,"area":null},{"id":"2410.08503","title":"Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data","created":"2024-10-11","cited_by_count":12,"area":null},{"id":"2502.14218","title":"Rethinking Spiking Neural Networks from an Ensemble Learning Perspective","created":"2025-02-20","cited_by_count":12,"area":null},{"id":"2502.15016","title":"TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation","created":"2025-02-20","cited_by_count":12,"area":null},{"id":"2301.12378","title":"Towards Inference Efficient Deep Ensemble Learning","created":"2023-01-29","cited_by_count":11,"area":null},{"id":"2406.03345","title":"Feature contamination: Neural networks learn uncorrelated features and fail to generalize","created":"2024-06-05","cited_by_count":11,"area":null},{"id":"2203.01726","title":"Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology","created":"2022-03-03","cited_by_count":10,"area":null},{"id":"2210.01019","title":"Plateau in Monotonic Linear Interpolation -- A \"Biased\" View of Loss Landscape for Deep Networks","created":"2022-10-03","cited_by_count":10,"area":null},{"id":"2306.17105","title":"Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations","created":"2023-06-29","cited_by_count":10,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2411.02837","title":"On the Comparison between Multi-modal and Single-modal Contrastive Learning","created":"2024-11-05","cited_by_count":10,"area":null},{"id":"2502.00620","title":"Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions","created":"2025-02-02","cited_by_count":10,"area":null},{"id":"2109.14213","title":"On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization","created":"2021-09-29","cited_by_count":9,"area":null},{"id":"2206.00944","title":"Feature Space Particle Inference for Neural Network Ensembles","created":"2022-06-02","cited_by_count":9,"area":null},{"id":"2208.10930","title":"FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classification","created":"2022-08-23","cited_by_count":9,"area":null},{"id":"2305.15718","title":"Towards Higher Pareto Frontier in Multilingual Machine Translation","created":"2023-05-25","cited_by_count":9,"area":null},{"id":"2310.06112","title":"Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach","created":"2023-10-09","cited_by_count":9,"area":null},{"id":"2506.01901","title":"Understanding Overadaptation in Supervised Fine-Tuning: The Role of Ensemble Methods","created":"2025-06-02","cited_by_count":9,"area":null},{"id":"2306.11680","title":"The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks","created":"2023-06-20","cited_by_count":8,"area":null},{"id":"2404.07815","title":"Post-Hoc Reversal: Are We Selecting Models Prematurely?","created":"2024-04-11","cited_by_count":8,"area":null},{"id":"2406.17167","title":"Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis","created":"2024-06-24","cited_by_count":8,"area":null},{"id":"2205.06265","title":"ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training","created":"2022-05-12","cited_by_count":7,"area":null},{"id":"2205.11833","title":"Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model","created":"2022-05-24","cited_by_count":7,"area":null},{"id":"2303.17940","title":"Per-Example Gradient Regularization Improves Learning Signals from Noisy Data","created":"2023-03-31","cited_by_count":7,"area":null},{"id":"2403.17592","title":"On the Benefits of Over-parameterization for Out-of-Distribution Generalization","created":"2024-03-26","cited_by_count":7,"area":null},{"id":"2410.23495","title":"DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity","created":"2024-10-30","cited_by_count":7,"area":null},{"id":"2104.03424","title":"Track, Check, Repeat: An EM Approach to Unsupervised Tracking","created":"2021-04-07","cited_by_count":6,"area":null},{"id":"2204.00077","title":"Efficient Maximal Coding Rate Reduction by Variational Forms","created":"2022-03-31","cited_by_count":6,"area":null},{"id":"2205.11416","title":"The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains","created":"2022-05-23","cited_by_count":6,"area":null},{"id":"2206.10566","title":"Ensembling over Classifiers: a Bias-Variance Perspective","created":"2022-06-21","cited_by_count":6,"area":null},{"id":"2306.00267","title":"Provable Benefit of Mixup for Finding Optimal Decision Boundaries","created":"2023-06-01","cited_by_count":6,"area":null},{"id":"2403.07310","title":"How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2403.19863","title":"DeNetDM: Debiasing by Network Depth Modulation","created":"2024-03-28","cited_by_count":6,"area":null},{"id":"2404.03843","title":"Scaling Motion Forecasting Models with Ensemble Distillation","created":"2024-04-05","cited_by_count":6,"area":null},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6,"area":null},{"id":"2105.02551","title":"Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods","created":"2021-05-06","cited_by_count":5,"area":null}],"next_cursor":"100"}