{"total":224,"rows":[{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396,"area":null},{"id":"2405.07987","title":"The Platonic Representation Hypothesis","created":"2024-05-13","cited_by_count":382,"area":null},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291,"area":null},{"id":"2408.07666","title":"Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities","created":"2024-08-14","cited_by_count":254,"area":null},{"id":"2403.13257","title":"Arcee's MergeKit: A Toolkit for Merging Large Language Models","created":"2024-03-20","cited_by_count":194,"area":null},{"id":"2208.05592","title":"Patching open-vocabulary models by interpolating weights","created":"2022-08-10","cited_by_count":190,"area":null},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158,"area":null},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148,"area":null},{"id":"2206.06232","title":"Towards Understanding Sharpness-Aware Minimization","created":"2022-06-13","cited_by_count":146,"area":null},{"id":"2201.04234","title":"Leveraging Unlabeled Data to Predict Out-of-Distribution Performance","created":"2022-01-11","cited_by_count":145,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2211.08403","title":"REPAIR: REnormalizing Permuted Activations for Interpolation Repair","created":"2022-11-15","cited_by_count":120,"area":null},{"id":"2102.00650","title":"Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective","created":"2021-02-01","cited_by_count":119,"area":"distill"},{"id":"2106.13799","title":"Assessing Generalization of SGD via Disagreement","created":"2021-06-25","cited_by_count":117,"area":null},{"id":"2104.10706","title":"Dataset Inference: Ownership Resolution in Machine Learning","created":"2021-04-21","cited_by_count":116,"area":"safety"},{"id":"2302.06600","title":"Task-Specific Skill Localization in Fine-tuned Language Models","created":"2023-02-13","cited_by_count":105,"area":null},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97,"area":null},{"id":"2305.18887","title":"How Does Information Bottleneck Help Deep Learning?","created":"2023-05-30","cited_by_count":93,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2309.15698","title":"Deep Model Fusion: A Survey","created":"2023-09-27","cited_by_count":91,"area":null},{"id":"2402.00433","title":"Merging Multi-Task Models via Weight-Ensembling Mixture of Experts","created":"2024-02-01","cited_by_count":85,"area":"moe"},{"id":"2302.11529","title":"Modular Deep Learning","created":"2023-02-22","cited_by_count":83,"area":null},{"id":"2211.13609","title":"PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization","created":"2022-11-24","cited_by_count":76,"area":null},{"id":"2212.12042","title":"Re-basin via implicit Sinkhorn differentiation","created":"2022-12-22","cited_by_count":62,"area":null},{"id":"2503.10657","title":"RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs","created":"2025-03-08","cited_by_count":61,"area":null},{"id":"2107.08444","title":"A Theory of PAC Learnability of Partial Concept Classes","created":"2021-07-18","cited_by_count":60,"area":null},{"id":"2503.01067","title":"All Roads Lead to Likelihood: The Value of Reinforcement Learning in Fine-Tuning","created":"2025-03-03","cited_by_count":59,"area":"alignment"},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2205.12411","title":"Linear Connectivity Reveals Generalization Strategies","created":"2022-05-24","cited_by_count":56,"area":null},{"id":"2106.09276","title":"Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting","created":"2021-06-17","cited_by_count":54,"area":null},{"id":"2312.17173","title":"Non-Vacuous Generalization Bounds for Large Language Models","created":"2023-12-28","cited_by_count":53,"area":null},{"id":"2112.03968","title":"Learning Theory Can (Sometimes) Explain Generalisation in Graph Neural Networks","created":"2021-12-07","cited_by_count":51,"area":null},{"id":"2307.08286","title":"Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity","created":"2023-07-17","cited_by_count":50,"area":null},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49,"area":null},{"id":"2106.04546","title":"LEADS: Learning Dynamical Systems that Generalize Across Environments","created":"2021-06-08","cited_by_count":40,"area":null},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38,"area":null},{"id":"2312.06173","title":"Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusion","created":"2023-12-11","cited_by_count":37,"area":null},{"id":"2312.04339","title":"Merging by Matching Models in Task Parameter Subspaces","created":"2023-12-07","cited_by_count":36,"area":null},{"id":"2104.05641","title":"Generalization bounds via distillation","created":"2021-04-12","cited_by_count":34,"area":null},{"id":"2102.05274","title":"Stability of SGD: Tightness Analysis and Improved Bounds","created":"2021-02-10","cited_by_count":33,"area":null},{"id":"2210.13738","title":"Pruning's Effect on Generalization Through the Lens of Training and Regularization","created":"2022-10-25","cited_by_count":31,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2211.13312","title":"A Moment-Matching Approach to Testable Learning and a New Characterization of Rademacher Complexity","created":"2022-11-23","cited_by_count":27,"area":null},{"id":"2402.03660","title":"On the Emergence of Cross-Task Linearity in the Pretraining-Finetuning Paradigm","created":"2024-02-06","cited_by_count":26,"area":null},{"id":"2106.03314","title":"Measuring Generalization with Optimal Transport","created":"2021-06-07","cited_by_count":25,"area":null},{"id":"2111.04746","title":"Realizable Learning is All You Need","created":"2021-11-08","cited_by_count":25,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2209.07509","title":"Random initialisations performing above chance and how to find them","created":"2022-09-15","cited_by_count":23,"area":null},{"id":"2410.21804","title":"Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging","created":"2024-10-29","cited_by_count":23,"area":"moe"},{"id":"2103.02200","title":"Formalizing Generalization and Robustness of Neural Networks to Weight Perturbations","created":"2021-03-03","cited_by_count":22,"area":null},{"id":"2202.01627","title":"Non-Vacuous Generalisation Bounds for Shallow Neural Networks","created":"2022-02-03","cited_by_count":22,"area":null},{"id":"2206.01278","title":"Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks","created":"2022-06-02","cited_by_count":21,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2307.01998","title":"Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities","created":"2023-07-05","cited_by_count":21,"area":null},{"id":"2105.00303","title":"RATT: Leveraging Unlabeled Data to Guarantee Generalization","created":"2021-05-01","cited_by_count":20,"area":null},{"id":"2202.11455","title":"On PAC-Bayesian reconstruction guarantees for VAEs","created":"2022-02-23","cited_by_count":20,"area":null},{"id":"2301.01597","title":"Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification","created":"2022-12-29","cited_by_count":20,"area":null},{"id":"2306.10460","title":"Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models","created":"2023-06-18","cited_by_count":20,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2107.03955","title":"On Margins and Derandomisation in PAC-Bayes","created":"2021-07-08","cited_by_count":19,"area":null},{"id":"2202.02842","title":"Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data","created":"2022-02-06","cited_by_count":19,"area":null},{"id":"2202.13361","title":"Benign Underfitting of Stochastic Gradient Descent","created":"2022-02-27","cited_by_count":19,"area":null},{"id":"2207.00614","title":"Integral Probability Metrics PAC-Bayes Bounds","created":"2022-07-01","cited_by_count":19,"area":null},{"id":"2210.11948","title":"lo-fi: distributed fine-tuning without communication","created":"2022-10-19","cited_by_count":19,"area":null},{"id":"2304.09424","title":"Loss Minimization Yields Multicalibration for Large Neural Networks","created":"2023-04-19","cited_by_count":19,"area":null},{"id":"2309.13658","title":"Fantastic Generalization Measures are Nowhere to be Found","created":"2023-09-24","cited_by_count":19,"area":null},{"id":"2203.01572","title":"Data Augmentation as Feature Manipulation","created":"2022-03-03","cited_by_count":18,"area":null},{"id":"2210.13150","title":"A PAC-Bayesian Generalization Bound for Equivariant Networks","created":"2022-10-24","cited_by_count":18,"area":null},{"id":"2406.11779","title":"Compact Proofs of Model Performance via Mechanistic Interpretability","created":"2024-06-17","cited_by_count":18,"area":"mechinterp"},{"id":"2101.08732","title":"Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning","created":"2021-01-21","cited_by_count":17,"area":null},{"id":"2112.04470","title":"Optimistic Rates: A Unifying Theory for Interpolation Learning and Regularization in Linear Regression","created":"2021-12-08","cited_by_count":17,"area":null},{"id":"2306.12214","title":"More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity","created":"2023-06-21","cited_by_count":17,"area":null},{"id":"2402.16828","title":"Training Neural Networks from Scratch with Parallel Low-Rank Adapters","created":"2024-02-26","cited_by_count":17,"area":null},{"id":"2410.10801","title":"Mix Data or Merge Models? Optimizing for Diverse Multi-Task Learning","created":"2024-10-14","cited_by_count":17,"area":null},{"id":"2206.04502","title":"What is a Good Metric to Study Generalization of Minimax Learners?","created":"2022-06-09","cited_by_count":16,"area":null},{"id":"2208.04284","title":"On Rademacher Complexity-based Generalization Bounds for Deep Learning","created":"2022-08-08","cited_by_count":16,"area":null},{"id":"2305.15141","title":"From Tempered to Benign Overfitting in ReLU Neural Networks","created":"2023-05-24","cited_by_count":16,"area":null},{"id":"2306.00312","title":"(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy","created":"2023-06-01","cited_by_count":16,"area":null},{"id":"2111.07632","title":"CoReS: Compatible Representations via Stationarity","created":"2021-11-15","cited_by_count":14,"area":null},{"id":"2203.02006","title":"Why adversarial training can hurt robust accuracy","created":"2022-03-03","cited_by_count":14,"area":null},{"id":"2206.01367","title":"Adversarial Unlearning: Reducing Confidence Along Adversarial Directions","created":"2022-06-03","cited_by_count":14,"area":"safety"},{"id":"2305.19674","title":"Online-to-PAC Conversions: Generalization Bounds via Regret Analysis","created":"2023-05-31","cited_by_count":14,"area":null},{"id":"2102.11069","title":"A PAC-Bayes Analysis of Adversarial Robustness","created":"2021-02-19","cited_by_count":13,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2207.05685","title":"PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners","created":"2022-07-12","cited_by_count":13,"area":null},{"id":"2302.08942","title":"PAC-Bayesian Generalization Bounds for Adversarial Generative Models","created":"2023-02-17","cited_by_count":13,"area":null},{"id":"2404.04002","title":"Continual Learning with Weight Interpolation","created":"2024-04-05","cited_by_count":13,"area":null},{"id":"2401.15207","title":"HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy","created":"2024-01-26","cited_by_count":12,"area":null},{"id":"2202.13216","title":"Adversarial robustness of sparse local Lipschitz predictors","created":"2022-02-26","cited_by_count":11,"area":null},{"id":"2208.10842","title":"Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost","created":"2022-08-23","cited_by_count":11,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2202.06233","title":"The Sample Complexity of One-Hidden-Layer Neural Networks","created":"2022-02-13","cited_by_count":10,"area":null},{"id":"2203.03443","title":"Generalization Through The Lens Of Leave-One-Out Error","created":"2022-03-07","cited_by_count":10,"area":null},{"id":"2310.01225","title":"A path-norm toolkit for modern networks: consequences, promises and challenges","created":"2023-10-02","cited_by_count":10,"area":null},{"id":"2310.03957","title":"Understanding prompt engineering may not require rethinking generalization","created":"2023-10-06","cited_by_count":10,"area":"lr"},{"id":"2404.06498","title":"Simultaneous linear connectivity of neural networks modulo permutation","created":"2024-04-09","cited_by_count":10,"area":null},{"id":"2107.06665","title":"Disparity Between Batches as a Signal for Early Stopping","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2202.08070","title":"On Measuring Excess Capacity in Neural Networks","created":"2022-02-16","cited_by_count":9,"area":null},{"id":"2310.20369","title":"Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm","created":"2023-10-31","cited_by_count":9,"area":null},{"id":"2402.04051","title":"Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods","created":"2024-02-06","cited_by_count":9,"area":null}],"next_cursor":"100"}