{"total":337,"rows":[{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396,"area":null},{"id":"2212.04089","title":"Editing Models with Task Arithmetic","created":"2022-12-08","cited_by_count":1120,"area":null},{"id":"2302.00487","title":"A Comprehensive Survey of Continual Learning: Theory, Method and Application","created":"2023-01-31","cited_by_count":872,"area":null},{"id":"2306.01708","title":"TIES-Merging: Resolving Interference When Merging Models","created":"2023-06-02","cited_by_count":818,"area":null},{"id":"2109.01903","title":"Robust fine-tuning of zero-shot models","created":"2021-09-04","cited_by_count":797,"area":null},{"id":"2212.09849","title":"Dataless Knowledge Fusion by Merging Weights of Language Models","created":"2022-12-19","cited_by_count":387,"area":null},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381,"area":null},{"id":"2101.05224","title":"Big Self-Supervised Models Advance Medical Image Classification","created":"2021-01-13","cited_by_count":320,"area":null},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291,"area":null},{"id":"2404.16789","title":"Continual Learning of Large Language Models: A Comprehensive Survey","created":"2024-04-25","cited_by_count":234,"area":null},{"id":"2210.11466","title":"Surgical Fine-Tuning Improves Adaptation to Distribution Shifts","created":"2022-10-20","cited_by_count":205,"area":null},{"id":"2101.12037","title":"BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG data","created":"2021-01-28","cited_by_count":199,"area":null},{"id":"2403.13257","title":"Arcee's MergeKit: A Toolkit for Merging Large Language Models","created":"2024-03-20","cited_by_count":194,"area":null},{"id":"2208.05592","title":"Patching open-vocabulary models by interpolating weights","created":"2022-08-10","cited_by_count":190,"area":null},{"id":"2305.03053","title":"ZipIt! Merging Models from Different Tasks without Training","created":"2023-05-04","cited_by_count":179,"area":null},{"id":"2102.11005","title":"LogME: Practical Assessment of Pre-trained Models for Transfer Learning","created":"2021-02-22","cited_by_count":172,"area":null},{"id":"2203.07378","title":"Dawn of the transformer era in speech emotion recognition: closing the valence gap","created":"2022-03-14","cited_by_count":157,"area":null},{"id":"2306.14870","title":"Composing Parameter-Efficient Modules with Arithmetic Operations","created":"2023-06-26","cited_by_count":156,"area":null},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148,"area":null},{"id":"2210.17451","title":"AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning","created":"2022-10-31","cited_by_count":137,"area":null},{"id":"2112.09153","title":"An Empirical Investigation of the Role of Pre-training in Lifelong Learning","created":"2021-12-16","cited_by_count":134,"area":null},{"id":"2312.06795","title":"Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks","created":"2023-12-11","cited_by_count":133,"area":null},{"id":"2410.19735","title":"Model merging with SVD to tie the Knots","created":"2024-10-25","cited_by_count":122,"area":null},{"id":"2211.13131","title":"FeTrIL: Feature Translation for Exemplar-Free Class-Incremental Learning","created":"2022-11-23","cited_by_count":121,"area":null},{"id":"2205.13543","title":"Revealing the Dark Secrets of Masked Image Modeling","created":"2022-05-26","cited_by_count":117,"area":null},{"id":"2204.03044","title":"Fusing finetuned models for better pretraining","created":"2022-04-06","cited_by_count":110,"area":null},{"id":"2110.02095","title":"Exploring the Limits of Large Scale Pre-training","created":"2021-10-05","cited_by_count":104,"area":null},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97,"area":null},{"id":"2110.06976","title":"Representational Continuity for Unsupervised Continual Learning","created":"2021-10-13","cited_by_count":95,"area":null},{"id":"2309.15698","title":"Deep Model Fusion: A Survey","created":"2023-09-27","cited_by_count":91,"area":null},{"id":"2110.13100","title":"Parameter Prediction for Unseen Deep Architectures","created":"2021-10-25","cited_by_count":89,"area":null},{"id":"2210.16156","title":"Reliability of CKA as a Similarity Measure in Deep Learning","created":"2022-10-28","cited_by_count":87,"area":null},{"id":"2204.09810","title":"Deep transfer operator learning for partial differential equations under conditional shift","created":"2022-04-20","cited_by_count":83,"area":null},{"id":"2302.11529","title":"Modular Deep Learning","created":"2023-02-22","cited_by_count":83,"area":null},{"id":"2110.14633","title":"Similarity and Matching of Neural Network Representations","created":"2021-10-27","cited_by_count":78,"area":null},{"id":"2202.00661","title":"When Do Flat Minima Optimizers Work?","created":"2022-02-01","cited_by_count":78,"area":null},{"id":"2209.00099","title":"Efficient Methods for Natural Language Processing: A Survey","created":"2022-08-31","cited_by_count":78,"area":null},{"id":"2310.12808","title":"Model Merging by Uncertainty-Based Gradient Matching","created":"2023-10-19","cited_by_count":77,"area":null},{"id":"2303.08566","title":"Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning","created":"2023-03-15","cited_by_count":74,"area":null},{"id":"2206.11488","title":"On the Importance and Applicability of Pre-Training for Federated Learning","created":"2022-06-23","cited_by_count":71,"area":null},{"id":"2102.10680","title":"Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learning","created":"2021-02-21","cited_by_count":68,"area":null},{"id":"2203.01825","title":"What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors","created":"2022-03-02","cited_by_count":61,"area":null},{"id":"2106.11872","title":"Randomness In Neural Network Training: Characterizing The Impact of Tooling","created":"2021-06-22","cited_by_count":59,"area":null},{"id":"2110.12899","title":"No One Representation to Rule Them All: Overlapping Features of Training Methods","created":"2021-10-20","cited_by_count":58,"area":null},{"id":"2201.09679","title":"A Review of Deep Transfer Learning and Recent Advancements","created":"2022-01-19","cited_by_count":57,"area":null},{"id":"2211.11427","title":"Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations","created":"2022-11-21","cited_by_count":57,"area":null},{"id":"2205.12411","title":"Linear Connectivity Reveals Generalization Strategies","created":"2022-05-24","cited_by_count":56,"area":null},{"id":"2410.03617","title":"What Matters for Model Merging at Scale?","created":"2024-10-04","cited_by_count":55,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2307.16184","title":"UnIVAL: Unified Model for Image, Video, Audio and Language Tasks","created":"2023-07-30","cited_by_count":45,"area":null},{"id":"2206.00388","title":"Transfer without Forgetting","created":"2022-06-01","cited_by_count":44,"area":null},{"id":"2602.14486","title":"Revisiting the Platonic Representation Hypothesis: An Aristotelian View","created":"2026-02-16","cited_by_count":44,"area":null},{"id":"2312.08977","title":"Weighted Ensemble Models Are Strong Continual Learners","created":"2023-12-14","cited_by_count":42,"area":null},{"id":"2410.17146","title":"LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging","created":"2024-10-22","cited_by_count":41,"area":null},{"id":"2205.09723","title":"Robust and Efficient Medical Imaging with Self-Supervision","created":"2022-05-19","cited_by_count":40,"area":null},{"id":"2304.14381","title":"$\\pi$-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation","created":"2023-04-27","cited_by_count":40,"area":null},{"id":"2101.05913","title":"Supervised Transfer Learning at Scale for Medical Imaging","created":"2021-01-14","cited_by_count":38,"area":null},{"id":"2202.01339","title":"Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty","created":"2022-02-01","cited_by_count":37,"area":null},{"id":"2303.10720","title":"Trainable Projected Gradient Method for Robust Fine-tuning","created":"2023-03-19","cited_by_count":37,"area":null},{"id":"2312.04339","title":"Merging by Matching Models in Task Parameter Subspaces","created":"2023-12-07","cited_by_count":36,"area":null},{"id":"2206.02659","title":"Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees","created":"2022-06-06","cited_by_count":34,"area":null},{"id":"2305.19753","title":"The Tunnel Effect: Building Data Representations in Deep Neural Networks","created":"2023-05-31","cited_by_count":34,"area":null},{"id":"2408.07362","title":"BadMerging: Backdoor Attacks Against Model Merging","created":"2024-08-14","cited_by_count":34,"area":null},{"id":"2209.13900","title":"Disentangling Transfer in Continual Reinforcement Learning","created":"2022-09-28","cited_by_count":33,"area":null},{"id":"2207.05739","title":"A Data-Based Perspective on Transfer Learning","created":"2022-07-12","cited_by_count":32,"area":null},{"id":"2106.11905","title":"Dangers of Bayesian Model Averaging under Covariate Shift","created":"2021-06-22","cited_by_count":31,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2109.04953","title":"Does Pretraining for Summarization Require Knowledge Transfer?","created":"2021-09-10","cited_by_count":30,"area":null},{"id":"2211.12491","title":"ModelDiff: A Framework for Comparing Learning Algorithms","created":"2022-11-22","cited_by_count":30,"area":null},{"id":"2506.09022","title":"Do Multiple Instance Learning Models Transfer?","created":"2025-06-10","cited_by_count":29,"area":null},{"id":"2106.16004","title":"What can linear interpolation of neural network loss landscapes tell us?","created":"2021-06-30","cited_by_count":28,"area":null},{"id":"2110.10545","title":"Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs","created":"2021-10-20","cited_by_count":28,"area":null},{"id":"2501.18512","title":"Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch","created":"2025-01-30","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2303.02141","title":"Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!","created":"2023-03-03","cited_by_count":27,"area":null},{"id":"2210.14102","title":"Exploring Mode Connectivity for Pre-trained Language Models","created":"2022-10-25","cited_by_count":26,"area":null},{"id":"2309.17230","title":"Spurious Feature Diversification Improves Out-of-distribution Generalization","created":"2023-09-29","cited_by_count":26,"area":null},{"id":"2410.08989","title":"Zeroth-Order Fine-Tuning of LLMs in Random Subspaces","created":"2024-10-11","cited_by_count":26,"area":null},{"id":"2106.05418","title":"Probing transfer learning with a model of synthetic correlated datasets","created":"2021-06-09","cited_by_count":25,"area":null},{"id":"2106.05956","title":"Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning","created":"2021-06-10","cited_by_count":25,"area":null},{"id":"2310.19103","title":"Proving Linear Mode Connectivity of Neural Networks via Optimal Transport","created":"2023-10-29","cited_by_count":25,"area":null},{"id":"2412.12153","title":"Revisiting Weight Averaging for Model Merging","created":"2024-12-11","cited_by_count":25,"area":null},{"id":"2404.18211","title":"A survey of dynamic graph neural networks","created":"2024-04-28","cited_by_count":24,"area":null},{"id":"2412.06712","title":"How to Merge Your Multimodal Models Over Time?","created":"2024-12-09","cited_by_count":23,"area":null},{"id":"2105.14095","title":"Weighted Training for Cross-Task Learning","created":"2021-05-28","cited_by_count":22,"area":null},{"id":"2301.03441","title":"L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Staging","created":"2023-01-09","cited_by_count":21,"area":null},{"id":"2109.00267","title":"The Impact of Reinitialization on Generalization in Convolutional Neural Networks","created":"2021-09-01","cited_by_count":20,"area":null},{"id":"2205.12694","title":"Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2206.03198","title":"Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow","created":"2022-06-07","cited_by_count":20,"area":null},{"id":"2303.03052","title":"Masked Images Are Counterfactual Samples for Robust Fine-tuning","created":"2023-03-06","cited_by_count":20,"area":null},{"id":"2306.10460","title":"Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models","created":"2023-06-18","cited_by_count":20,"area":null},{"id":"2306.16788","title":"Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging","created":"2023-06-29","cited_by_count":20,"area":null},{"id":"2110.14805","title":"Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning","created":"2021-10-27","cited_by_count":19,"area":null},{"id":"2202.00095","title":"Deconfounded Representation Similarity for Comparison of Neural Networks","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2207.09684","title":"On the Versatile Uses of Partial Distance Correlation in Deep Learning","created":"2022-07-20","cited_by_count":19,"area":null},{"id":"2210.11948","title":"lo-fi: distributed fine-tuning without communication","created":"2022-10-19","cited_by_count":19,"area":null},{"id":"2310.17653","title":"Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model","created":"2023-10-26","cited_by_count":19,"area":null},{"id":"2204.07344","title":"CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging","created":"2022-04-15","cited_by_count":18,"area":null},{"id":"2304.01973","title":"ERM++: An Improved Baseline for Domain Generalization","created":"2023-04-04","cited_by_count":18,"area":null},{"id":"2304.11247","title":"Hybrid quantum physics-informed neural networks for simulating computational fluid dynamics in complex shapes","created":"2023-04-21","cited_by_count":18,"area":null}],"next_cursor":"100"}