{"list":"other","total":195,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"2104.14294","title":"Emerging Properties in Self-Supervised Vision Transformers","created":"2021-04-29","cited_by_count":6968},{"id":"1706.06083","title":"Towards Deep Learning Models Resistant to Adversarial Attacks","created":"2017-06-19","cited_by_count":6415},{"id":"1512.00567","title":"Rethinking the Inception Architecture for Computer Vision","created":"2015-12-02","cited_by_count":5475},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1612.00796","title":"Overcoming catastrophic forgetting in neural networks","created":"2016-12-02","cited_by_count":4787},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"1912.04977","title":"Advances and Open Problems in Federated Learning","created":"2019-12-10","cited_by_count":3046},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1908.07873","title":"Federated Learning: Challenges, Methods, and Future Directions","created":"2019-08-21","cited_by_count":1538},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1705.07115","title":"Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics","created":"2017-05-19","cited_by_count":1358},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"2007.01282","title":"Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering","created":"2020-07-02","cited_by_count":1210},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"2212.04089","title":"Editing Models with Task Arithmetic","created":"2022-12-08","cited_by_count":1120},{"id":"1610.02242","title":"Temporal Ensembling for Semi-Supervised Learning","created":"2016-10-07","cited_by_count":1057},{"id":"2003.00295","title":"Adaptive Federated Optimization","created":"2020-02-29","cited_by_count":1046},{"id":"2106.04560","title":"Scaling Vision Transformers","created":"2021-06-08","cited_by_count":999},{"id":"1909.06335","title":"Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification","created":"2019-09-13","cited_by_count":851},{"id":"2306.01708","title":"TIES-Merging: Resolving Interference When Merging Models","created":"2023-06-02","cited_by_count":818},{"id":"2109.01903","title":"Robust fine-tuning of zero-shot models","created":"2021-09-04","cited_by_count":797},{"id":"2006.07242","title":"Ensemble Distillation for Robust Model Fusion in Federated Learning","created":"2020-06-12","cited_by_count":682},{"id":"1705.10467","title":"Federated Multi-Task Learning","created":"2017-05-30","cited_by_count":672},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"2103.00112","title":"Transformer in Transformer","created":"2021-02-27","cited_by_count":633},{"id":"2111.09832","title":"Merging Models with Fisher-Weighted Averaging","created":"2021-11-18","cited_by_count":621},{"id":"1802.10026","title":"Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs","created":"2018-02-27","cited_by_count":588},{"id":"2106.04803","title":"CoAtNet: Marrying Convolution and Attention for All Data Sizes","created":"2021-06-09","cited_by_count":569},{"id":"2002.06440","title":"Federated Learning with Matched Averaging","created":"2020-02-15","cited_by_count":564},{"id":"2306.02561","title":"LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion","created":"2023-06-05","cited_by_count":564},{"id":"1902.02476","title":"A Simple Baseline for Bayesian Uncertainty in Deep Learning","created":"2019-02-07","cited_by_count":560},{"id":"1907.09682","title":"Similarity-Preserving Knowledge Distillation","created":"2019-07-23","cited_by_count":516},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"1910.03581","title":"FedMD: Heterogenous Federated Learning via Model Distillation","created":"2019-10-08","cited_by_count":459},{"id":"1902.00146","title":"Agnostic Federated Learning","created":"2019-02-01","cited_by_count":456},{"id":"1912.02757","title":"Deep Ensembles: A Loss Landscape Perspective","created":"2019-12-05","cited_by_count":443},{"id":"2102.08604","title":"SWAD: Domain Generalization by Seeking Flat Minima","created":"2021-02-17","cited_by_count":434},{"id":"1910.07738","title":"A Survey of Deep Learning Techniques for Autonomous Driving","created":"2019-10-17","cited_by_count":403},{"id":"1905.12022","title":"Bayesian Nonparametric Federated Learning of Neural Networks","created":"2019-05-28","cited_by_count":387},{"id":"2212.09849","title":"Dataless Knowledge Fusion by Merging Weights of Language Models","created":"2022-12-19","cited_by_count":387},{"id":"2105.10056","title":"Data-Free Knowledge Distillation for Heterogeneous Federated Learning","created":"2021-05-20","cited_by_count":383},{"id":"1905.07553","title":"Which Tasks Should Be Learned Together in Multi-task Learning?","created":"2019-05-18","cited_by_count":375},{"id":"2002.06715","title":"BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning","created":"2020-02-17","cited_by_count":371},{"id":"1804.08838","title":"Measuring the Intrinsic Dimension of Objective Landscapes","created":"2018-04-24","cited_by_count":370},{"id":"2008.11687","title":"What is being transferred in transfer learning?","created":"2020-08-26","cited_by_count":368},{"id":"2307.13269","title":"LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition","created":"2023-07-25","cited_by_count":364},{"id":"1804.08333","title":"Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge","created":"2018-04-23","cited_by_count":352},{"id":"1704.00109","title":"Snapshot Ensembles: Train 1, get M for free","created":"2017-04-01","cited_by_count":350},{"id":"1907.08610","title":"Lookahead Optimizer: k steps forward, 1 step back","created":"2019-07-19","cited_by_count":336},{"id":"1803.00885","title":"Essentially No Barriers in Neural Network Energy Landscape","created":"2018-03-02","cited_by_count":330},{"id":"1904.05835","title":"Variational Information Distillation for Knowledge Transfer","created":"2019-04-11","cited_by_count":324},{"id":"1802.05296","title":"Stronger generalization bounds for deep nets via a compression approach","created":"2018-02-14","cited_by_count":307},{"id":"1910.00189","title":"The Non-IID Data Quagmire of Decentralized Machine Learning","created":"2019-10-01","cited_by_count":305},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1406.2572","title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","created":"2014-06-10","cited_by_count":289},{"id":"2103.06030","title":"FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space","created":"2021-03-10","cited_by_count":287},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"1705.08741","title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","created":"2017-05-24","cited_by_count":279},{"id":"1802.04977","title":"Paraphrasing Complex Network: Network Compression via Factor Transfer","created":"2018-02-14","cited_by_count":260},{"id":"1811.11479","title":"Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data","created":"2018-11-28","cited_by_count":243},{"id":"2306.04488","title":"Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards","created":"2023-06-07","cited_by_count":243},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"1902.04742","title":"Uniform convergence may be unable to explain generalization in deep learning","created":"2019-02-13","cited_by_count":224},{"id":"2109.04617","title":"Efficiently Identifying Task Groupings for Multi-Task Learning","created":"2021-09-10","cited_by_count":222},{"id":"2305.12827","title":"Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Models","created":"2023-05-22","cited_by_count":221},{"id":"1511.07543","title":"Convergent Learning: Do different neural networks learn the same representations?","created":"2015-11-24","cited_by_count":220},{"id":"1910.05653","title":"Model Fusion via Optimal Transport","created":"2019-10-12","cited_by_count":219},{"id":"1811.01088","title":"Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks","created":"2018-11-02","cited_by_count":215},{"id":"2208.03306","title":"Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models","created":"2022-08-05","cited_by_count":191},{"id":"2208.05592","title":"Patching open-vocabulary models by interpolating weights","created":"2022-08-10","cited_by_count":190},{"id":"1412.6544","title":"Qualitatively characterizing neural network optimization problems","created":"2014-12-19","cited_by_count":188},{"id":"2010.15110","title":"Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel","created":"2020-10-28","cited_by_count":187},{"id":"2106.06042","title":"FedBABU: Towards Enhanced Representation for Federated Image Classification","created":"2021-06-04","cited_by_count":182},{"id":"2305.03053","title":"ZipIt! Merging Models from Different Tasks without Training","created":"2023-05-04","cited_by_count":179},{"id":"2009.01974","title":"FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning","created":"2020-09-04","cited_by_count":176},{"id":"2212.03551","title":"Talking About Large Language Models","created":"2022-12-07","cited_by_count":175},{"id":"2203.09249","title":"Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning","created":"2022-03-17","cited_by_count":172},{"id":"1905.00076","title":"Ensemble Distribution Distillation","created":"2019-04-30","cited_by_count":158},{"id":"2004.00345","title":"Editable Neural Networks","created":"2020-04-01","cited_by_count":155},{"id":"1904.08918","title":"Attentive Single-Tasking of Multiple Tasks","created":"2019-04-18","cited_by_count":148},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148},{"id":"1804.03235","title":"Large scale distributed neural network training through online distillation","created":"2018-04-09","cited_by_count":146},{"id":"2110.10832","title":"Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization","created":"2021-10-21","cited_by_count":144},{"id":"1810.05749","title":"Graph HyperNetworks for Neural Architecture Search","created":"2018-10-12","cited_by_count":132},{"id":"2005.00060","title":"Bridging Mode Connectivity in Loss Landscapes and Adversarial Robustness","created":"2020-04-30","cited_by_count":132},{"id":"2003.08082","title":"Federated Visual Classification with Real-World Data Distribution","created":"2020-03-18","cited_by_count":128},{"id":"2005.00770","title":"Exploring and Predicting Transferability across NLP Tasks","created":"2020-05-02","cited_by_count":128},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127}],"next_cursor":"100"}