{"list":"other","total":72,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2103.00020","title":"Learning Transferable Visual Models From Natural Language Supervision","created":"2021-02-26","cited_by_count":33744},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2103.14030","title":"Swin Transformer: Hierarchical Vision Transformer using Shifted Windows","created":"2021-03-25","cited_by_count":12139},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"1607.06450","title":"Layer Normalization","created":"2016-07-21","cited_by_count":5669},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"1612.01474","title":"Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles","created":"2016-12-05","cited_by_count":3926},{"id":"2006.03654","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","created":"2020-06-05","cited_by_count":2181},{"id":"1610.05492","title":"Federated Learning: Strategies for Improving Communication Efficiency","created":"2016-10-18","cited_by_count":1475},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"2306.01708","title":"TIES-Merging: Resolving Interference When Merging Models","created":"2023-06-02","cited_by_count":818},{"id":"2111.09832","title":"Merging Models with Fisher-Weighted Averaging","created":"2021-11-18","cited_by_count":621},{"id":"2002.06440","title":"Federated Learning with Matched Averaging","created":"2020-02-15","cited_by_count":564},{"id":"1911.06455","title":"Graph Transformer Networks","created":"2019-11-06","cited_by_count":523},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"2102.08604","title":"SWAD: Domain Generalization by Seeking Flat Minima","created":"2021-02-17","cited_by_count":434},{"id":"1905.12022","title":"Bayesian Nonparametric Federated Learning of Neural Networks","created":"2019-05-28","cited_by_count":387},{"id":"2212.09849","title":"Dataless Knowledge Fusion by Merging Weights of Language Models","created":"2022-12-19","cited_by_count":387},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"2310.02575","title":"AdaMerging: Adaptive Model Merging for Multi-Task Learning","created":"2023-10-04","cited_by_count":252},{"id":"1910.05653","title":"Model Fusion via Optimal Transport","created":"2019-10-12","cited_by_count":219},{"id":"2208.03306","title":"Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models","created":"2022-08-05","cited_by_count":191},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"2110.10832","title":"Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization","created":"2021-10-21","cited_by_count":144},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127},{"id":"1506.02617","title":"Path-SGD: Path-Normalized Optimization in Deep Neural Networks","created":"2015-06-08","cited_by_count":120},{"id":"2204.03044","title":"Fusing finetuned models for better pretraining","created":"2022-04-06","cited_by_count":110},{"id":"2405.17461","title":"EMR-Merging: Tuning-Free High-Performance Model Merging","created":"2024-05-23","cited_by_count":110},{"id":"2301.12780","title":"Equivariant Architectures for Learning in Deep Weight Spaces","created":"2023-01-30","cited_by_count":107},{"id":"2012.04728","title":"Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics","created":"2020-12-08","cited_by_count":96},{"id":"2309.15698","title":"Deep Model Fusion: A Survey","created":"2023-09-27","cited_by_count":91},{"id":"2009.02439","title":"Optimizing Mode Connectivity via Neuron Alignment","created":"2020-09-05","cited_by_count":86},{"id":"2310.12808","title":"Model Merging by Uncertainty-Based Gradient Matching","created":"2023-10-19","cited_by_count":77},{"id":"2102.13042","title":"Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling","created":"2021-02-25","cited_by_count":75},{"id":"2205.14258","title":"On the Symmetries of Deep Learning Models and their Internal Representations","created":"2022-05-27","cited_by_count":64},{"id":"1907.02911","title":"Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape","created":"2019-07-05","cited_by_count":63},{"id":"2212.12042","title":"Re-basin via implicit Sinkhorn differentiation","created":"2022-12-22","cited_by_count":62},{"id":"2001.02312","title":"Stochastic Weight Averaging in Parallel: Large-Batch Training that Generalizes Well","created":"2020-01-07","cited_by_count":57},{"id":"2312.04501","title":"Graph Metanetworks for Processing Diverse Neural Architectures","created":"2023-12-07","cited_by_count":57},{"id":"2410.03617","title":"What Matters for Model Merging at Scale?","created":"2024-10-04","cited_by_count":55},{"id":"2406.11385","title":"MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic","created":"2024-06-17","cited_by_count":53},{"id":"2305.13546","title":"Neural Functional Transformers","created":"2023-05-22","cited_by_count":52},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50},{"id":"2307.08286","title":"Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity","created":"2023-07-17","cited_by_count":50},{"id":"2406.14563","title":"Model Merging and Safety Alignment: One Bad Model Spoils the Bunch","created":"2024-06-20","cited_by_count":43},{"id":"2306.06179","title":"Hidden symmetries of ReLU networks","created":"2023-06-09","cited_by_count":39},{"id":"2310.05719","title":"Transformer Fusion with Optimal Transport","created":"2023-10-09","cited_by_count":36},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35},{"id":"2310.13397","title":"Equivariant Deep Weight Space Alignment","created":"2023-10-20","cited_by_count":35},{"id":"1802.03713","title":"$\\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space","created":"2018-02-11","cited_by_count":27},{"id":"2205.10637","title":"Symmetry Teleportation for Accelerated Optimization","created":"2022-05-21","cited_by_count":25},{"id":"2309.16932","title":"Symmetry Induces Structure and Constraint of Learning","created":"2023-09-29","cited_by_count":25},{"id":"2310.19103","title":"Proving Linear Mode Connectivity of Neural Networks via Optimal Transport","created":"2023-10-29","cited_by_count":25},{"id":"2406.10685","title":"Scale Equivariant Graph Metanetworks","created":"2024-06-15","cited_by_count":24},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23},{"id":"2410.04209","title":"Equivariant Neural Functional Networks for Transformers","created":"2024-10-05","cited_by_count":22},{"id":"2405.20231","title":"The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof","created":"2024-05-30","cited_by_count":21},{"id":"2007.12213","title":"The Representation Theory of Neural Networks","created":"2020-07-23","cited_by_count":19},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19},{"id":"1511.01754","title":"Symmetry-invariant optimization in deep networks","created":"2015-11-05","cited_by_count":15},{"id":"2502.00158","title":"Resolving Editing-Unlearning Conflicts: A Knowledge Codebook Framework for Large Language Model Updating","created":"2025-01-31","cited_by_count":12},{"id":"2408.15495","title":"Remove Symmetries to Control Model Expressivity and Improve Optimization","created":"2024-08-28","cited_by_count":8},{"id":"2310.10171","title":"On permutation symmetries in Bayesian neural network posteriors: a variational perspective","created":"2023-10-16","cited_by_count":4},{"id":"2408.04381","title":"Understanding and Modeling Job Marketplace with Pretrained Language Models","created":"2024-08-08","cited_by_count":3},{"id":"2501.02711","title":"KG-CF: Knowledge Graph Completion with Context Filtering under the Guidance of Large Language Models","created":"2025-01-06","cited_by_count":1}],"next_cursor":null}