{"total":486,"rows":[{"id":"2107.06917","title":"A Field Guide to Federated Optimization","created":"2021-07-14","cited_by_count":315,"area":null},{"id":"2108.10252","title":"Federated Multi-Task Learning under a Mixture of Distributions","created":"2021-08-23","cited_by_count":192,"area":null},{"id":"2206.02618","title":"Generalized Federated Learning via Sharpness Aware Minimization","created":"2022-06-06","cited_by_count":144,"area":null},{"id":"2211.08413","title":"Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges","created":"2022-11-15","cited_by_count":138,"area":null},{"id":"2106.05203","title":"EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback","created":"2021-06-09","cited_by_count":133,"area":null},{"id":"2104.11375","title":"Decentralized Federated Averaging","created":"2021-04-23","cited_by_count":114,"area":null},{"id":"2112.12371","title":"DENSE: Data-Free One-Shot Federated Learning","created":"2021-12-23","cited_by_count":100,"area":null},{"id":"2111.12444","title":"Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications","created":"2021-11-24","cited_by_count":97,"area":null},{"id":"2206.01288","title":"Decentralized Training of Foundation Models in Heterogeneous Environments","created":"2022-06-02","cited_by_count":87,"area":null},{"id":"2306.01603","title":"Decentralized Federated Learning: A Survey and Perspective","created":"2023-06-02","cited_by_count":86,"area":null},{"id":"2206.08307","title":"Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning","created":"2022-06-16","cited_by_count":79,"area":null},{"id":"2102.07845","title":"MARINA: Faster Non-Convex Distributed Learning with Compression","created":"2021-02-15","cited_by_count":78,"area":null},{"id":"2102.02888","title":"1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed","created":"2021-02-04","cited_by_count":75,"area":null},{"id":"2206.00187","title":"DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training","created":"2022-06-01","cited_by_count":74,"area":null},{"id":"2102.04761","title":"Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data","created":"2021-02-09","cited_by_count":69,"area":null},{"id":"2202.03836","title":"An Improved Analysis of Gradient Tracking for Decentralized Machine Learning","created":"2022-02-08","cited_by_count":69,"area":null},{"id":"2104.14362","title":"From Distributed Machine Learning to Federated Learning: A Survey","created":"2021-04-29","cited_by_count":66,"area":null},{"id":"2403.13101","title":"AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networks","created":"2024-03-19","cited_by_count":64,"area":null},{"id":"2206.07638","title":"Asynchronous SGD Beats Minibatch SGD Under Arbitrary Delays","created":"2022-06-15","cited_by_count":63,"area":null},{"id":"2301.11913","title":"SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient","created":"2023-01-27","cited_by_count":59,"area":null},{"id":"2106.10207","title":"Distributed Deep Learning in Open Collaborations","created":"2021-06-18","cited_by_count":58,"area":null},{"id":"2110.13363","title":"Exponential Graph is Provably Efficient for Decentralized Deep Training","created":"2021-10-26","cited_by_count":56,"area":null},{"id":"2107.12048","title":"Decentralized Federated Learning: Balancing Communication and Computing Costs","created":"2021-07-26","cited_by_count":55,"area":null},{"id":"2102.04828","title":"Consensus Control for Decentralized Deep Learning","created":"2021-02-09","cited_by_count":49,"area":null},{"id":"2406.10416","title":"Byzantine-Robust Decentralized Federated Learning","created":"2024-06-14","cited_by_count":48,"area":null},{"id":"2302.04083","title":"Improving the Model Consistency of Decentralized Federated Learning","created":"2023-02-08","cited_by_count":45,"area":null},{"id":"2108.00951","title":"Rethinking gradient sparsification as total error minimization","created":"2021-08-02","cited_by_count":41,"area":null},{"id":"2201.13320","title":"BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression","created":"2022-01-31","cited_by_count":41,"area":null},{"id":"2104.11981","title":"DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training","created":"2021-04-24","cited_by_count":40,"area":null},{"id":"2110.04175","title":"RelaySum for Decentralized Deep Learning on Heterogeneous Data","created":"2021-10-08","cited_by_count":39,"area":null},{"id":"2206.04723","title":"On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Data","created":"2022-06-09","cited_by_count":38,"area":null},{"id":"2206.12680","title":"Topology-aware Generalization of Decentralized SGD","created":"2022-06-25","cited_by_count":38,"area":null},{"id":"2412.07197","title":"Hierarchical Split Federated Learning: Convergence Analysis and System Optimization","created":"2024-12-10","cited_by_count":38,"area":null},{"id":"2106.09397","title":"Quantized Federated Learning under Transmission Delay and Outage Constraints","created":"2021-06-17","cited_by_count":37,"area":null},{"id":"2103.03239","title":"Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices","created":"2021-03-04","cited_by_count":36,"area":null},{"id":"2102.07091","title":"Decentralized Riemannian Gradient Descent on the Stiefel Manifold","created":"2021-02-14","cited_by_count":33,"area":null},{"id":"2103.02051","title":"Cross-Gradient Aggregation for Decentralized Learning from Non-IID data","created":"2021-03-02","cited_by_count":33,"area":null},{"id":"2206.03665","title":"Lower Bounds and Nearly Optimal Algorithms in Distributed Learning with Communication Compression","created":"2022-06-08","cited_by_count":33,"area":null},{"id":"2204.04452","title":"Refined Convergence and Topology Learning for Decentralized SGD with Heterogeneous Data","created":"2022-04-09","cited_by_count":32,"area":null},{"id":"2206.10870","title":"Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks","created":"2022-06-22","cited_by_count":32,"area":null},{"id":"2301.01313","title":"Decentralized Gradient Tracking with Local Steps","created":"2023-01-03","cited_by_count":32,"area":null},{"id":"2103.11109","title":"DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregation","created":"2021-03-20","cited_by_count":31,"area":null},{"id":"2202.01545","title":"Byzantine-Robust Decentralized Learning via ClippedGossip","created":"2022-02-03","cited_by_count":31,"area":null},{"id":"2106.02743","title":"SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks","created":"2021-06-04","cited_by_count":30,"area":null},{"id":"2206.01299","title":"Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees","created":"2022-06-02","cited_by_count":30,"area":null},{"id":"2105.08023","title":"Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD","created":"2021-05-17","cited_by_count":29,"area":null},{"id":"2301.02982","title":"Why Batch Normalization Damage Federated Learning on Non-IID Data?","created":"2023-01-08","cited_by_count":29,"area":null},{"id":"2209.15259","title":"On the Impossible Safety of Large AI Models","created":"2022-09-30","cited_by_count":28,"area":null},{"id":"2206.03093","title":"Beyond spectral gap: The role of the topology in decentralized learning","created":"2022-06-07","cited_by_count":27,"area":null},{"id":"2206.05091","title":"Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averaging","created":"2022-06-10","cited_by_count":27,"area":null},{"id":"2103.00543","title":"On the Utility of Gradient Compression in Distributed Training Systems","created":"2021-02-28","cited_by_count":26,"area":null},{"id":"2101.05471","title":"Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration","created":"2021-01-14","cited_by_count":25,"area":null},{"id":"2105.09080","title":"Accelerating Gossip SGD with Periodic Global Averaging","created":"2021-05-19","cited_by_count":25,"area":null},{"id":"2106.08315","title":"Decentralized Local Stochastic Extra-Gradient for Variational Inequalities","created":"2021-06-15","cited_by_count":25,"area":null},{"id":"2210.07881","title":"Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate","created":"2022-10-14","cited_by_count":25,"area":null},{"id":"2401.17319","title":"Decentralized Federated Learning: A Survey on Security and Privacy","created":"2024-01-25","cited_by_count":25,"area":null},{"id":"2104.06069","title":"1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence Speed","created":"2021-04-13","cited_by_count":24,"area":null},{"id":"2203.12285","title":"Towards Effective Clustered Federated Learning: A Peer-to-peer Framework with Adaptive Neighbor Matching","created":"2022-03-23","cited_by_count":24,"area":null},{"id":"2111.05326","title":"The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning","created":"2021-11-09","cited_by_count":23,"area":null},{"id":"2205.08443","title":"On the (In)security of Peer-to-Peer Decentralized Machine Learning","created":"2022-05-17","cited_by_count":23,"area":null},{"id":"2210.07863","title":"Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization","created":"2022-10-14","cited_by_count":23,"area":null},{"id":"2302.02573","title":"Topology-aware Federated Learning in Edge Computing: A Comprehensive Survey","created":"2023-02-06","cited_by_count":23,"area":null},{"id":"2104.07557","title":"Decentralized Federated Learning for UAV Networks: Architecture, Challenges, and Opportunities","created":"2021-04-15","cited_by_count":22,"area":null},{"id":"2104.11125","title":"ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training","created":"2021-04-21","cited_by_count":22,"area":null},{"id":"2102.06752","title":"A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization","created":"2021-02-12","cited_by_count":21,"area":null},{"id":"2210.12839","title":"Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity","created":"2022-10-23","cited_by_count":21,"area":null},{"id":"2210.14026","title":"SWIFT: Rapid Decentralized Federated Learning via Wait-Free Model Communication","created":"2022-10-25","cited_by_count":21,"area":null},{"id":"2310.01972","title":"Epidemic Learning: Boosting Decentralized Learning with Randomized Communication","created":"2023-10-03","cited_by_count":21,"area":null},{"id":"2110.08133","title":"Trade-offs of Local SGD at Scale: An Empirical Study","created":"2021-10-15","cited_by_count":20,"area":null},{"id":"2209.15505","title":"Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data","created":"2022-09-30","cited_by_count":20,"area":null},{"id":"2102.03990","title":"DeEPCA: Decentralized Exact PCA with Linear Convergence Rate","created":"2021-02-08","cited_by_count":18,"area":null},{"id":"2106.08011","title":"Over-the-Air Decentralized Federated Learning","created":"2021-06-15","cited_by_count":18,"area":null},{"id":"2107.00961","title":"ResIST: Layer-Wise Decomposition of ResNets for Distributed Training","created":"2021-07-02","cited_by_count":18,"area":null},{"id":"2304.08322","title":"Decentralized Learning Made Easy with DecentralizePy","created":"2023-04-17","cited_by_count":18,"area":null},{"id":"2405.01031","title":"The Privacy Power of Correlated Noise in Decentralized Learning","created":"2024-05-02","cited_by_count":18,"area":null},{"id":"2104.00352","title":"Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space","created":"2021-04-01","cited_by_count":17,"area":null},{"id":"2104.05245","title":"Distributed Learning Systems with First-order Methods","created":"2021-04-12","cited_by_count":17,"area":null},{"id":"2109.03194","title":"On the Convergence of Decentralized Adaptive Gradient Methods","created":"2021-09-07","cited_by_count":17,"area":null},{"id":"2110.12347","title":"Acceleration in Distributed Optimization under Similarity","created":"2021-10-24","cited_by_count":17,"area":null},{"id":"2111.05897","title":"Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters","created":"2021-11-10","cited_by_count":17,"area":null},{"id":"2302.02589","title":"$z$-SignFedAvg: A Unified Stochastic Sign-based Compression for Federated Learning","created":"2023-02-06","cited_by_count":17,"area":null},{"id":"2306.14853","title":"Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles","created":"2023-06-26","cited_by_count":17,"area":null},{"id":"2402.16828","title":"Training Neural Networks from Scratch with Parallel Low-Rank Adapters","created":"2024-02-26","cited_by_count":17,"area":null},{"id":"2105.07806","title":"Towards Demystifying Serverless Machine Learning Training","created":"2021-05-17","cited_by_count":16,"area":null},{"id":"2110.01165","title":"DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization","created":"2021-10-04","cited_by_count":16,"area":null},{"id":"2111.04287","title":"BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning","created":"2021-11-08","cited_by_count":16,"area":null},{"id":"2205.10998","title":"Semi-Decentralized Federated Learning with Collaborative Relaying","created":"2022-05-23","cited_by_count":16,"area":null},{"id":"2107.11304","title":"Finite-Bit Quantization For Distributed Algorithms With Linear Convergence","created":"2021-07-23","cited_by_count":15,"area":null},{"id":"2202.06009","title":"Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam","created":"2022-02-12","cited_by_count":15,"area":null},{"id":"2306.02913","title":"Decentralized SGD and Average-direction SAM are Asymptotically Equivalent","created":"2023-06-05","cited_by_count":15,"area":null},{"id":"2311.05645","title":"EControl: Fast Distributed Optimization with Compression and Error Control","created":"2023-11-06","cited_by_count":15,"area":null},{"id":"2312.10935","title":"AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices","created":"2023-12-18","cited_by_count":15,"area":null},{"id":"2402.07011","title":"FedImpro: Measuring and Improving Client Update in Federated Learning","created":"2024-02-10","cited_by_count":15,"area":null},{"id":"2506.08426","title":"HASFL: Heterogeneity-aware Split Federated Learning over Edge Computing Systems","created":"2025-06-10","cited_by_count":15,"area":null},{"id":"2206.15025","title":"On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network","created":"2022-06-30","cited_by_count":14,"area":null},{"id":"2305.16297","title":"Unbiased Compression Saves Communication in Distributed Optimization: When and How Much?","created":"2023-05-25","cited_by_count":14,"area":null},{"id":"2105.04851","title":"Improving the Transient Times for Distributed Stochastic Gradient Methods","created":"2021-05-11","cited_by_count":13,"area":null},{"id":"2107.01499","title":"BAGUA: Scaling up Distributed Learning with System Relaxations","created":"2021-07-03","cited_by_count":13,"area":null},{"id":"2104.07365","title":"D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning","created":"2021-04-15","cited_by_count":12,"area":null},{"id":"2203.10736","title":"The activity-weight duality in feed forward neural networks: The geometric determinants of generalization","created":"2022-03-21","cited_by_count":12,"area":null}],"next_cursor":"100"}