{"list":"other","total":56,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"1706.04599","title":"On Calibration of Modern Neural Networks","created":"2017-06-14","cited_by_count":4960},{"id":"1912.04977","title":"Advances and Open Problems in Federated Learning","created":"2019-12-10","cited_by_count":3046},{"id":"1812.06127","title":"Federated Optimization in Heterogeneous Networks","created":"2018-12-14","cited_by_count":2987},{"id":"1803.08494","title":"Group Normalization","created":"2018-03-22","cited_by_count":1524},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1907.02189","title":"On the Convergence of FedAvg on Non-IID Data","created":"2019-07-04","cited_by_count":1229},{"id":"1909.10351","title":"TinyBERT: Distilling BERT for Natural Language Understanding","created":"2019-09-23","cited_by_count":1167},{"id":"2003.00295","title":"Adaptive Federated Optimization","created":"2020-02-29","cited_by_count":1046},{"id":"2007.07481","title":"Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization","created":"2020-07-15","cited_by_count":906},{"id":"1909.06335","title":"Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification","created":"2019-09-13","cited_by_count":851},{"id":"1901.08584","title":"Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks","created":"2019-01-24","cited_by_count":566},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1608.04636","title":"Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-\\L{}ojasiewicz Condition","created":"2016-08-16","cited_by_count":539},{"id":"1703.11008","title":"Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data","created":"2017-03-31","cited_by_count":533},{"id":"2003.10422","title":"A Unified Theory of Decentralized SGD with Changing Topology and Local Updates","created":"2020-03-23","cited_by_count":367},{"id":"2104.07914","title":"Federated Learning for Internet of Things: A Comprehensive Survey","created":"2021-04-16","cited_by_count":252},{"id":"1905.11604","title":"SGD on Neural Networks Learns Functions of Increasing Complexity","created":"2019-05-28","cited_by_count":204},{"id":"2001.09122","title":"Reasoning About Generalization via Conditional Mutual Information","created":"2020-01-24","cited_by_count":147},{"id":"2206.02618","title":"Generalized Federated Learning via Sharpness Aware Minimization","created":"2022-06-06","cited_by_count":144},{"id":"2108.10749","title":"Federated Learning for Open Banking","created":"2021-08-24","cited_by_count":141},{"id":"1712.07897","title":"Non-convex Optimization for Machine Learning","created":"2017-12-21","cited_by_count":133},{"id":"1810.11914","title":"Rademacher Complexity for Adversarially Robust Generalization","created":"2018-10-29","cited_by_count":132},{"id":"2010.05627","title":"Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning","created":"2020-10-12","cited_by_count":126},{"id":"2311.08105","title":"DiLoCo: Distributed Low-Communication Training of Language Models","created":"2023-11-14","cited_by_count":121},{"id":"2006.08157","title":"Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent","created":"2020-06-15","cited_by_count":119},{"id":"2006.08907","title":"Robust Federated Learning: The Case of Affine Distribution Shifts","created":"2020-06-16","cited_by_count":102},{"id":"1710.08402","title":"Stability and Generalization of Learning Algorithms that Converge to Global Optima","created":"2017-10-23","cited_by_count":100},{"id":"2311.06750","title":"Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark","created":"2023-11-12","cited_by_count":99},{"id":"2203.11834","title":"Improving Generalization in Federated Learning by Seeking Flat Minima","created":"2022-03-22","cited_by_count":98},{"id":"1703.01678","title":"Data-Dependent Stability of Stochastic Gradient Descent","created":"2017-03-05","cited_by_count":92},{"id":"2102.00931","title":"Information-Theoretic Generalization Bounds for Stochastic Gradient Descent","created":"2021-02-01","cited_by_count":84},{"id":"1801.04295","title":"Generalization Error Bounds for Noisy, Iterative Algorithms","created":"2018-01-12","cited_by_count":82},{"id":"2402.19449","title":"Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models","created":"2024-02-29","cited_by_count":80},{"id":"2106.10874","title":"FedCM: Federated Learning with Client-level Momentum","created":"2021-06-21","cited_by_count":77},{"id":"2207.14130","title":"FedVARP: Tackling the Variance Due to Partial Client Participation in Federated Learning","created":"2022-07-28","cited_by_count":64},{"id":"1902.00621","title":"On Generalization Error Bounds of Noisy Gradient Methods for Non-Convex Learning","created":"2019-02-02","cited_by_count":57},{"id":"1804.01619","title":"Stability and Convergence Trade-off of Iterative Optimization Algorithms","created":"2018-04-04","cited_by_count":53},{"id":"1803.10266","title":"Privacy-preserving Prediction","created":"2018-03-27","cited_by_count":48},{"id":"2305.11584","title":"Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape","created":"2023-05-19","cited_by_count":46},{"id":"2010.13988","title":"Toward Better Generalization Bounds with Locally Elastic Stability","created":"2020-10-27","cited_by_count":42},{"id":"2207.05931","title":"Towards understanding how momentum improves generalization in deep learning","created":"2022-07-13","cited_by_count":40},{"id":"1702.08712","title":"Algorithmic stability and hypothesis complexity","created":"2017-02-28","cited_by_count":39},{"id":"2206.04723","title":"On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Data","created":"2022-06-09","cited_by_count":38},{"id":"2303.11242","title":"Make Landscape Flatter in Differentially Private Federated Learning","created":"2023-03-20","cited_by_count":33},{"id":"2306.03824","title":"Understanding Generalization of Federated Learning via Stability: Heterogeneity Matters","created":"2023-06-06","cited_by_count":27},{"id":"2206.07082","title":"Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems","created":"2022-06-14","cited_by_count":25},{"id":"2302.10637","title":"A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacy","created":"2023-02-21","cited_by_count":24},{"id":"1904.04755","title":"Hypothesis Set Stability and Generalization","created":"2019-04-09","cited_by_count":23},{"id":"2306.05706","title":"Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization","created":"2023-06-09","cited_by_count":21},{"id":"2312.12670","title":"On the Role of Server Momentum in Federated Learning","created":"2023-12-19","cited_by_count":16},{"id":"1802.06903","title":"Generalization Error Bounds with Probabilistic Guarantee for SGD in Nonconvex Optimization","created":"2018-02-19","cited_by_count":14},{"id":"2409.13155","title":"Convergence of Distributed Adaptive Optimization with Local Updates","created":"2024-09-20","cited_by_count":10},{"id":"2106.06153","title":"Towards Understanding Generalization via Decomposing Excess Risk Dynamics","created":"2021-06-11","cited_by_count":5},{"id":"2305.02247","title":"Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally","created":"2023-05-03","cited_by_count":5}],"next_cursor":null}