{"total":48,"rows":[{"id":"2304.13960","title":"Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be","created":"2023-04-27","cited_by_count":114,"area":null},{"id":"2309.05516","title":"Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs","created":"2023-09-11","cited_by_count":50,"area":null},{"id":"2506.04192","title":"Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise","created":"2025-06-04","cited_by_count":41,"area":null},{"id":"2206.01299","title":"Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees","created":"2022-06-02","cited_by_count":30,"area":null},{"id":"2507.16099","title":"TorchAO: PyTorch-Native Training-to-Serving Model Optimization","created":"2025-07-21","cited_by_count":26,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2204.13169","title":"FedShuffle: Recipes for Better Use of Local Work in Federated Learning","created":"2022-04-27","cited_by_count":21,"area":null},{"id":"2302.02589","title":"$z$-SignFedAvg: A Unified Stochastic Sign-based Compression for Federated Learning","created":"2023-02-06","cited_by_count":17,"area":null},{"id":"2202.06009","title":"Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam","created":"2022-02-12","cited_by_count":15,"area":null},{"id":"2406.00489","title":"Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction","created":"2024-06-01","cited_by_count":13,"area":null},{"id":"2502.07923","title":"Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2411.07724","title":"Convergence Rate Analysis of LION","created":"2024-11-12","cited_by_count":11,"area":null},{"id":"2106.03524","title":"Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques","created":"2021-06-07","cited_by_count":9,"area":null},{"id":"2408.03215","title":"FedBAT: Communication-Efficient Federated Learning via Learnable Binarization","created":"2024-08-06","cited_by_count":9,"area":null},{"id":"2506.04430","title":"Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order","created":"2025-06-04","cited_by_count":9,"area":null},{"id":"2305.13187","title":"SignSVRG: fixing SignSGD via variance reduction","created":"2023-05-22","cited_by_count":7,"area":null},{"id":"2110.02998","title":"Federated Learning via Plurality Vote","created":"2021-10-06","cited_by_count":6,"area":null},{"id":"2206.10452","title":"Shifted Compression Framework: Generalizations and Improvements","created":"2022-06-21","cited_by_count":6,"area":null},{"id":"2306.16484","title":"Towards a Better Theoretical Understanding of Independent Subnetwork Training","created":"2023-06-28","cited_by_count":6,"area":null},{"id":"2402.09941","title":"FedLion: Faster Adaptive Federated Optimization with Fewer Communication","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2507.12091","title":"Better Convergence Guarantees for Sign-Based Momentum Methods","created":"2025-07-16","cited_by_count":6,"area":null},{"id":"2204.06787","title":"Sign Bit is Enough: A Learning Synchronization Framework for Multi-hop All-reduce with Ultimate Compression","created":"2022-04-14","cited_by_count":5,"area":null},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2505.18724","title":"LoTA-QAF: Lossless Ternary Adaptation for Quantization-Aware Fine-Tuning","created":"2025-05-24","cited_by_count":5,"area":null},{"id":"2604.15416","title":"StoSignSGD: Unbiased Structural Stochasticity Fixes SignSGD for Training Large Language Models","created":"2026-04-16","cited_by_count":5,"area":null},{"id":"2210.00665","title":"Distributed Non-Convex Optimization with One-Bit Compressors on Heterogeneous Data: Efficient and Resilient Algorithms","created":"2022-10-03","cited_by_count":4,"area":null},{"id":"2303.05206","title":"FedREP: A Byzantine-Robust, Communication-Efficient and Privacy-Preserving Framework for Federated Learning","created":"2023-03-09","cited_by_count":4,"area":null},{"id":"2310.14616","title":"Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz","created":"2023-10-23","cited_by_count":4,"area":null},{"id":"2403.14716","title":"Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers","created":"2024-03-19","cited_by_count":4,"area":null},{"id":"2408.03220","title":"Masked Random Noise for Communication Efficient Federated Learning","created":"2024-08-06","cited_by_count":4,"area":null},{"id":"2506.00181","title":"On the Interaction of Batch Noise, Adaptivity, and Compression, under $(L_0,L_1)$-Smoothness: An SDE Approach","created":"2025-05-30","cited_by_count":4,"area":null},{"id":"2510.00823","title":"Non-Euclidean Broximal Point Method: A Blueprint for Geometry-Aware Optimization","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2302.09624","title":"Breaking the Communication-Privacy-Accuracy Tradeoff with $f$-Differential Privacy","created":"2023-02-19","cited_by_count":3,"area":null},{"id":"2507.08963","title":"Stochastic Approximation with Block Coordinate Optimal Stepsizes","created":"2025-07-11","cited_by_count":3,"area":null},{"id":"2302.09634","title":"Magnitude Matters: Fixing SIGNSGD Through Magnitude-Aware Sparsification in the Presence of Data Heterogeneity","created":"2023-02-19","cited_by_count":2,"area":null},{"id":"2310.15976","title":"Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization","created":"2023-10-24","cited_by_count":2,"area":null},{"id":"2402.10816","title":"TernaryVote: Differentially Private, Communication Efficient, and Byzantine Resilient Distributed Optimization on Heterogeneous Data","created":"2024-02-16","cited_by_count":2,"area":null},{"id":"2403.16372","title":"SignSGD with Federated Voting","created":"2024-03-25","cited_by_count":2,"area":null},{"id":"2605.06615","title":"When and Why SignSGD Outperforms SGD: A Theoretical Study Based on $\\ell_1$-norm Lower Bounds","created":"2026-05-07","cited_by_count":2,"area":null},{"id":"2605.18528","title":"Tight Complexity of Muon under Heavy-Tailed Noise","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2411.16462","title":"Lion Cub: Minimizing Communication Overhead in Distributed Lion","created":"2024-11-25","cited_by_count":1,"area":null},{"id":"2411.17866","title":"Distributed Sign Momentum with Local Steps for Training Transformers","created":"2024-11-26","cited_by_count":1,"area":null},{"id":"2503.17867","title":"Detecting and Mitigating DDoS Attacks with AI: A Survey","created":"2025-03-22","cited_by_count":1,"area":null},{"id":"2601.18950","title":"Collaborative Compressors in Distributed Mean Estimation with Limited Communication Budget","created":"2026-01-26","cited_by_count":1,"area":null},{"id":"2602.02355","title":"Mitigating Heterogeneity-Induced Drift in Hierarchical Sign-Based Federated Learning","created":"2026-02-02","cited_by_count":0,"area":null},{"id":"2607.20890","title":"Information-Theoretically Secure Aggregation for Lightweight Federated Learning: Resilient to Dropouts and Adversaries","created":"2026-07-23","cited_by_count":0,"area":null},{"id":"2607.29674","title":"Sign compression for Muon: SignMuon, MuonSign, and the Limits of Error Feedback","created":"2026-07-31","cited_by_count":0,"area":null},{"id":"2609.18656","title":"Revisiting Distributed Sign-Based Variance Reduction","created":"2026-09-16","cited_by_count":0,"area":null}],"next_cursor":null}