{"list":"other","total":58,"rows":[{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1803.05457","title":"Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge","created":"2018-03-14","cited_by_count":4886},{"id":"1905.07830","title":"HellaSwag: Can a Machine Really Finish Your Sentence?","created":"2019-05-19","cited_by_count":4100},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"1911.11641","title":"PIQA: Reasoning about Physical Commonsense in Natural Language","created":"2019-11-26","cited_by_count":2883},{"id":"1905.10044","title":"BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions","created":"2019-05-24","cited_by_count":2183},{"id":"1809.02789","title":"Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering","created":"2018-09-08","cited_by_count":2164},{"id":"2401.04088","title":"Mixtral of Experts","created":"2024-01-08","cited_by_count":1823},{"id":"2006.16668","title":"GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding","created":"2020-06-30","cited_by_count":1631},{"id":"2012.14913","title":"Transformer Feed-Forward Layers Are Key-Value Memories","created":"2020-12-29","cited_by_count":1336},{"id":"1907.02189","title":"On the Convergence of FedAvg on Non-IID Data","created":"2019-07-04","cited_by_count":1229},{"id":"1606.04838","title":"Optimization Methods for Large-Scale Machine Learning","created":"2016-06-15","cited_by_count":1150},{"id":"2405.04434","title":"DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model","created":"2024-05-07","cited_by_count":1135},{"id":"2112.06905","title":"GLaM: Efficient Scaling of Language Models with Mixture-of-Experts","created":"2021-12-13","cited_by_count":897},{"id":"1909.06335","title":"Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification","created":"2019-09-13","cited_by_count":851},{"id":"2402.00838","title":"OLMo: Accelerating the Science of Language Models","created":"2024-02-01","cited_by_count":613},{"id":"1608.04636","title":"Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-\\L{}ojasiewicz Condition","created":"2016-08-16","cited_by_count":539},{"id":"2202.08906","title":"ST-MoE: Designing Stable and Transferable Sparse Expert Models","created":"2022-02-17","cited_by_count":399},{"id":"1905.12022","title":"Bayesian Nonparametric Federated Learning of Neural Networks","created":"2019-05-28","cited_by_count":387},{"id":"2003.10422","title":"A Unified Theory of Decentralized SGD with Changing Topology and Local Updates","created":"2020-03-23","cited_by_count":367},{"id":"2304.01933","title":"LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models","created":"2023-04-04","cited_by_count":324},{"id":"2409.02060","title":"OLMoE: Open Mixture-of-Experts Language Models","created":"2024-09-03","cited_by_count":301},{"id":"1901.09401","title":"SGD: General Analysis and Improved Rates","created":"2019-01-27","cited_by_count":207},{"id":"2408.15664","title":"Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts","created":"2024-08-28","cited_by_count":205},{"id":"2305.05644","title":"Towards Building the Federated GPT: Federated Instruction Tuning","created":"2023-05-09","cited_by_count":185},{"id":"2403.12313","title":"Improving LoRA in Privacy-preserving Federated Learning","created":"2024-03-18","cited_by_count":161},{"id":"2409.05976","title":"FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations","created":"2024-09-09","cited_by_count":146},{"id":"2401.06432","title":"Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models","created":"2024-01-12","cited_by_count":116},{"id":"2308.08165","title":"Stochastic Controlled Averaging for Federated Learning with Communication Compression","created":"2023-08-16","cited_by_count":101},{"id":"2402.11505","title":"Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources","created":"2024-02-18","cited_by_count":93},{"id":"2008.00051","title":"On the Convergence of SGD with Biased Gradients","created":"2020-07-31","cited_by_count":83},{"id":"2308.12305","title":"FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning","created":"2023-08-21","cited_by_count":60},{"id":"2308.15367","title":"Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generation","created":"2023-08-29","cited_by_count":54},{"id":"2412.14711","title":"ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing","created":"2024-12-19","cited_by_count":54},{"id":"2501.11873","title":"Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models","created":"2025-01-21","cited_by_count":54},{"id":"2002.10790","title":"Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning","created":"2020-02-25","cited_by_count":47},{"id":"1902.00629","title":"Non-asymptotic Analysis of Biased Stochastic Approximation Scheme","created":"2019-02-02","cited_by_count":45},{"id":"2305.16296","title":"A Guide Through the Zoo of Biased SGD","created":"2023-05-25","cited_by_count":40},{"id":"2307.09182","title":"Federated Learning for Computationally-Constrained Heterogeneous Devices: A Survey","created":"2023-07-18","cited_by_count":40},{"id":"2310.08670","title":"Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models Reduction","created":"2023-10-12","cited_by_count":24},{"id":"2311.03154","title":"Convergence Analysis of Sequential Federated Learning on Heterogeneous Data","created":"2023-11-06","cited_by_count":23},{"id":"2409.19610","title":"Federated Learning from Vision-Language Foundation Models: Theoretical Analysis and Method","created":"2024-09-29","cited_by_count":22},{"id":"2411.19557","title":"Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning","created":"2024-11-29","cited_by_count":22},{"id":"2404.08003","title":"Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis","created":"2024-04-09","cited_by_count":21},{"id":"2410.09432","title":"FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models","created":"2024-10-12","cited_by_count":18},{"id":"2310.00811","title":"Sparse Backpropagation for MoE Training","created":"2023-10-01","cited_by_count":17},{"id":"2402.15166","title":"Convergence Analysis of Split Federated Learning on Heterogeneous Data","created":"2024-02-23","cited_by_count":17},{"id":"2409.12136","title":"GRIN: GRadient-INformed MoE","created":"2024-09-18","cited_by_count":17},{"id":"2504.21099","title":"A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning","created":"2025-04-29","cited_by_count":17},{"id":"2112.15400","title":"A Theoretical Understanding of Gradient Bias in Meta-Reinforcement Learning","created":"2021-12-31","cited_by_count":12},{"id":"2502.15436","title":"Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning","created":"2025-02-21","cited_by_count":10},{"id":"2504.12463","title":"Dense Backpropagation Improves Training for Sparse Mixture-of-Experts","created":"2025-04-16","cited_by_count":10},{"id":"2503.20117","title":"Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainable","created":"2025-03-25","cited_by_count":6},{"id":"2501.13985","title":"Pilot: Building the Federated Multimodal Instruction Tuning Framework","created":"2025-01-23","cited_by_count":5},{"id":"2405.17267","title":"FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation","created":"2024-05-27","cited_by_count":3},{"id":"2411.01548","title":"Analysis of regularized federated learning","created":"2024-11-03","cited_by_count":1},{"id":"2512.03915","title":"A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models","created":"2025-12-03","cited_by_count":1}],"next_cursor":null}