{"total":59,"rows":[{"id":"2401.04088","title":"Mixtral of Experts","created":"2024-01-08","cited_by_count":1823,"area":"moe"},{"id":"2202.08906","title":"ST-MoE: Designing Stable and Transferable Sparse Expert Models","created":"2022-02-17","cited_by_count":399,"area":"moe"},{"id":"2206.02770","title":"Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts","created":"2022-06-06","cited_by_count":203,"area":"moe"},{"id":"2309.05444","title":"Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning","created":"2023-09-11","cited_by_count":150,"area":"moe"},{"id":"2209.01667","title":"A Review of Sparse Expert Models in Deep Learning","created":"2022-09-04","cited_by_count":148,"area":"moe"},{"id":"2210.14793","title":"M$^3$ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design","created":"2022-10-26","cited_by_count":98,"area":"moe"},{"id":"2306.03745","title":"Soft Merging of Experts with Adaptive Routing","created":"2023-06-06","cited_by_count":90,"area":"moe"},{"id":"2402.08609","title":"Mixtures of Experts Unlock Parameter Scaling for Deep RL","created":"2024-02-13","cited_by_count":78,"area":"moe"},{"id":"2305.14705","title":"Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models","created":"2023-05-24","cited_by_count":65,"area":"moe"},{"id":"2303.01610","title":"Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers","created":"2023-03-02","cited_by_count":59,"area":"moe"},{"id":"2405.14124","title":"Mixture of Experts Meets Prompt-Based Continual Learning","created":"2024-05-23","cited_by_count":43,"area":"moe"},{"id":"2303.06182","title":"Towards MoE Deployment: Mitigating Inefficiencies in Mixture-of-Expert (MoE) Inference","created":"2023-03-10","cited_by_count":37,"area":"moe"},{"id":"2305.03288","title":"Demystifying Softmax Gating Function in Gaussian Mixture of Experts","created":"2023-05-05","cited_by_count":33,"area":"moe"},{"id":"2112.14397","title":"EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate","created":"2021-12-29","cited_by_count":30,"area":"moe"},{"id":"2309.13850","title":"Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts","created":"2023-09-25","cited_by_count":29,"area":"moe"},{"id":"2404.08452","title":"MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection","created":"2024-04-12","cited_by_count":27,"area":"moe"},{"id":"2402.12656","title":"HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts","created":"2024-02-20","cited_by_count":26,"area":"moe"},{"id":"2405.13997","title":"Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts","created":"2024-05-22","cited_by_count":24,"area":"moe"},{"id":"2310.14188","title":"A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts","created":"2023-10-22","cited_by_count":23,"area":"moe"},{"id":"2402.02952","title":"On Least Square Estimation in Softmax Gating Mixture of Experts","created":"2024-02-05","cited_by_count":23,"area":"moe"},{"id":"2403.20022","title":"Psychometry: An Omnifit Model for Image Reconstruction from Human Brain Activity","created":"2024-03-29","cited_by_count":22,"area":"moe"},{"id":"2406.18420","title":"Mixture of Experts in a Mixture of RL settings","created":"2024-06-26","cited_by_count":21,"area":"moe"},{"id":"2501.16352","title":"Mixture of Experts (MoE): A Big Data Perspective","created":"2025-01-18","cited_by_count":18,"area":"moe"},{"id":"2310.07188","title":"Adaptive Gating in Mixture-of-Experts based Language Models","created":"2023-10-11","cited_by_count":16,"area":"moe"},{"id":"2405.14131","title":"Statistical Advantages of Perturbing Cosine Router in Mixture of Experts","created":"2024-05-23","cited_by_count":16,"area":"moe"},{"id":"2410.10456","title":"Ada-K Routing: Boosting the Efficiency of MoE-based LLMs","created":"2024-10-14","cited_by_count":16,"area":"moe"},{"id":"2401.13875","title":"Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?","created":"2024-01-25","cited_by_count":15,"area":"moe"},{"id":"2403.07965","title":"Conditional computation in neural networks: principles and research trends","created":"2024-03-12","cited_by_count":10,"area":"moe"},{"id":"2402.02933","title":"Intrinsic User-Centric Interpretability through Global Mixture of Experts","created":"2024-02-05","cited_by_count":9,"area":"moe"},{"id":"2405.19086","title":"MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors","created":"2024-05-29","cited_by_count":9,"area":"moe"},{"id":"2211.08253","title":"HMOE: Hypernetwork-based Mixture of Experts for Domain Generalization","created":"2022-11-15","cited_by_count":8,"area":"moe"},{"id":"2402.06512","title":"Multimodal Clinical Trial Outcome Prediction with Large Language Models","created":"2024-02-09","cited_by_count":7,"area":"moe"},{"id":"2408.15901","title":"Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts","created":"2024-08-28","cited_by_count":7,"area":"moe"},{"id":"2411.00918","title":"LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models","created":"2024-11-01","cited_by_count":6,"area":"moe"},{"id":"2504.01337","title":"Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Parallelism Design","created":"2025-04-02","cited_by_count":6,"area":"moe"},{"id":"2310.15961","title":"Mixture of Tokens: Continuous MoE through Cross-Example Aggregation","created":"2023-10-24","cited_by_count":5,"area":"moe"},{"id":"2410.03440","title":"Exploring the Benefit of Activation Sparsity in Pre-training","created":"2024-10-04","cited_by_count":5,"area":"moe"},{"id":"2502.00281","title":"Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective","created":"2025-02-01","cited_by_count":4,"area":"moe"},{"id":"2503.21135","title":"DynaMo: Runtime Switchable Quantization for MoE with Cross-Dataset Adaptation","created":"2025-03-27","cited_by_count":4,"area":"moe"},{"id":"2209.15207","title":"Mixture of experts models for multilevel data: modelling framework and approximation theory","created":"2022-09-30","cited_by_count":3,"area":"moe"},{"id":"2402.18787","title":"Enhancing the \"Immunity\" of Mixture-of-Experts Networks for Adversarial Defense","created":"2024-02-29","cited_by_count":3,"area":"moe"},{"id":"2503.20633","title":"Enhancing Multi-modal Models with Heterogeneous MoE Adapters for Fine-tuning","created":"2025-03-26","cited_by_count":3,"area":"moe"},{"id":"2510.16138","title":"Expert Merging in Sparse Mixture of Experts with Nash Bargaining","created":"2025-10-17","cited_by_count":3,"area":"moe"},{"id":"2601.03577","title":"Variational Inference, Entropy, and Orthogonality: A Unified Theory of Mixture-of-Experts","created":"2026-01-07","cited_by_count":3,"area":"moe"},{"id":"2603.04348","title":"RANGER: Sparsely-Gated Mixture-of-Experts with Adaptive Retrieval Re-ranking for Pathology Report Generation","created":"2026-03-04","cited_by_count":3,"area":"moe"},{"id":"2306.02824","title":"COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Search","created":"2023-06-05","cited_by_count":2,"area":"moe"},{"id":"2402.05220","title":"On Parameter Estimation in Deviated Gaussian Mixture of Experts","created":"2024-02-07","cited_by_count":2,"area":"moe"},{"id":"2503.09504","title":"Double-Stage Feature-Level Clustering-Based Mixture of Experts Framework","created":"2025-03-12","cited_by_count":2,"area":"moe"},{"id":"2510.13079","title":"GatePro: Parameter-Free Expert Selection Optimization for Mixture-of-Experts Models","created":"2025-10-15","cited_by_count":2,"area":"moe"},{"id":"2608.08627","title":"UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models","created":"2026-08-09","cited_by_count":2,"area":"moe"},{"id":"2410.15732","title":"ViMoE: An Empirical Study of Designing Vision Mixture-of-Experts","created":"2024-10-21","cited_by_count":1,"area":"moe"},{"id":"2505.01105","title":"CoCoAFusE: Beyond Mixtures of Experts via Model Fusion","created":"2025-05-02","cited_by_count":1,"area":"moe"},{"id":"2607.08250","title":"On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting","created":"2026-07-09","cited_by_count":1,"area":"moe"},{"id":"2412.17009","title":"Expert Routing with Synthetic Data for Continual Learning","created":"2024-12-22","cited_by_count":0,"area":"moe"},{"id":"2604.03342","title":"Mixture-of-Experts in Remote Sensing: A Survey","created":"2026-04-03","cited_by_count":0,"area":"moe"},{"id":"2604.21330","title":"Teacher-Guided Routing for Sparse Vision Mixture-of-Experts","created":"2026-04-23","cited_by_count":0,"area":"moe"},{"id":"2606.09907","title":"LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts","created":"2026-06-06","cited_by_count":0,"area":"moe"},{"id":"2608.23794","title":"Mixture of Channel Experts: Static Sparse Supports with Input-Adaptive Mixing for Pointwise Projections","created":"2026-08-24","cited_by_count":0,"area":"moe"},{"id":"2610.11575","title":"Smoothing the Top-k Exposure Boundary for Sparse Mixture-of-Experts","created":"2026-10-08","cited_by_count":0,"area":"moe"}],"next_cursor":null}