{"total":135,"rows":[{"id":"2606.19348","title":"DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence","created":"2026-04-26","cited_by_count":1040,"area":"moe"},{"id":"2601.07372","title":"Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models","created":"2026-01-12","cited_by_count":86,"area":"moe"},{"id":"2501.11873","title":"Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models","created":"2025-01-21","cited_by_count":54,"area":"moe"},{"id":"2505.22323","title":"Advancing Expert Specialization for Better MoE","created":"2025-05-28","cited_by_count":39,"area":"moe"},{"id":"2601.08393","title":"Controlled LLM Training on Spectral Sphere","created":"2026-01-13","cited_by_count":31,"area":"moe"},{"id":"2506.14038","title":"Load Balancing Mixture of Experts with Similarity Preserving Routers","created":"2025-06-16","cited_by_count":22,"area":"moe"},{"id":"2512.14080","title":"SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations","created":"2025-12-16","cited_by_count":21,"area":"moe"},{"id":"2603.07685","title":"Scalable Training of Mixture-of-Experts Models with Megatron Core","created":"2026-03-08","cited_by_count":19,"area":"moe"},{"id":"2607.07675","title":"Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence","created":"2026-07-08","cited_by_count":15,"area":"moe"},{"id":"2601.18089","title":"LatentMoE: Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts","created":"2026-01-26","cited_by_count":14,"area":"moe"},{"id":"2501.15103","title":"Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning","created":"2025-01-25","cited_by_count":13,"area":"moe"},{"id":"2601.20205","title":"Hyperparameter Transfer with Mixture-of-Expert Layers","created":"2026-01-28","cited_by_count":13,"area":"moe"},{"id":"2604.09780","title":"The Myth of Expert Specialization in MoEs: Why Routing Reflects Geometry, Not Necessarily Domain Expertise","created":"2026-04-10","cited_by_count":13,"area":"moe"},{"id":"2508.19594","title":"Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs","created":"2025-08-27","cited_by_count":12,"area":"moe"},{"id":"2509.21892","title":"Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts","created":"2025-09-26","cited_by_count":11,"area":"moe"},{"id":"2512.23447","title":"Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary Loss","created":"2025-12-29","cited_by_count":11,"area":"moe"},{"id":"2602.04705","title":"ERNIE 5.0 Technical Report","created":"2026-02-04","cited_by_count":11,"area":"moe"},{"id":"2602.17004","title":"Arcee Trinity Large Technical Report","created":"2026-02-19","cited_by_count":11,"area":"moe"},{"id":"2504.12463","title":"Dense Backpropagation Improves Training for Sparse Mixture-of-Experts","created":"2025-04-16","cited_by_count":10,"area":"moe"},{"id":"2508.02853","title":"Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic Perspectives","created":"2025-08-04","cited_by_count":10,"area":"moe"},{"id":"2509.25278","title":"MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series","created":"2025-09-29","cited_by_count":10,"area":"moe"},{"id":"2510.17483","title":"ReXMoE: Reusing Experts with Minimal Overhead in Mixture-of-Experts","created":"2025-10-20","cited_by_count":10,"area":"moe"},{"id":"2605.07260","title":"When Are Experts Misrouted? Counterfactual Routing Analysis in Mixture-of-Experts Language Models","created":"2026-05-08","cited_by_count":9,"area":"moe"},{"id":"2606.04101","title":"UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing","created":"2026-06-02","cited_by_count":9,"area":"moe"},{"id":"2501.13074","title":"Autonomy-of-Experts Models","created":"2025-01-22","cited_by_count":7,"area":"moe"},{"id":"2509.23933","title":"Beyond Benchmarks: Understanding Mixture-of-Experts Models through Internal Mechanisms","created":"2025-09-28","cited_by_count":7,"area":"moe"},{"id":"2511.10971","title":"ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization","created":"2025-11-14","cited_by_count":7,"area":"moe"},{"id":"2512.01252","title":"Efficient Training of Diffusion Mixture-of-Experts Models: A Practical Recipe","created":"2025-12-01","cited_by_count":7,"area":"moe"},{"id":"2411.00918","title":"LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models","created":"2024-11-01","cited_by_count":6,"area":"moe"},{"id":"2503.05447","title":"Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts","created":"2025-03-07","cited_by_count":6,"area":"moe"},{"id":"2507.08771","title":"BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity","created":"2025-07-11","cited_by_count":6,"area":"moe"},{"id":"2509.25913","title":"Understanding the Mixture-of-Experts with Nadaraya-Watson Kernel","created":"2025-09-30","cited_by_count":6,"area":"moe"},{"id":"2511.06494","title":"Route Experts by Sequence, not by Token","created":"2025-11-09","cited_by_count":6,"area":"moe"},{"id":"2603.05806","title":"MoE Lens -- An Expert Is All You Need","created":"2026-03-06","cited_by_count":6,"area":"moe"},{"id":"2503.05029","title":"Continual Pre-training of MoEs: How robust is your router?","created":"2025-03-06","cited_by_count":5,"area":"moe"},{"id":"2504.19925","title":"SYMI: Efficient Mixture-of-Experts Training via Model and Optimizer State Decoupling","created":"2025-04-28","cited_by_count":5,"area":"moe"},{"id":"2506.05767","title":"dots.llm1 Technical Report","created":"2025-06-06","cited_by_count":5,"area":"moe"},{"id":"2510.03293","title":"From Score Distributions to Balance: Plug-and-Play Mixture-of-Experts Routing","created":"2025-09-29","cited_by_count":5,"area":"moe"},{"id":"2603.06626","title":"Grouter: Decoupling Routing from Representation for Accelerated MoE Training","created":"2026-02-22","cited_by_count":5,"area":"moe"},{"id":"2605.15403","title":"$\\phi$-Balancing for Mixture-of-Experts Training","created":"2026-05-14","cited_by_count":5,"area":"moe"},{"id":"2506.07366","title":"MoE-GPS: Guidlines for Prediction Strategy for Dynamic Expert Duplication in MoE Load Balancing","created":"2025-06-09","cited_by_count":4,"area":"moe"},{"id":"2511.10676","title":"Pre-Attention Expert Prediction and Prefetching for Mixture-of-Experts Large Language Models","created":"2025-11-10","cited_by_count":4,"area":"moe"},{"id":"2602.00509","title":"PROBE: Co-Balancing Computation and Communication in MoE Inference via Real-Time Predictive Prefetching","created":"2026-01-31","cited_by_count":4,"area":"moe"},{"id":"2603.00054","title":"Expert Divergence Learning for MoE-based Language Models","created":"2026-02-10","cited_by_count":4,"area":"moe"},{"id":"2604.04230","title":"Three Phases of Expert Routing: How Load Balance Evolves During Mixture-of-Experts Training","created":"2026-04-05","cited_by_count":4,"area":"moe"},{"id":"2605.12476","title":"Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts","created":"2026-05-12","cited_by_count":4,"area":"moe"},{"id":"2505.19525","title":"Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate","created":"2025-05-26","cited_by_count":3,"area":"moe"},{"id":"2507.09955","title":"DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models","created":"2025-07-14","cited_by_count":3,"area":"moe"},{"id":"2508.02002","title":"Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization","created":"2025-08-04","cited_by_count":3,"area":"moe"},{"id":"2510.16138","title":"Expert Merging in Sparse Mixture of Experts with Nash Bargaining","created":"2025-10-17","cited_by_count":3,"area":"moe"},{"id":"2603.11535","title":"Expert Threshold Routing for Autoregressive Language Modeling with Dynamic Computation Allocation and Load Balancing","created":"2026-03-12","cited_by_count":3,"area":"moe"},{"id":"2605.02641","title":"Mamoda2.5: Enhancing Unified Multimodal Model with DiT-MoE","created":"2026-05-04","cited_by_count":3,"area":"moe"},{"id":"2605.08292","title":"Hierarchical Mixture-of-Experts with Two-Stage Optimization","created":"2026-05-08","cited_by_count":3,"area":"moe"},{"id":"2605.27081","title":"ReMoE: Boosting Expert Reuse through Router Fine-Tuning in Memory-Constrained MoE LLM Inference","created":"2026-05-26","cited_by_count":3,"area":"moe"},{"id":"2605.27358","title":"MobileMoE: Scaling On-Device Mixture of Experts","created":"2026-05-26","cited_by_count":3,"area":"moe"},{"id":"2606.01062","title":"DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts","created":"2026-05-31","cited_by_count":3,"area":"moe"},{"id":"2606.25971","title":"Improving Neural Network Training by Decoupling the Magnitude and Direction of Weight Vectors","created":"2026-06-24","cited_by_count":3,"area":"moe"},{"id":"2506.02890","title":"Scaling Fine-Grained MoE Beyond 50B Parameters: Empirical Evaluation and Practical Insights","created":"2025-06-03","cited_by_count":2,"area":"moe"},{"id":"2508.01261","title":"Unifying Mixture of Experts and Multi-Head Latent Attention for Efficient Language Models","created":"2025-08-02","cited_by_count":2,"area":"moe"},{"id":"2509.06346","title":"Ban&Pick: Enhancing Performance and Efficiency of MoE-LLMs via Smarter Routing","created":"2025-09-08","cited_by_count":2,"area":"moe"},{"id":"2510.01185","title":"Dirichlet-Prior Shaping: Guiding Expert Specialization in Upcycled MoEs","created":"2025-10-01","cited_by_count":2,"area":"moe"},{"id":"2512.16248","title":"Sigma-MoE-Tiny Technical Report","created":"2025-12-18","cited_by_count":2,"area":"moe"},{"id":"2512.23070","title":"FLEX-MoE: Federated Mixture-of-Experts with Load-balanced Expert Assignment for Edge Computing","created":"2025-12-28","cited_by_count":2,"area":"moe"},{"id":"2601.00457","title":"Geometric Regularization in Mixture-of-Experts: The Disconnect Between Weights and Activations","created":"2026-01-01","cited_by_count":2,"area":"moe"},{"id":"2601.12137","title":"EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts","created":"2026-01-17","cited_by_count":2,"area":"moe"},{"id":"2601.21461","title":"L$^3$: Large Lookup Layers","created":"2026-01-29","cited_by_count":2,"area":"moe"},{"id":"2602.04870","title":"Multi-Head LatentMoE and Head Parallel: Communication-Efficient and Deterministic MoE Parallelism","created":"2026-02-04","cited_by_count":2,"area":"moe"},{"id":"2602.11192","title":"MELINOE: Fine-Tuning Enables Memory-Efficient Inference for Mixture-of-Experts Models","created":"2026-01-30","cited_by_count":2,"area":"moe"},{"id":"2602.17798","title":"Grassmannian Mixture-of-Experts: Concentration-Controlled Routing on Subspace Manifolds","created":"2026-02-19","cited_by_count":2,"area":"moe"},{"id":"2604.00801","title":"Routing-Free Mixture-of-Experts","created":"2026-04-01","cited_by_count":2,"area":"moe"},{"id":"2605.10670","title":"Surviving Partial Rank Failures in Wide Expert-Parallel MoE Inference","created":"2026-05-11","cited_by_count":2,"area":"moe"},{"id":"2605.20247","title":"CP-MoE: Consistency-Preserving Mixture-of-Experts for Continual Learning","created":"2026-05-18","cited_by_count":2,"area":"moe"},{"id":"2502.15451","title":"Binary-Integer-Programming Based Algorithm for Expert Load Balancing in Mixture-of-Experts Models","created":"2025-02-21","cited_by_count":1,"area":"moe"},{"id":"2503.02495","title":"Union of Experts: Adapting Hierarchical Routing to Equivalently Decomposed Transformer","created":"2025-03-04","cited_by_count":1,"area":"moe"},{"id":"2503.22996","title":"Rethinking Sparse Mixture of Experts from a Unified Perspective","created":"2025-03-29","cited_by_count":1,"area":"moe"},{"id":"2505.15151","title":"Time Tracker: Mixture-of-Experts-Enhanced Foundation Time Series Forecasting Model with Decoupled Training Pipelines","created":"2025-05-21","cited_by_count":1,"area":"moe"},{"id":"2508.07490","title":"N-BEATS-MOE: N-BEATS with a Mixture-of-Experts Layer for Heterogeneous Time Series Forecasting","created":"2025-08-10","cited_by_count":1,"area":"moe"},{"id":"2509.15964","title":"MoE-CE: Enhancing Generalization for Deep Learning based Channel Estimation via a Mixture-of-Experts Framework","created":"2025-09-19","cited_by_count":1,"area":"moe"},{"id":"2509.18137","title":"LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methods","created":"2025-09-14","cited_by_count":1,"area":"moe"},{"id":"2511.16947","title":"Fine-grained MoE Load Balancing with Linear Programming","created":"2025-11-21","cited_by_count":1,"area":"moe"},{"id":"2511.21431","title":"MemFine: Memory-Aware Fine-Grained Scheduling for MoE Training","created":"2025-11-26","cited_by_count":1,"area":"moe"},{"id":"2512.03915","title":"A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models","created":"2025-12-03","cited_by_count":1,"area":"moe"},{"id":"2601.15370","title":"Improving MoE Compute Efficiency by Composing Weight and Data Sparsity","created":"2026-01-21","cited_by_count":1,"area":"moe"},{"id":"2602.09001","title":"DirMoE: Dirichlet-routed Mixture of Experts","created":"2026-02-09","cited_by_count":1,"area":"moe"},{"id":"2603.24044","title":"MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning","created":"2026-03-25","cited_by_count":1,"area":"moe"},{"id":"2604.03044","title":"JoyAI-LLM Flash: Advancing Mid-Scale LLMs with Token Efficiency","created":"2026-04-03","cited_by_count":1,"area":"moe"},{"id":"2604.07030","title":"MoE Routing Testbed: Studying Expert Specialization and Routing Behavior at Small Scale","created":"2026-04-08","cited_by_count":1,"area":"moe"},{"id":"2604.19835","title":"Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts","created":"2026-04-21","cited_by_count":1,"area":"moe"},{"id":"2604.23036","title":"Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning","created":"2026-04-24","cited_by_count":1,"area":"moe"},{"id":"2605.06665","title":"UniPool: A Globally Shared Expert Pool for Mixture-of-Experts","created":"2026-05-07","cited_by_count":1,"area":"moe"},{"id":"2605.29121","title":"A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router","created":"2026-05-27","cited_by_count":1,"area":"moe"},{"id":"2609.35751","title":"How to Loop MoE: Flatten the Experts, Untie the Attention","created":"2026-09-28","cited_by_count":1,"area":"moe"},{"id":"2507.12419","title":"Mixture of Raytraced Experts","created":"2025-07-16","cited_by_count":0,"area":"moe"},{"id":"2602.19938","title":"A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs","created":"2026-02-23","cited_by_count":0,"area":"moe"},{"id":"2602.21798","title":"Excitation: Momentum For Experts","created":"2026-02-25","cited_by_count":0,"area":"moe"},{"id":"2603.27624","title":"Expert Streaming: Accelerating Low-Batch MoE Inference via Multi-chiplet Architecture and Dynamic Expert Trajectory Scheduling","created":"2026-03-29","cited_by_count":0,"area":"moe"},{"id":"2604.03342","title":"Mixture-of-Experts in Remote Sensing: A Survey","created":"2026-04-03","cited_by_count":0,"area":"moe"},{"id":"2604.07298","title":"Region-Graph Optimal Transport Routing for Mixture-of-Experts Whole-Slide Image Classification","created":"2026-04-08","cited_by_count":0,"area":"moe"},{"id":"2604.13508","title":"Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcycling","created":"2026-04-15","cited_by_count":0,"area":"moe"},{"id":"2605.06415","title":"E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology","created":"2026-05-07","cited_by_count":0,"area":"moe"}],"next_cursor":"100"}