mlsanityData to 7 Oct 2026

Self-Augmented Mixture-of-Experts for QoS Prediction

arXiv 2601.11036 ↗First posted 16 Jan 2026cs.LGcited by 0

On the map: Mixture-of-experts → MoE theory and gating functions

Abstract (arXiv)

Quality of Service (QoS) prediction is one of the most fundamental problems in service computing and personalized recommendation. In the problem, there is a set of users and services, each associated with a set of descriptive features. Interactions between users and services produce feedback values, typically represented as numerical QoS metrics such as response time or availability. Given the observed feedback for a subset of user-service pairs, the goal is to predict the QoS values for the remaining pairs. A key challenge in QoS prediction is the inherent sparsity of user-service interactions, as only a small subset of feedback values is typically observed. To address this, we propose a self-augmented strategy that leverages a model's own predictions for iterative refinement. In particular, we partially mask the predicted values and feed them back into the model to predict again. Building on this idea, we design a self-augmented mixture-of-experts model, where multiple expert networks iteratively and collaboratively estimate QoS values. We find that the iterative augmentation process naturally aligns with the MoE architecture by enabling inter-expert communication: in the second round, each expert receives the first-round predictions and refines its output accordingly. Experiments on benchmark datasets show that our method outperforms existing baselines and achieves competitive results.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE theory and gating functions, one of 12 directions in Mixture-of-experts. Builds on 5 of its 35 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

5 of 35 references.

References · 5

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Neural Collaborative Filteringcited by 1,108
  3. 2016Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptationcited by 38
  4. 2025RAHN: A Reputation Based Hourglass Network for Web Service QoS Predictioncited by 1
  5. 2025Fuzzy Information Entropy and Region Biased Matrix Factorization for Web Service QoS Predictioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025PreMoE: Proactive Inference for Efficient Mixture-of-Experts
  2. 2025MoE-MLoRA for Multi-Domain CTR Prediction: Efficient Adaptation with Expert Specialization
  3. 2025Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
  4. 2023Revisiting Single-gated Mixtures of Experts
  5. 2026UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models
  6. 2026Towards a Statistical Understanding of Mixture-of-Experts
  7. 2025Understanding the Mixture-of-Experts with Nadaraya-Watson Kernel
  8. 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications