Plasticity-Aware Mixture of Experts for Learning Under QoE Shifts in Adaptive Video Streaming
On the map: Mixture-of-experts → Mixture of LoRA experts
Abstract (arXiv)
Adaptive video streaming systems are designed to optimize Quality of Experience (QoE) and, in turn, enhance user satisfaction. However, differences in user profiles and video content lead to different weights for QoE factors, resulting in user-specific QoE functions and, thus, varying optimization objectives. This variability poses significant challenges for neural networks, as they often struggle to generalize under evolving targets - a phenomenon known as plasticity loss that prevents conventional models from adapting effectively to changing optimization objectives. To address this limitation, we propose the Plasticity-Aware Mixture of Experts (PA-MoE), a novel learning framework that dynamically modulates network plasticity by balancing memory retention with selective forgetting. In particular, PA-MoE leverages noise injection to promote the selective forgetting of outdated knowledge, thereby endowing neural networks with enhanced adaptive capabilities. In addition, we present a rigorous theoretical analysis of PA-MoE by deriving a regret bound that quantifies its learning performance. Experimental evaluations demonstrate that PA-MoE achieves a 45.5% improvement in QoE over competitive baselines in dynamic streaming environments. Further analysis reveals that the model effectively mitigates plasticity loss by optimizing neuron utilization. Finally, a parameter sensitivity study is performed by injecting varying levels of noise, and the results align closely with our theoretical predictions.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Mixture of LoRA experts, one of 12 directions in Mixture-of-experts. Builds on 35 of its 70 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
35 of 70 references.
Closest ancestors · 1
Same direction, newest first
Other references · 34
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 807
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2021BASE Layers: Simplifying Training of Large, Sparse Modelscited by 320
- 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
- 2023From Sparse to Soft Mixtures of Expertscited by 248
- 2022The Primacy Bias in Deep Reinforcement Learningcited by 247
- 2021Hash Layers For Large Sparse Modelscited by 237
- 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 187
- 2023The Dormant Neuron Phenomenon in Deep Reinforcement Learningcited by 174
22 more
- 2023Understanding plasticity in neural networkscited by 174
- 2017Parameter Space Noise for Explorationcited by 161
- 2023Bigger, Better, Faster: Human-level Atari with human-level efficiencycited by 147
- 2023Loss of Plasticity in Continual Deep Reinforcement Learningcited by 121
- 2024Bigger, Regularized, Optimistic: scaling for compute and sample-efficient continuous controlcited by 108
- 2018Dynamic Weights in Multi-Objective Deep Reinforcement Learningcited by 100
- 2023Multi-Task Reinforcement Learning with Mixture of Orthogonal Expertscited by 49
- 2022PaCo: Parameter-Compositional Multi-Task Reinforcement Learningcited by 46
- 2024Slow and Steady Wins the Race: Maintaining Plasticity with Hare and Tortoise Networkscited by 43
- 2024In value-based deep reinforcement learning, a pruned network is a good networkcited by 39
- 2022Sparsity-Constrained Optimal Transportcited by 32
- 2024Streaming Deep Reinforcement Learning Finally Workscited by 25
- 2019Harnessing Structures for Value-Based Planning and Reinforcement Learningcited by 24
- 2022An Empirical Study of Implicit Regularization in Deep Offline RLcited by 24
- 2024Mixture of Experts in a Mixture of RL settingscited by 21
- 2024LocMoE: A Low-Overhead MoE for Large Language Model Trainingcited by 19
- 2024Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Resetcited by 17
- 2020SENSEI: Aligning Video Streaming Quality with Dynamic User Sensitivitycited by 6
- 2023MANSY: Generalizing Neural Adaptive Immersive Video Streaming With Ensemble and Representation Learningcited by 5
- 2024Theory of Mixture-of-Experts for Mobile Edge Computingcited by 5
- 2018Content-Aware Personalised Rate Adaptation for Adaptive Streaming via Deep Video Analysiscited by 2
- 2022Enabling Personalized Video Quality Optimization with VidHoccited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Silent Neuron Theory and Plasticity Preservation for Deep Reinforcement Learning in Adaptive Video Streamingcited by 1
- 2025A Simple Baseline for Stable and Plastic Neural Networkscited by 0
- 2026PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networkscited by 0
- 2026NSMA: Neuro-Symbolic Manifold Alignment for Generalizable Adaptive Bitrate Streaming under Texture Shiftcited by 0
- 2026NSMA: Neuro-Symbolic Manifold Alignment for Generalizable Adaptive Bitrate Streaming under Texture Shift21 Jul 2026
- 2026PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networks20 Jul 2026
- 2025A Simple Baseline for Stable and Plastic Neural Networks14 Jul 2025
- 2025Silent Neuron Theory and Plasticity Preservation for Deep Reinforcement Learning in Adaptive Video Streaming2 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic Mixture of Experts Against Severe Distribution Shifts
- 2026SPHERE: Mitigating the Loss of Spectral Plasticity in Mixture-of-Experts for Deep Reinforcement Learning
- 2026DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models
- 2026EMO: Frustratingly Easy Progressive Training of Extendable MoE
- 2025Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation
- 2019Comyco: Quality-Aware Adaptive Video Streaming via Imitation Learning
- 2025Beyond Benchmarks: Understanding Mixture-of-Experts Models through Internal Mechanisms
- 2025Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churn