# Team Deep Mixture of Experts for Distributed Power Control

arXiv: https://arxiv.org/abs/2007.14147 · HTML: https://mlsanity.com/paper/2007.14147/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts.
- Builds on 6 of its 18 references that are in the map.
- First posted on arXiv 28 Jul 2020.

## Placed in

- Mixture-of-experts / [Vision mixture-of-experts](https://mlsanity.com/moe/vision-mixture-of-experts/)

## Builds on (most cited first, 6 of 6)

- [Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer](https://mlsanity.com/paper/1701.06538/) (2017)
- [Learning Factored Representations in a Deep Mixture of Experts](https://mlsanity.com/paper/1312.4314/) (2013)
- [From Learning to Meta-Learning: Reduced Training Overhead and Complexity for Communication Systems](https://mlsanity.com/paper/2001.01227/) (2020)
- [Deep Learning for Distributed Optimization: Applications to Wireless Resource Management](https://mlsanity.com/paper/1905.13378/) (2019)
- [Meta-Learning to Communicate: Fast End-to-End Training for Fading Channels](https://mlsanity.com/paper/1910.09945/) (2019)
- [Speech Enhancement using a Deep Mixture of Experts](https://mlsanity.com/paper/1703.09302/) (2017)

## Abstract (arXiv)

In the context of wireless networking, it was recently shown that multiple DNNs can be jointly trained to offer a desired collaborative behaviour capable of coping with a broad range of sensing uncertainties. In particular, it was established that DNNs can be used to derive policies that are robust with respect to the information noise statistic affecting the local information (e.g. CSI in a wireless network) used by each agent (e.g. transmitter) to make its decision. While promising, a major challenge in the implementation of such method is that information noise statistics may differ from agent to agent and, more importantly, that such statistics may not be available at the time of training or may evolve over time, making burdensome retraining necessary. This situation makes it desirable to devise a "universal" machine learning model, which can be trained once for all so as to allow for decentralized cooperation in any future feedback noise environment. With this goal in mind, we propose an architecture inspired from the well-known Mixture of Experts (MoE) model, which was previously used for non-linear regression and classification tasks in various contexts, such as computer vision and speech recognition. We consider the decentralized power control problem as an example to showcase the validity of the proposed model and to compare it against other power control algorithms. We show the ability of the so called Team-DMoE model to efficiently track time-varying statistical scenarios.