Hierarchical RNNs-Based Transformers MADDPG for Mixed Cooperative-Competitive Environments
Not on the map. Why?
Abstract (arXiv)
At present, attention mechanism has been widely applied to the fields of deep learning models. Structural models that based on attention mechanism can not only record the relationships between features position, but also can measure the importance of different features based on their weights. By establishing dynamically weighted parameters for choosing relevant and irrelevant features, the key information can be strengthened, and the irrelevant information can be weakened. Therefore, the efficiency of deep learning algorithms can be significantly elevated and improved. Although transformers have been performed very well in many fields including reinforcement learning, there are still many problems and applications can be solved and made with transformers within this area. MARL (known as Multi-Agent Reinforcement Learning) can be recognized as a set of independent agents trying to adapt and learn through their way to reach the goal. In order to emphasize the relationship between each MDP decision in a certain time period, we applied the hierarchical coding method and validated the effectiveness of this method. This paper proposed a hierarchical transformers MADDPG based on RNN which we call it Hierarchical RNNs-Based Transformers MADDPG(HRTMADDPG). It consists of a lower level encoder based on RNNs that encodes multiple step sizes in each time sequence, and it also consists of an upper sequence level encoder based on transformer for learning the correlations between multiple sequences so that we can capture the causal relationship between sub-time sequences and make HRTMADDPG more efficient.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 54 references that are in the map. First posted on arXiv 11 May 2021.
Builds on
36 of 54 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Layer Normalizationcited by 5,579
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Trust Region Policy Optimizationcited by 2,503
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
24 more
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2014Recurrent Models of Visual Attentioncited by 344
- 2019Stabilizing Transformers for Reinforcement Learningcited by 262
- 2018Actor-Attention-Critic for Multi-Agent Reinforcement Learningcited by 259
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
- 2021Reinforcement learning based recommender systems: A surveycited by 187
- 2018Learning Attentional Communication for Multi-Agent Cooperationcited by 170
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2018Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applicationscited by 122
- 2020End-to-end Lane Shape Prediction with Transformerscited by 111
- 2019Hierarchical Transformers for Long Document Classificationcited by 103
- 2020Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Datasetcited by 94
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2015Memory-based control with recurrent neural networkscited by 77
- 2020Learning to Encode Position for Transformer with Continuous Dynamical Modelcited by 61
- 2020R-MADDPG for Partially Observable Environments and Limited Communicationcited by 36
- 2019RTHN: A RNN-Transformer Hierarchical Network for Emotion Cause Extractioncited by 24
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2020An Overview of Natural Language State Representation for Reinforcement Learningcited by 6
- 2019Transformer Based Reinforcement Learning For Gamescited by 5
- 2019Resampling detection of recompressed images via dual-stream convolutional neural networkcited by 2
Built on by
Citing papers per year: 2022: 1.
1 paper.