# Graph-Embedded Multi-Agent Learning for Smart Reconfigurable THz MIMO-NOMA Networks

arXiv: https://arxiv.org/abs/2107.07198 · HTML: https://mlsanity.com/paper/2107.07198/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Jul 2021.

## Built on by (most cited first, 6 of 6)

- [Graph Neural Networks Meet Wireless Communications: Motivation, Applications, and Future Directions](https://mlsanity.com/paper/2212.04047/) (2022)
- [Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks](https://mlsanity.com/paper/2206.10152/) (2022)
- [Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks](https://mlsanity.com/paper/2208.06963/) (2022)
- [Two-Timescale Synchronization and Migration for Digital Twin Networks: A Multi-Agent Deep Reinforcement Learning Approach](https://mlsanity.com/paper/2409.01092/) (2024)
- [Linear Function Approximation as a Computationally Efficient Method to Solve Classical Reinforcement Learning Challenges](https://mlsanity.com/paper/2405.20350/) (2024)
- [DRL-AdaPart: DRL-Driven Adaptive STAR-RIS Partitioning for Fair and Efficient Resource Utilization](https://mlsanity.com/paper/2407.06868/) (2024)

## Abstract (arXiv)

With the accelerated development of immersive applications and the explosive increment of internet-of-things (IoT) terminals, 6G would introduce terahertz (THz) massive multiple-input multiple-output non-orthogonal multiple access (MIMO-NOMA) technologies to meet the ultra-high-speed transmission and massive connectivity requirements. Nevertheless, the unreliability of THz transmissions and the extreme heterogeneity of device requirements pose critical challenges for practical applications. To address these challenges, we propose a novel smart reconfigurable THz MIMO-NOMA framework, which can realize customizable and intelligent communications by flexibly and coordinately reconfiguring hybrid beams through the cooperation between access points (APs) and reconfigurable intelligent surfaces (RISs). The optimization problem is formulated as a decentralized partially-observable Markov decision process (Dec-POMDP) to maximize the network energy efficiency, while guaranteeing the diversified users' performance, via a joint RIS element selection, coordinated discrete phase-shift control, and power allocation strategy. To solve the above non-convex, strongly coupled, and highly complex mixed integer nonlinear programming (MINLP) problem, we propose a novel multi-agent deep reinforcement learning (MADRL) algorithm, namely graph-embedded value-decomposition actor-critic (GE-VDAC), that embeds the interaction information of agents, and learns a locally optimal solution through a distributed policy. Numerical results demonstrate that the proposed algorithm achieves highly customized communications and outperforms traditional MADRL algorithms.