Federated Prompt-based Decision Transformer for Customized VR Services in Mobile Edge Computing System
Not on the map. Why?
Abstract (arXiv)
This paper investigates resource allocation to provide heterogeneous users with customized virtual reality (VR) services in a mobile edge computing (MEC) system. We first introduce a quality of experience (QoE) metric to measure user experience, which considers the MEC system's latency, user attention levels, and preferred resolutions. Then, a QoE maximization problem is formulated for resource allocation to ensure the highest possible user experience,which is cast as a reinforcement learning problem, aiming to learn a generalized policy applicable across diverse user environments for all MEC servers. To learn the generalized policy, we propose a framework that employs federated learning (FL) and prompt-based sequence modeling to pre-train a common decision model across MEC servers, which is named FedPromptDT. Using FL solves the problem of insufficient local MEC data while protecting user privacy during offline training. The design of prompts integrating user-environment cues and user-preferred allocation improves the model's adaptability to various user environments during online execution.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 15 Feb 2024.
Builds on
29 of 40 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 143
- 2019Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systemscited by 77
- 2022Federated Reinforcement Learning with Environment Heterogeneitycited by 61
- 2021Fault-Tolerant Federated Reinforcement Learning with Theoretical Guaranteecited by 52
- 2022A Survey on Metaverse: Fundamentals, Security, and Privacycited by 51
17 more
- 2023A Survey on Transformers in Reinforcement Learningcited by 50
- 2022FedFA: Federated Learning with Feature Anchors to Align Features and Classifiers for Heterogeneous Datacited by 49
- 2022A Full Dive into Realizing the Edge-enabled Metaverse: Visions, Enabling Technologies,and Challengescited by 39
- 2020When Deep Reinforcement Learning Meets Federated Learning: Intelligent Multi-Timescale Resource Management for Multi-access Edge Computing in 5G Ultra Dense Networkcited by 29
- 2022Federated Stochastic Approximation under Markov Noise and Heterogeneity: Applications in Reinforcement Learningcited by 27
- 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
- 2022Attention-aware Resource Allocation and QoE Analysis for Metaverse xURLLC Servicescited by 15
- 2022Enabling Long-term Fairness in Dynamic Resource Allocationcited by 15
- 2023FedCiR: Client-Invariant Representation Learning for Federated Non-IID Featurescited by 12
- 2023Clinical Decision Transformer: Intended Treatment Recommendation through Goal Promptingcited by 8
- 2017Federated Control with Hierarchical Multi-Agent Deep Reinforcement Learningcited by 7
- 2020Deep Learning for Content-based Personalized Viewport Prediction of 360-Degree VR Videoscited by 7
- 2023Understanding and Improving Model Averaging in Federated Learning on Heterogeneous Datacited by 7
- 2023Attention-based QoE-aware Digital Twin Empowered Edge Computing for Immersive Virtual Realitycited by 7
- 2022Bi-directional Digital Twin and Edge Computing in the Metaversecited by 5
- 2020Reliability Enhancement for VR Delivery in Mobile-Edge Empowered Dual-Connectivity Sub-6 GHz and mmWave HetNetscited by 3
- 2022FoVR: Attention-based VR Streaming through Bandwidth-limited Wireless Networkscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.