mlsanityData to 7 Oct 2026

Generative AI for Immersive Communication: The Next Frontier in Internet-of-Senses Through 6G

arXiv 2404.01713 ↗First posted 2 Apr 2024cs.CL cs.AI cs.HCcited by 4

Not on the map. Why?

Abstract (arXiv)

Over the past two decades, the Internet-of-Things (IoT) has become a transformative concept, and as we approach 2030, a new paradigm known as the Internet of Senses (IoS) is emerging. Unlike conventional Virtual Reality (VR), IoS seeks to provide multi-sensory experiences, acknowledging that in our physical reality, our perception extends far beyond just sight and sound; it encompasses a range of senses. This article explores the existing technologies driving immersive multi-sensory media, delving into their capabilities and potential applications. This exploration includes a comparative analysis between conventional immersive media streaming and a proposed use case that leverages semantic communication empowered by generative Artificial Intelligence (AI). The focal point of this analysis is the substantial reduction in bandwidth consumption by 99.93% in the proposed scheme. Through this comparison, we aim to underscore the practical applications of generative AI for immersive media. Concurrently addressing major challenges in this field, such as temporal synchronization of multiple media, ensuring high throughput, minimizing the End-to-End (E2E) latency, and robustness to low bandwidth while outlining future trajectories.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 2 Apr 2024.

Builds on

20 of 50 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
  6. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  7. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
  8. 2023Language Modeling Is Compressioncited by 225
  9. 2022MegaBlocks: Efficient Sparse Training with Mixture-of-Expertscited by 204
  10. 2023TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbonescited by 77
  11. 2023TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledgecited by 62
  12. 2023MM-LIMA: Less Is More for Alignment in Multi-Modal Datasetscited by 61
8 more
  1. 2023FuseCap: Leveraging Large Language Models for Enriched Fused Image Captionscited by 33
  2. 2021YOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUscited by 12
  3. 2023YOLO-based Semantic Communication with Generative AI-aided Resource Allocation for Digital Twins Constructioncited by 11
  4. 2016On the Diagnostic of Road Pathway Visibilitycited by 10
  5. 2022WiserVR: Semantic Communication Enabled Wireless Virtual Reality Deliverycited by 2
  6. 2023Mobile Edge Generation: A New Era to 6Gcited by 2
  7. 2023Mulsemedia Communication Research Challenges for Metaverse in 6G Wireless Systemscited by 1
  8. 2024Dynamic and Super-Personalized Media Ecosystem Driven by Generative AI: Unpredictable Plays Never Repeating The Samecited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

  1. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  2. 2025Generative Diffusion Models for Wireless Networks: Fundamental, Architecture, and State-of-the-Artcited by 13
  3. 2024WDMoE: Wireless Distributed Mixture of Experts for Large Language Modelscited by 12
  4. 2025Generative Artificial Intelligence for Internet of Things Computing: A Systematic Surveycited by 3