# Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Models

arXiv: https://arxiv.org/abs/2411.02334 · HTML: https://mlsanity.com/paper/2411.02334/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models.
- Builds on 29 of its 52 references that are in the map.
- First posted on arXiv 4 Nov 2024.

## Placed in

- Diffusion models / [Diffusion for compression and wireless](https://mlsanity.com/diffusion/diffusion-for-compression-and-wireless/)

## Builds on (most cited first, 29 of 29)

- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [The Cityscapes Dataset for Semantic Urban Scene Understanding](https://mlsanity.com/paper/1604.01685/) (2016)
- [Semantic Image Synthesis with Spatially-Adaptive Normalization](https://mlsanity.com/paper/1903.07291/) (2019)
- [The Perception-Distortion Tradeoff](https://mlsanity.com/paper/1711.06077/) (2017)
- [Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications](https://mlsanity.com/paper/2207.09353/) (2022)
- [Nonlinear Transform Coding](https://mlsanity.com/paper/2007.03034/) (2020)
- [Semantic Image Synthesis via Diffusion Models](https://mlsanity.com/paper/2207.00050/) (2022)
- [You Only Need Adversarial Supervision for Semantic Image Synthesis](https://mlsanity.com/paper/2012.04781/) (2020)
- [Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges](https://mlsanity.com/paper/2207.00427/) (2022)
- [CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications](https://mlsanity.com/paper/2309.08895/) (2023)
- [Generative Joint Source-Channel Coding for Semantic Image Transmission](https://mlsanity.com/paper/2211.13772/) (2022)
- [Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimization](https://mlsanity.com/paper/2308.05384/) (2023)
- [MobileDiffusion: Instant Text-to-Image Generation on Mobile Devices](https://mlsanity.com/paper/2311.16567/) (2023)
- [Generative AI-driven Semantic Communication Networks: Architecture, Technologies and Applications](https://mlsanity.com/paper/2401.00124/) (2023)
- [RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformer](https://mlsanity.com/paper/2210.07124/) (2022)
- [At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence](https://mlsanity.com/paper/2402.18587/) (2024)
- [Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models](https://mlsanity.com/paper/2403.17256/) (2024)
- [High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Models](https://mlsanity.com/paper/2309.15889/) (2023)
- [Generative AI for Semantic Communication: Architecture, Challenges, and Outlook](https://mlsanity.com/paper/2308.15483/) (2023)
- [Conditional Denoising Diffusion Probabilistic Models for Data Reconstruction Enhancement in Wireless Communications](https://mlsanity.com/paper/2310.19460/) (2023)
- [Language-Oriented Semantic Latent Representation for Image Transmission](https://mlsanity.com/paper/2405.09976/) (2024)
- [Semantic Communications using Foundation Models: Design Approaches and Open Issues](https://mlsanity.com/paper/2309.13315/) (2023)
- [Cross-Modal Generative Semantic Communications for Mobile AIGC: Joint Semantic Encoding and Prompt Engineering](https://mlsanity.com/paper/2404.13898/) (2024)
- [Generative Semantic Communication via Textual Prompts: Latency Performance Tradeoffs](https://mlsanity.com/paper/2409.09715/) (2024)
- [Lightweight Diffusion Models for Resource-Constrained Semantic Communication](https://mlsanity.com/paper/2410.02491/) (2024)
- [Compression before Fusion: Broadcast Semantic Communication System for Heterogeneous Tasks](https://mlsanity.com/paper/2401.17669/) (2024)
- [Features Disentangled Semantic Broadcast Communication Networks](https://mlsanity.com/paper/2303.01892/) (2023)
- [Deep Learning Based Superposition Coded Modulation for Hierarchical Semantic Communications over Broadcast Channels](https://mlsanity.com/paper/2401.01564/) (2024)

## Built on by (most cited first, 5 of 5)

- [ToDMA: Large Model-Driven Massive Token Communications for Semantic Multiple Access](https://mlsanity.com/paper/2505.10946/) (2025)
- [Video TokenCom: Textual Intent-Guided Multi-Rate Video Token Communications with UEP-Based Adaptive Source-Channel Coding](https://mlsanity.com/paper/2603.02470/) (2026)
- [Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation](https://mlsanity.com/paper/2608.28086/) (2026)
- [Exploiting Overlapping Fields of View for Redundancy-Aware Uplink Transmission in Vehicular 6G](https://mlsanity.com/paper/2606.31715/) (2026)
- [From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity](https://mlsanity.com/paper/2609.10714/) (2026)

## Abstract (arXiv)

Generative diffusion models (GDMs) have recently shown great success in synthesizing multimedia signals with high perceptual quality, enabling highly efficient semantic communications in future wireless networks. In this paper, we develop an intent-aware generative semantic multicasting framework utilizing pre-trained diffusion models. In the proposed framework, the transmitter decomposes the source signal into multiple semantic classes based on the multi-user intent, i.e. each user is assumed to be interested in details of only a subset of the semantic classes. To better utilize the wireless resources, the transmitter sends to each user only its intended classes, and multicasts a highly compressed semantic map to all users over shared wireless resources that allows them to locally synthesize the other classes, namely non-intended classes, utilizing pre-trained diffusion models. The signal retrieved at each user is thereby partially reconstructed and partially synthesized utilizing the received semantic map. We design a communication/computation-aware scheme for per-class adaptation of the communication parameters, such as the transmission power and compression rate, to minimize the total latency of retrieving signals at multiple receivers, tailored to the prevailing channel conditions as well as the users' reconstruction/synthesis distortion/perception requirements. The simulation results demonstrate significantly reduced per-user latency compared with non-generative and intent-unaware multicasting benchmarks while maintaining high perceptual quality of the signals retrieved at the users.
