mlsanityData to 7 Oct 2026

Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts

arXiv 2309.02616 ↗First posted 5 Sep 2023eess.IV cs.LG cs.NIcited by 7

Not on the map. Why?

Abstract (arXiv)

Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and the subsequent deployment in network devices-are overlooked. Recent advances in Generative artificial intelligence (GAI) offer a potential solution. The robust learning abilities of GAI models indicate that semantic decoders can reconstruct source messages using a limited amount of semantic information, e.g., prompts, without joint training with the semantic encoder. A notable challenge, however, is the instability introduced by GAI's diverse generation ability. This instability, evident in outputs like text-generated images, limits the direct application of GAI in scenarios demanding accurate message recovery, such as face image transmission. To solve the above problems, this paper proposes a GAI-aided SemCom system with multi-model prompts for accurate content decoding. Moreover, in response to security concerns, we introduce the application of covert communications aided by a friendly jammer. The system jointly optimizes the diffusion step, jamming, and transmitting power with the aid of the generative diffusion models, enabling successful and secure transmission of the source messages.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 16 of its 17 references that are in the map. First posted on arXiv 5 Sep 2023.

Builds on

16 of 17 references.

References · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  6. 2022Diffusion Models in Vision: A Surveycited by 1,008
  7. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  8. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  9. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
  10. 2022Semantic Communications for Future Internet: Fundamentals, Applications, and Challengescited by 94
  11. 2021Semantic Communications: Principles and Challengescited by 90
  12. 2023Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimizationcited by 56
4 more
  1. 2020From Semantic Communication to Semantic-aware Networking: Model, Architecture, and Open Problemscited by 51
  2. 2023Exploring Collaborative Distributed Diffusion-Based AI-Generated Content (AIGC) in Wireless Networkscited by 26
  3. 2023AI-Generated Incentive Mechanism and Full-Duplex Semantic Communications for Information Sharingcited by 21
  4. 2023Semantic Communications for Artificial Intelligence Generated Content (AIGC) Toward Effective Content Creationcited by 8

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Generative Semantic Communication: Architectures, Technologies, and Applications
  2. 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework
  3. 2025Enabling Training-Free Semantic Communication Systems with Generative Diffusion Models
  4. 2023Semantic Change Driven Generative Semantic Communication Framework
  5. 2024Generative AI for Secure Physical Layer Communications: A Survey
  6. 2024Training-Free Multi-User Generative Semantic Communications via Null-Space Diffusion Sampling
  7. 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Models
  8. 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models