Foundation Models for Generalizable Semantic and Goal-Oriented Communication
Not on the map. Why?
Abstract (arXiv)
Semantic and goal-oriented communication is increasingly studied for 6G, but generalization beyond seen data remains a key weakness under tight rate budgets. Many existing systems overfit their training data and degrade sharply at very low bit rates because they attempt to compress the entire signal. We introduce Foundation Model-Guided Semantic and Goal-Oriented Communication (FMSGOC), a framework that uses broad visual-linguistic Foundation Model priors to mitigate overfitting. It further improves rate efficiency by concentrating bits on sparse, goal-aligned anchors and relying on generative foundation-model priors to reconstruct the masked regions. By decoupling what to send from how to reconstruct, a vision-language foundation model selects and transmits a sparse set of semantic anchors, while a pretrained diffusion model, fine-tuned for masked completion, reconstructs the image at the receiver. In our experiments, FMSGOC reaches 0.039 bits per pixel (BPP), maintains high semantic fidelity (cosine similarity 0.87-0.90 on CIFAR-10), remains robust on previously unseen inputs (0.83-0.86 on ImageNet), and shows good perceptual similarity (0.1278/0.1558, CIFAR-10/ImageNet), outperforming strong end-to-end baselines at lower bit rates.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
11 of 15 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2022Generative Joint Source-Channel Coding for Semantic Image Transmissioncited by 58
- 2022WITT: A Wireless Image Transmission Transformer for Semantic Communicationscited by 37
- 2024Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmissioncited by 11
- 2023Conditional Denoising Diffusion Probabilistic Models for Data Reconstruction Enhancement in Wireless Communicationscited by 10
- 2024Generative Semantic Communications with Foundation Models: Perception-Error Analysis and Semantic-Aware Power Allocationcited by 10
- 2025SQ-GAN: Semantic Image Communications Using Masked Vector Quantizationcited by 4
- 2025SC-GIR: Goal-oriented Semantic Communication via Invariant Representation Learningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Goal-Oriented Semantic Communication for Wireless Image Transmission via Stable Diffusion
- 2024SC-CDM: Enhancing Quality of Image Semantic Communication with a Compact Diffusion Model
- 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗
- 2023Alternate Learning based Sparse Semantic Communications for Visual Transmission
- 2024Large Generative Model Assisted 3D Semantic Communication
- 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models
- 2025Task-Driven Semantic Quantization and Imitation Learning for Goal-Oriented Communications
- 2023Generative Semantic Communication: Diffusion Models Beyond Bit Recovery