# Large AI Model-Based Semantic Communications

arXiv: https://arxiv.org/abs/2307.03492 · HTML: https://mlsanity.com/paper/2307.03492/

## Key facts

- Cited by 35 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 35 references that are in the map.
- First posted on arXiv 7 Jul 2023.

## Builds on (most cited first, 8 of 8)

- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing](https://mlsanity.com/paper/2110.13900/) (2021)
- [VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks](https://mlsanity.com/paper/2112.06825/) (2021)
- [Deep Learning Enabled Semantic Communication Systems](https://mlsanity.com/paper/2006.10685/) (2020)
- [Self-Supervised Representation Learning: Introduction, Advances and Challenges](https://mlsanity.com/paper/2110.09327/) (2021)
- [Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis](https://mlsanity.com/paper/2205.04603/) (2022)
- [Robust Information Bottleneck for Task-Oriented Communication with Digital Modulation](https://mlsanity.com/paper/2209.10382/) (2022)
- [Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning](https://mlsanity.com/paper/2202.00535/) (2022)

## Built on by (most cited first, 30 of 35)

- [Large Language Model Enhanced Multi-Agent Systems for 6G Communications](https://mlsanity.com/paper/2312.07850/) (2023)
- [Large AI Model Empowered Multimodal Semantic Communications](https://mlsanity.com/paper/2309.01249/) (2023)
- [Large Generative Model Assisted 3D Semantic Communication](https://mlsanity.com/paper/2403.05783/) (2024)
- [Visual Language Model based Cross-modal Semantic Communication Systems](https://mlsanity.com/paper/2407.00020/) (2024)
- [BC4LLM: Trusted Artificial Intelligence When Blockchain Meets Large Language Models](https://mlsanity.com/paper/2310.06278/) (2023)
- [Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications](https://mlsanity.com/paper/2401.12800/) (2024)
- [Semantic Communication based on Large Language Model for Underwater Image Transmission](https://mlsanity.com/paper/2408.12616/) (2024)
- [SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Framework](https://mlsanity.com/paper/2503.08726/) (2025)
- [Deep progressive reinforcement learning-based flexible resource scheduling framework for IRS and UAV-assisted MEC system](https://mlsanity.com/paper/2408.01248/) (2024)
- [Semantic Communications with Computer Vision Sensing for Edge Video Transmission](https://mlsanity.com/paper/2503.07252/) (2025)
- [LAMeTA: Intent-Aware Agentic Network Optimization via a Large AI Model-Empowered Two-Stage Approach](https://mlsanity.com/paper/2505.12247/) (2025)
- [ICDM: Interference Cancellation Diffusion Models for Wireless Semantic Communications](https://mlsanity.com/paper/2505.19983/) (2025)
- [Large Generative Model-assisted Talking-face Semantic Communication System](https://mlsanity.com/paper/2411.03876/) (2024)
- [Multimodal LLM Integrated Semantic Communications for 6G Immersive Experiences](https://mlsanity.com/paper/2507.04621/) (2025)
- [Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities](https://mlsanity.com/paper/2509.06968/) (2025)
- [Explainable Semantic Federated Learning Enabled Industrial Edge Network for Fire Surveillance](https://mlsanity.com/paper/2412.19979/) (2024)
- [Large Language Model-Driven Distributed Integrated Multimodal Sensing and Semantic Communications](https://mlsanity.com/paper/2505.18194/) (2025)
- [From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications](https://mlsanity.com/paper/2505.22311/) (2025)
- [Trust Semantics Distillation for Collaborator Selection via Memory-Augmented Agentic AI](https://mlsanity.com/paper/2509.08151/) (2025)
- [Robust and Efficient Communication in Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2511.11393/) (2025)
- [Personalized Federated Learning for Generative AI-Assisted Semantic Communications](https://mlsanity.com/paper/2410.02450/) (2024)
- [Attention-based UAV Trajectory Optimization for Wireless Power Transfer-assisted IoT Systems](https://mlsanity.com/paper/2502.17517/) (2025)
- [Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models](https://mlsanity.com/paper/2506.13243/) (2025)
- [Semantic Chain-of-Trust: Autonomous Trust Orchestration for Collaborator Selection via Hypergraph-Aided Agentic AI](https://mlsanity.com/paper/2507.23565/) (2025)
- [BERT4beam: Large AI Model Enabled Generalized Beamforming Optimization](https://mlsanity.com/paper/2509.11056/) (2025)
- [Adapting Diffusion Language Models for Lossless Pixel-Level Image Transmission](https://mlsanity.com/paper/2606.06273/) (2026)
- [Interplay of Semantic Communication and Knowledge Learning](https://mlsanity.com/paper/2402.03339/) (2024)
- [SemAI: Semantic Artificial Intelligence-enhanced DNA storage for Internet-of-Things](https://mlsanity.com/paper/2409.12213/) (2024)
- [Integrating Semantic Communication and Human Decision-Making into an End-to-End Sensing-Decision Framework](https://mlsanity.com/paper/2412.05103/) (2024)
- [DiffPace: Diffusion-based Plug-and-play Augmented Channel Estimation in mmWave and Terahertz Ultra-Massive MIMO Systems](https://mlsanity.com/paper/2511.01867/) (2025)

## Abstract (arXiv)

Semantic communication (SC) is an emerging intelligent paradigm, offering solutions for various future applications like metaverse, mixed reality, and the Internet of Everything. However, in current SC systems, the construction of the knowledge base (KB) faces several issues, including limited knowledge representation, frequent knowledge updates, and insecure knowledge sharing. Fortunately, the development of the large AI model (LAM) provides new solutions to overcome the above issues. Here, we propose a LAM-based SC framework (LAM-SC) specifically designed for image data, where we first apply the segment anything model (SAM)-based KB (SKB) that can split the original image into different semantic segments by universal semantic knowledge. Then, we present an attention-based semantic integration (ASI) to weigh the semantic segments generated by SKB without human participation and integrate them as the semantic aware image. Additionally, we propose an adaptive semantic compression (ASC) encoding to remove redundant information in semantic features, thereby reducing communication overhead. Finally, through simulations, we demonstrate the effectiveness of the LAM-SC framework and the possibility of applying the LAM-based KB in future SC paradigms.
