# Task-Oriented Multi-User Semantic Communications for VQA Task

arXiv: https://arxiv.org/abs/2108.07357 · HTML: https://mlsanity.com/paper/2108.07357/

## Key facts

- Cited by 51 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Aug 2021.

## Built on by (most cited first, 30 of 51)

- [Semantic Communications: Principles and Challenges](https://mlsanity.com/paper/2201.01389/) (2021)
- [Less Data, More Knowledge: Building Next Generation Semantic Communication Networks](https://mlsanity.com/paper/2211.14343/) (2022)
- [Deep Learning-Enabled Semantic Communication Systems with Task-Unaware Transmitter and Dynamic Data](https://mlsanity.com/paper/2205.00271/) (2022)
- [Diffusion-Driven Semantic Communication for Generative Models with Bandwidth Constraints](https://mlsanity.com/paper/2407.18468/) (2024)
- [Curriculum Learning for Goal-Oriented Semantic Communications with a Common Language](https://mlsanity.com/paper/2204.10429/) (2022)
- [Digital-SC: Digital Semantic Communication with Adaptive Network Split and Learned Non-Linear Quantization](https://mlsanity.com/paper/2305.13553/) (2023)
- [OFDM-Based Digital Semantic Communication with Importance Awareness](https://mlsanity.com/paper/2401.02178/) (2024)
- [Pragmatic Communication in Multi-Agent Collaborative Perception](https://mlsanity.com/paper/2401.12694/) (2024)
- [Semantics-Empowered Communication: A Tutorial-cum-Survey](https://mlsanity.com/paper/2212.08487/) (2022)
- [Optimization of Image Transmission in a Cooperative Semantic Communication Networks](https://mlsanity.com/paper/2301.00433/) (2023)
- [Cognitive Semantic Communication Systems Driven by Knowledge Graph: Principle, Implementation, and Performance Evaluation](https://mlsanity.com/paper/2303.08546/) (2023)
- [Synchronous Multi-modal Semantic Communication System with Packet-level Coding](https://mlsanity.com/paper/2408.04535/) (2024)
- [Learning Based Joint Coding-Modulation for Digital Semantic Communication Systems](https://mlsanity.com/paper/2208.05704/) (2022)
- [Performance Limits of a Deep Learning-Enabled Text Semantic Communication under Interference](https://mlsanity.com/paper/2302.14702/) (2023)
- [Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Data](https://mlsanity.com/paper/2305.10773/) (2023)
- [How to Evaluate Semantic Communications for Images with ViTScore Metric?](https://mlsanity.com/paper/2309.04891/) (2023)
- [Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications](https://mlsanity.com/paper/2401.12800/) (2024)
- [Vision Transformer-based Semantic Communications With Importance-Aware Quantization](https://mlsanity.com/paper/2412.06038/) (2024)
- [An Efficient Federated Learning Framework for Training Semantic Communication System](https://mlsanity.com/paper/2310.13236/) (2023)
- [Knowledge Distillation Based Semantic Communications For Multiple Users](https://mlsanity.com/paper/2311.13789/) (2023)
- [Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2411.04672/) (2024)
- [Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges](https://mlsanity.com/paper/2411.18199/) (2024)
- [Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks](https://mlsanity.com/paper/2505.02413/) (2025)
- [Towards Ubiquitous Semantic Metaverse: Challenges, Approaches, and Opportunities](https://mlsanity.com/paper/2307.06687/) (2023)
- [Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communication](https://mlsanity.com/paper/2310.09394/) (2023)
- [Joint Sensing and Task-Oriented Communications with Image and Wireless Data Modalities for Dynamic Spectrum Access](https://mlsanity.com/paper/2312.13931/) (2023)
- [Multimodal generative semantic communication based on latent diffusion model](https://mlsanity.com/paper/2408.05455/) (2024)
- [Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models](https://mlsanity.com/paper/2409.02597/) (2024)
- [Goal-Oriented Semantic Communication for Wireless Visual Question Answering](https://mlsanity.com/paper/2411.02452/) (2024)
- [Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing](https://mlsanity.com/paper/2411.15702/) (2024)

## Abstract (arXiv)

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while the others transmit texts to inquiry the information about the images. To exploit the correlation among the multimodal data from multiple users, we propose a deep neural network enabled semantic communication system, named MU-DeepSC, to execute the visual question answering (VQA) task as an example. Specifically, the transceiver for MU-DeepSC is designed and optimized jointly to capture the features from the correlated multimodal data for task-oriented transmission. Simulation results demonstrate that the proposed MU-DeepSC is more robust to channel variations than the traditional communication systems, especially in the low signal-to-noise (SNR) regime.