mlsanityData to 7 Oct 2026

Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Models

arXiv 2604.26508 ↗First posted 29 Apr 2026cs.LG cs.AI cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Visual token pruning and efficiency

Abstract (arXiv)

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading inference to the cloud is often impractical in bandwidth-limited environments, where transmitting raw visual data introduces substantial latency overhead. While recent edge-cloud collaborative architectures attempt to partition VLM workloads across devices, they typically rely on transmitting fixed-size representations, lacking adaptability to dynamic network conditions and failing to fully exploit semantic redundancy. In this paper, we propose a progressive semantic communication framework for edge-cloud VLM inference, using a Meta AutoEncoder that compresses visual tokens into adaptive, progressively refinable representations, enabling plug-and-play deployment with off-the-shelf VLMs without additional fine-tuning. This design allows flexible transmission at different information levels, providing a controllable trade-off between communication cost and semantic fidelity. We implement a full end-to-end edge-cloud system comprising an embedded NXP i.MX95 platform and a GPU server, communicating over bandwidth-constrained networks. Experimental results show that, at 1 Mbps uplink, the proposed progressive scheme significantly reduces network latency compared to full-edge and full-cloud solutions, while maintaining high semantic consistency even under high compression. The implementation code will be released upon publication at https://github.com/open-ep/ProSemComVLM.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Visual token pruning and efficiency, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 21 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

19 of 21 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Collaborative Edge-to-Server Inference for Vision-Language Models18 Dec
  2. 2025Efficient Deployment of Vision-Language Models on Mobile Devices: A Case Study on OnePlus 13R11 Jul
  3. 2025SmolVLM: Redefining small and efficient multimodal models7 Apr
  4. 2024Visual Language Model based Cross-modal Semantic Communication Systems6 May

Other references · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  10. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  11. 2014Learning Ordered Representations with Nested Dropoutcited by 81
  12. 2022WITT: A Wireless Image Transmission Transformer for Semantic Communicationscited by 36
3 more
  1. 2025Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communicationscited by 32
  2. 2026Video TokenCom: Textual Intent-Guided Multi-Rate Video Token Communications with UEP-Based Adaptive Source-Channel Codingcited by 5
  3. 2025VLF-MSC: Vision-Language Feature-Based Multimodal Semantic Communication Systemcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025edgeVLM: Cloud-edge Collaborative Real-time VLM based on Context Transfer
  2. 2026INAR-VL: Input-Aware Routing for Edge-Cloud Vision-Language Inference
  3. 2025Vision-Language Models for Edge Networks: A Comprehensive Survey
  4. 2026RAPID: Redundancy-Aware and Compatibility-Optimal Edge-Cloud Partitioned Inference for Diverse VLA Models
  5. 2026Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization
  6. 2026LQA: A Lightweight Quantized-Adaptive Framework for Vision-Language Models on the Edge
  7. 2026LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference
  8. 2026AIVD: Adaptive Edge-Cloud Collaboration for Accurate and Efficient Industrial Visual Detection