Vision Language Model-Empowered Contract Theory for AIGC Task Allocation in Teleoperation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Integrating low-light image enhancement techniques, in which diffusion-based AI-generated content (AIGC) models are promising, is necessary to enhance nighttime teleoperation. Remarkably, the AIGC model is computation-intensive, thus necessitating the allocation of AIGC tasks to edge servers with ample computational resources. Given the distinct cost of the AIGC model trained with varying-sized datasets and AIGC tasks possessing disparate demand, it is imperative to formulate a differential pricing strategy to optimize the utility of teleoperators and edge servers concurrently. Nonetheless, the pricing strategy formulation is under information asymmetry, i.e., the demand (e.g., the difficulty level of AIGC tasks and their distribution) of AIGC tasks is hidden information to edge servers. Additionally, manually assessing the difficulty level of AIGC tasks is tedious and unnecessary for teleoperators. To this end, we devise a framework of AIGC task allocation assisted by the Vision Language Model (VLM)-empowered contract theory, which includes two components: VLM-empowered difficulty assessment and contract theory-assisted AIGC task allocation. The first component enables automatic and accurate AIGC task difficulty assessment. The second component is capable of formulating the pricing strategy for edge servers under information asymmetry, thereby optimizing the utility of both edge servers and teleoperators. The simulation results demonstrated that our proposed framework can improve the average utility of teleoperators and edge servers by 10.88~12.43% and 1.4~2.17%, respectively. Code and data are available at https://github.com/ZiJun0819/VLM-Contract-Theory.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 15 of its 36 references that are in the map. First posted on arXiv 9 Jul 2024.
Builds on
15 of 36 references.
References · 15
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Low-Light Image Enhancement with Wavelet-based Diffusion Modelscited by 127
- 2023Security and Privacy on Generative Data in AIGC: A Surveycited by 34
- 2023Diffusion-based Reinforcement Learning for Edge-enabled AI-Generated Content Servicescited by 33
- 2023Exploring Collaborative Distributed Diffusion-Based AI-Generated Content (AIGC) in Wireless Networkscited by 26
- 2022Incentive Mechanism Design for Joint Resource Allocation in Blockchain-based Federated Learningcited by 13
- 2023Task Freshness-aware Incentive Mechanism for Vehicle Twin Migration in Vehicular Metaversescited by 7
- 2023Reinforcement Learning With LLMs Interaction For Distributed Diffusion Model Servicescited by 7
3 more
- 2023Guiding AI-Generated Digital Content with Wireless Perceptioncited by 4
- 2022Joint Offloading Decision and Resource Allocation for Vehicular Fog-Edge Computing Networks: A Contract-Stackelberg Approachcited by 2
- 2024A Learning-based Incentive Mechanism for Mobile AIGC Service in Decentralized Internet of Vehiclescited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024LADEV: A Language-Driven Testing and Evaluation Platform for Vision-Language-Action Models in Robotic Manipulation
- 2026DREAM: Deployment-Time Demonstration Generation via Real-to-Sim for Scalable Policy Adaptation
- 2026PhAIL: A Real-Robot VLA Benchmark and Distributional Methodology
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey
- 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model
- 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone