# Generative AI-empowered Effective Physical-Virtual Synchronization in the Vehicular Metaverse

arXiv: https://arxiv.org/abs/2301.07636 · HTML: https://mlsanity.com/paper/2301.07636/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 15 references that are in the map.
- First posted on arXiv 18 Jan 2023.

## Builds on (most cited first, 6 of 6)

- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation](https://mlsanity.com/paper/2208.12242/) (2022)
- [A Full Dive into Realizing the Edge-enabled Metaverse: Visions, Enabling Technologies,and Challenges](https://mlsanity.com/paper/2203.05471/) (2022)
- [Metaverse for Social Good: A University Campus Prototype](https://mlsanity.com/paper/2108.08985/) (2021)
- [Multi-Dimensional Auction Mechanisms for Crowdsourced Mobile Video Streaming](https://mlsanity.com/paper/1703.06648/) (2017)
- [EPViSA: Efficient Auction Design for Real-time Physical-Virtual Synchronization in the Metaverse](https://mlsanity.com/paper/2211.06838/) (2022)

## Built on by (most cited first, 6 of 6)

- [Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancement](https://mlsanity.com/paper/2405.19464/) (2024)
- [Diffusion-based Reinforcement Learning for Dynamic UAV-assisted Vehicle Twins Migration in Vehicular Metaverses](https://mlsanity.com/paper/2406.05422/) (2024)
- [Confidence-Regulated Generative Diffusion Models for Reliable AI Agent Migration in Vehicular Metaverses](https://mlsanity.com/paper/2505.12710/) (2025)
- [When Generative Artificial Intelligence meets Extended Reality: A Systematic Review](https://mlsanity.com/paper/2511.03282/) (2025)
- [Distributed Radiance Fields for Edge Video Compression and Metaverse Integration in Autonomous Driving](https://mlsanity.com/paper/2402.14642/) (2024)
- [Metaverse Survey & Tutorial: Exploring Key Requirements, Technologies, Standards, Applications, Challenges, and Perspectives](https://mlsanity.com/paper/2405.04718/) (2024)

## Abstract (arXiv)

Metaverse seamlessly blends the physical world and virtual space via ubiquitous communication and computing infrastructure. In transportation systems, the vehicular Metaverse can provide a fully-immersive and hyperreal traveling experience (e.g., via augmented reality head-up displays, AR-HUDs) to drivers and users in autonomous vehicles (AVs) via roadside units (RSUs). However, provisioning real-time and immersive services necessitates effective physical-virtual synchronization between physical and virtual entities, i.e., AVs and Metaverse AR recommenders (MARs). In this paper, we propose a generative AI-empowered physical-virtual synchronization framework for the vehicular Metaverse. In physical-to-virtual synchronization, digital twin (DT) tasks generated by AVs are offloaded for execution in RSU with future route generation. In virtual-to-physical synchronization, MARs customize diverse and personal AR recommendations via generative AI models based on user preferences. Furthermore, we propose a multi-task enhanced auction-based mechanism to match and price AVs and MARs for RSUs to provision real-time and effective services. Finally, property analysis and experimental results demonstrate that the proposed mechanism is strategy-proof and adverse-selection free while increasing social surplus by 50%.