A Style-Based Profiling Framework for Quantifying the Synthetic-to-Real Gap in Autonomous Driving Datasets
Not on the map. Why?
Abstract (arXiv)
Ensuring the reliability of autonomous driving perception systems requires extensive environment-based testing, yet real-world execution is often impractical. Synthetic datasets have therefore emerged as a promising alternative, offering advantages such as cost-effectiveness, bias free labeling, and controllable scenarios. However, the domain gap between synthetic and real-world datasets remains a major obstacle to model generalization. To address this challenge from a data-centric perspective, this paper introduces a profile extraction and discovery framework for characterizing the style profiles underlying both synthetic and real image datasets. We propose Style Embedding Distribution Discrepancy (SEDD) as a novel evaluation metric. Our framework combines Gram matrix-based style extraction with metric learning optimized for intra-class compactness and inter-class separation to extract style embeddings. Furthermore, we establish a benchmark using publicly available datasets. Experiments are conducted on a variety of datasets and sim-to-real methods, and the results show that our method is capable of quantifying the synthetic-to-real gap. This work provides a standardized profiling-based quality control paradigm that enables systematic diagnosis and targeted enhancement of synthetic datasets, advancing future development of data-driven autonomous driving systems.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
22 of 49 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,435
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,439
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2017NIMA: Neural Image Assessmentcited by 389
- 2020Virtual KITTI 2cited by 349
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 341
- 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
10 more
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2021Enhancing Photorealism Enhancementcited by 74
- 2019Improved Embeddings with Easy Positive Triplet Miningcited by 67
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
- 2022Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Drivingcited by 20
- 2022A Quality Index Metric and Method for Online Self-Assessment of Autonomous Vehicles Sensory Perceptioncited by 10
- 2024CARLA2Real: a tool for reducing the sim2real appearance gap in CARLA simulatorcited by 8
- 2024Exploring Generative AI for Sim2Real in Driving Data Synthesiscited by 7
- 2025Synthetic Dataset Evaluation Based on Generalized Cross Validationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.