Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction
Not on the map. Why?
Abstract (arXiv)
For camera-based satellite visual sensing, Sim2Real data construction requires images that approach real-domain sensor appearance while retaining the annotations inherited from simulation. Real sensor images of satellite targets with reliable pose labels and component-level masks are difficult to acquire at scale, whereas synthetic rendering provides exact geometric annotations but suffers from a visible appearance gap. This paper presents a component-aware structure-preserving style transfer framework for satellite visual synthetic-to-real data construction. The method builds weakly paired real--synthetic samples from calibrated real acquisition, ArUco-based camera-pose measurement, CAD rendering, and component masks. It then extracts part-wise real-domain style codes from unlabeled real images and injects them into corresponding synthetic satellite regions through mask-aligned modulation. To keep the generated images usable for downstream sensor-data supervision, adversarial training is combined with local contrastive consistency, self-regularization, and edge-preserving constraints. Experiments are conducted on 5,000 rendered satellite images and 100 real images captured in a calibrated setup. The real images provide target-domain appearance references and final evaluation images, while the downstream GDRNet pose estimator is trained only on synthetic or translated synthetic images. Compared with representative image-translation baselines, the proposed method achieves the lowest image distribution discrepancy, with an FID of 54.32 and a KID of 0.048. When the translated data are used to train GDRNet in this target-domain adaptation setting, the ADD pass rate improves to 0.260 and the AUC improves to 0.611. These results indicate that component-level appearance transfer can improve annotation-preserving satellite visual Sim2Real data generation in the considered calibrated setup.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
21 of 37 references.
References · 21
- 2023Segment Anythingcited by 8,158
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 237
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
9 more
- 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
- 2019Satellite Pose Estimation Challenge: Dataset, Competition Design and Resultscited by 62
- 2021SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gapcited by 57
- 2019Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinementcited by 56
- 2019Deep Learning for Spacecraft Pose Estimation from Photorealistic Renderingcited by 54
- 2022Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gapcited by 44
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
- 2021Deep Learning-based Spacecraft Relative Navigation Methods: A Surveycited by 17
- 2022Sim2Real Instance-Level Style Transfer for 6D Pose Estimationcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.